#vision-language-model Repositories
82 repositories total
[dsh] A more powerful visual toolkit designed for text-only models: one-line installation and usage, direct image recognition by pasting images, multi-image Q&A, screenshot-to-frontend UI restoration, and more๏ฝDeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.
[CVPR 2024 Highlight๐ฅ] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate with bounding boxes, in place of generated text. Free API, ONNX, GGUF, vLLM and SGLang; fine-tuning code included.
About This repository is a curated collection of the most exciting and influential CVPR 2025 papers. ๐ฅ [Paper + Code + Demo]
A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.
[ICLR 2026] The offical Implementation of "Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model"
OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.
Bilingual (Chinese + English) ML / LLM / diffusion / agent interview cheat sheets for AI autumn recruiting โ generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML that can be read anywhere โ plus a CVโDBLP fact-checked academic homepage generator and hand-authored long-form blogs ๐ฑ
The successful integration of Qwen3-VL-Instruct series into the ComfyUI platform has enabled a smooth operation, supporting (but not limited to) text-based queries, video queries, single-image queries, and multi-image queries for generating captions or responses.
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
Flame is an open-source multimodal AI system designed to translate UI design mockups into high-quality React code. It leverages vision-language modeling, automated data synthesis, and structured training workflows to bridge the gap between design and front-end development.
Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!
Code and implementation guidelines for the paper โจCounting Anything. Project Page: https://mengqi-lei.github.io/count-anything-projectpage/
[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;
World model reinforcement learning for multi-turn VLM agents. RL for vision framework (NeurIPS 2025).
A comprehensive list of excellent research papers, models, datasets, and other resources on VisionโLanguageโAction (VLA) models in robotics.