#vision-language-models Repositories
Discover 86 active open source GitHub repositories tagged with #vision-language-models, accumulating 198,329 total stars (averaging 2,306 stars per project). Leading this topic is Vision-CAIR/MiniGPT-4 with 25,770 stars.
86 repositories total
Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025
VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.
A curated list of state-of-the-art research in embodied AI, focusing on vision-language-action (VLA) models, vision-language navigation (VLN), and related multimodal learning approaches.
[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.
State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
[CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation
[ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning
Semantic search. Search local photos and videos through natural language. AI semantic search local material. Search by image, find local material, match scenes by text description, video frame search, search videos by scene description.
Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.
This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-based Reasoning MLLMs!
Official repository of Evolutionary Optimization of Model Merging Recipes
Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.
A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''
Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.
ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
Lightweight LLM Post-training Framework, supports SFT, RLVR, On-Policy KD, Guide KD, and mixed training; implements single/multi-round Guide distillation, multi-teacher distillation, Reward mixed training, and automated data sharding๐ฉโ๐๐จโ๐
A curated publication list on open vocabulary semantic segmentation and related area (e.g. zero-shot semantic segmentation) resources..
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
[NeurIPS' 2025] JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent
[ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
๐ This is a repository for organizing papers, codes and other resources related to unified multimodal models.
Frequently Asked Questions
What is the most popular #vision-language-models repository on GitHub?
The top ranked open source #vision-language-models project on GitHub is Vision-CAIR/MiniGPT-4 with 25,770 stars. Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
Which programming languages are most used in #vision-language-models repositories?
Among the top ranked #vision-language-models projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, Rust.
How is the #vision-language-models repository ranking calculated?
We track 86 active open source repositories tagged with #vision-language-models (500+ stars), totaling 198,329 stars with an average of 2,306 stars per repository. Rankings update daily from the GitHub API.