Git Stars Git Stars

#vision-language-models Repositories

Discover 86 active open source GitHub repositories tagged with #vision-language-models, accumulating 198,329 total stars (averaging 2,306 stars per project). Leading this topic is Vision-CAIR/MiniGPT-4 with 25,770 stars.

86
Total Repositories
198,329
Total Stars
2,306
Avg Stars/Repo
1
Vision-CAIR/MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Vision-CAIR
โญ 25,770 Python ๐Ÿ‘ค Vision-CAIR Organization ๐Ÿ• Updated 2024-09-02 ๐Ÿ“… Created 2023-04-15
2
deepseek-ai/DeepSeek-OCR

Contexts Optical Compression

deepseek-ai
โญ 24,180 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-01-27 ๐Ÿ“… Created 2025-10-17
3
allenai/olmocr

Toolkit for linearizing PDFs for LLM datasets/training

allenai
โญ 19,838 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2026-03-25 ๐Ÿ“… Created 2024-09-17
4
NVIDIA/Isaac-GR00T

NVIDIA Isaac GR00T N1.7 - A Foundation Model for Generalist Robots.

NVIDIA
โญ 8,402 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-03-11
5
apple-aiml-research/ml-fastvlm

This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025

apple-aiml-research
โญ 7,445 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2025-05-01
6
LargeWorldModel/LWM

Large World Model -- Modeling Text and Video with Millions Context

LargeWorldModel
โญ 7,391 Python ๐Ÿ‘ค LargeWorldModel Organization ๐Ÿ• Updated 2024-10-19 ๐Ÿ“… Created 2024-02-08
7
google/gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

google
โญ 7,089 C++ ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-02-13
8
huggingface/nanoVLM

The simplest, fastest repository for training/finetuning small-sized VLMs.

huggingface
โญ 5,063 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2025-10-27 ๐Ÿ“… Created 2025-05-02
9
lumina-ai-inc/chunkr

Vision infrastructure to turn complex documents into LLM-ready data

lumina-ai-inc
โญ 4,154 Rust ๐Ÿ‘ค lumina-ai-inc Organization ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2024-08-24
10
StarsfieldAI/R1-V

Witness the aha moment of VLM with less than $3.

StarsfieldAI
โญ 4,058 Python ๐Ÿ‘ค StarsfieldAI Organization ๐Ÿ• Updated 2025-05-19 ๐Ÿ“… Created 2025-02-02
11
NVlabs/VILA

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

NVlabs
โญ 3,873 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2024-02-23
12
jonyzhang2023/awesome-embodied-vla-va-vln

A curated list of state-of-the-art research in embodied AI, focusing on vision-language-action (VLA) models, vision-language navigation (VLN), and related multimodal learning approaches.

jonyzhang2023
โญ 3,634 ๐Ÿ‘ค jonyzhang2023 User ๐Ÿ• Updated 2026-09-15 ๐Ÿ“… Created 2025-01-16
13
OmniSVG/OmniSVG

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

OmniSVG
โญ 2,666 Python ๐Ÿ‘ค OmniSVG User ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2025-04-07
14
facebookresearch/perception_models

State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!

facebookresearch
โญ 2,415 Jupyter Notebook ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-04-13 ๐Ÿ“… Created 2025-04-16
โญ 2,288 Jupyter Notebook ๐Ÿ‘ค imanoop7 User ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2024-11-28
16
opendatalab/OmniDocBench

[CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation

opendatalab
โญ 2,183 Python ๐Ÿ‘ค opendatalab Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2024-10-14
17
PKU-YuanGroup/LLaVA-CoT

[ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning

PKU-YuanGroup
โญ 2,129 Python ๐Ÿ‘ค PKU-YuanGroup Organization ๐Ÿ• Updated 2025-12-12 ๐Ÿ“… Created 2024-11-17
18
Tencent-Hunyuan/HunyuanOCR

HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better

Tencent-Hunyuan
โญ 2,091 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2025-11-18
19
chn-lee-yumi/MaterialSearch

Semantic search. Search local photos and videos through natural language. AI semantic search local material. Search by image, find local material, match scenes by text description, video frame search, search videos by scene description.

chn-lee-yumi
โญ 1,998 HTML ๐Ÿ‘ค chn-lee-yumi User ๐Ÿ• Updated 2026-09-21 ๐Ÿ“… Created 2023-03-16
21
gpt-omni/mini-omni2

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities.

gpt-omni
โญ 1,896 Python ๐Ÿ‘ค gpt-omni Organization ๐Ÿ• Updated 2025-01-16 ๐Ÿ“… Created 2024-10-14
22
facebookresearch/MetaCLIP

NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024

facebookresearch
โญ 1,856 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-08-11 ๐Ÿ“… Created 2023-09-28
23
kijai/ComfyUI-Florence2

Inference Microsoft Florence2 VLM

kijai
โญ 1,764 Python ๐Ÿ‘ค kijai User ๐Ÿ• Updated 2026-05-06 ๐Ÿ“… Created 2024-06-19
24
baaivision/Emu3.5

Native Multimodal Models are World Learners

baaivision
โญ 1,567 Python ๐Ÿ‘ค baaivision Organization ๐Ÿ• Updated 2025-12-30 ๐Ÿ“… Created 2025-10-29
25
tjmlabs/ColiVara

Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.

tjmlabs
โญ 1,485 Python ๐Ÿ‘ค tjmlabs Organization ๐Ÿ• Updated 2026-07-08 ๐Ÿ“… Created 2024-09-21
27
Sun-Haoyuan23/Awesome-RL-based-Reasoning-MLLMs

This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-based Reasoning MLLMs!

Sun-Haoyuan23
โญ 1,449 ๐Ÿ‘ค Sun-Haoyuan23 User ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2025-02-21
28
rmokady/CLIP_prefix_caption

Simple image captioning model

rmokady
โญ 1,407 Jupyter Notebook ๐Ÿ‘ค rmokady User ๐Ÿ• Updated 2024-06-09 ๐Ÿ“… Created 2021-09-16
29
SakanaAI/evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes

SakanaAI
โญ 1,394 Python ๐Ÿ‘ค SakanaAI Organization ๐Ÿ• Updated 2024-11-29 ๐Ÿ“… Created 2024-03-05
30
gokayfem/awesome-vlm-architectures

Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

gokayfem
โญ 1,368 Markdown ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-02-15
31
Computer-Vision-in-the-Wild/CVinW_Readings

A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

Computer-Vision-in-the-Wild
โญ 1,349 ๐Ÿ‘ค Computer-Vision-in-the-Wild Organization ๐Ÿ• Updated 2024-03-14 ๐Ÿ“… Created 2022-09-28
32
X-Square-Robot/wall-x

Building General-Purpose Robots Based on Embodied Foundation Model

X-Square-Robot
โญ 1,337 Python ๐Ÿ‘ค X-Square-Robot Organization ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2025-09-04
โญ 1,293 Python ๐Ÿ‘ค Visual-Agent Organization ๐Ÿ• Updated 2025-11-20 ๐Ÿ“… Created 2025-03-15
35
aiming-lab/Agent0

[ICML'26 & COLM'26] Agent0 Series: Self-Evolving Agents from Zero Data

aiming-lab
โญ 1,292 Python ๐Ÿ‘ค aiming-lab Organization ๐Ÿ• Updated 2026-07-10 ๐Ÿ“… Created 2025-10-20
โญ 1,125 ๐Ÿ‘ค 52CV User ๐Ÿ• Updated 2024-06-27 ๐Ÿ“… Created 2023-11-29
37
reacher-z/Awesome-CUA

Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.

reacher-z
โญ 1,072 Python ๐Ÿ‘ค reacher-z User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-16
38
nvidia-cosmos/cosmos-reason1

Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.

nvidia-cosmos
โญ 965 Python ๐Ÿ‘ค nvidia-cosmos Organization ๐Ÿ• Updated 2026-06-07 ๐Ÿ“… Created 2025-03-02
39
huangwl18/ReKep

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation

huangwl18
โญ 950 Python ๐Ÿ‘ค huangwl18 User ๐Ÿ• Updated 2025-02-20 ๐Ÿ“… Created 2024-08-29
40
mst272/LLM-Dojo

Lightweight LLM Post-training Framework, supports SFT, RLVR, On-Policy KD, Guide KD, and mixed training; implements single/multi-round Guide distillation, multi-teacher distillation, Reward mixed training, and automated data sharding๐Ÿ‘ฉโ€๐ŸŽ“๐Ÿ‘จโ€๐ŸŽ“

mst272
โญ 939 Python ๐Ÿ‘ค mst272 User ๐Ÿ• Updated 2026-03-08 ๐Ÿ“… Created 2024-01-23
41
Qinying-Liu/Awesome-Open-Vocabulary-Semantic-Segmentation

A curated publication list on open vocabulary semantic segmentation and related area (e.g. zero-shot semantic segmentation) resources..

Qinying-Liu
โญ 910 ๐Ÿ‘ค Qinying-Liu User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2023-09-28
42
TRI-ML/prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

TRI-ML
โญ 894 Python ๐Ÿ‘ค TRI-ML Organization ๐Ÿ• Updated 2024-07-04 ๐Ÿ“… Created 2024-02-13
43
LYL1015/JarvisArt

[NeurIPS' 2025] JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

LYL1015
โญ 880 Python ๐Ÿ‘ค LYL1015 User ๐Ÿ• Updated 2026-04-04 ๐Ÿ“… Created 2025-06-24
44
beichenzbc/Long-CLIP

[ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"

beichenzbc
โญ 879 Python ๐Ÿ‘ค beichenzbc User ๐Ÿ• Updated 2024-08-13 ๐Ÿ“… Created 2024-03-20
45
InternLM/Intern-S1

A Scientific Multimodal Foundation Model

InternLM
โญ 876 ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2026-09-13 ๐Ÿ“… Created 2025-07-25
46
RiseInRose/MiniGPT-4-ZH

MiniGPT-4 Chinese Deployment Translation Refine deployment details

RiseInRose
โญ 859 Python ๐Ÿ‘ค RiseInRose User ๐Ÿ• Updated 2026-05-09 ๐Ÿ“… Created 2023-04-19
โญ 853 Python ๐Ÿ‘ค jiayev User ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2023-12-27
48
allenai/molmo

Code for the Molmo Vision-Language Model

allenai
โญ 851 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2024-12-12 ๐Ÿ“… Created 2024-12-05
49
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
50
showlab/Awesome-Unified-Multimodal-Models

๐Ÿ“– This is a repository for organizing papers, codes and other resources related to unified multimodal models.

showlab
โญ 834 ๐Ÿ‘ค showlab Organization ๐Ÿ• Updated 2025-10-10 ๐Ÿ“… Created 2024-08-27

Frequently Asked Questions

1

What is the most popular #vision-language-models repository on GitHub?

The top ranked open source #vision-language-models project on GitHub is Vision-CAIR/MiniGPT-4 with 25,770 stars. Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

2

Which programming languages are most used in #vision-language-models repositories?

Among the top ranked #vision-language-models projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, Rust.

3

How is the #vision-language-models repository ranking calculated?

We track 86 active open source repositories tagged with #vision-language-models (500+ stars), totaling 198,329 stars with an average of 2,306 stars per repository. Rankings update daily from the GitHub API.