Git Stars Git Stars

#vision-language-models Repositories

86
Total Repositories
198,329
Total Stars
2,306
Avg Stars/Repo
51
rai-opensource/vlfm

The repository provides code associated with the paper VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation (ICRA 2024)

rai-opensource
โญ 834 Python ๐Ÿ‘ค rai-opensource Organization ๐Ÿ• Updated 2025-11-12 ๐Ÿ“… Created 2023-07-04
52
taco-group/4KAgent

[NeurIPS 2025] 4KAgent: Agentic Any Image to 4K Super-Resolution. An intelligent computer vision agent that can magically restore any image to perfect-4K!

taco-group
โญ 830 Python ๐Ÿ‘ค taco-group Organization ๐Ÿ• Updated 2025-09-24 ๐Ÿ“… Created 2025-05-27
53
thu-ml/RDT2

Official code of RDT 2

thu-ml
โญ 811 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-02-07 ๐Ÿ“… Created 2025-09-19
54
mll-lab-nu/Awesome-Spatial-Intelligence-in-VLM

A paper list for spatial reasoning

mll-lab-nu
โญ 803 ๐Ÿ‘ค mll-lab-nu Organization ๐Ÿ• Updated 2026-08-23 ๐Ÿ“… Created 2025-02-07
55
microsoft/RegionCLIP

[CVPR 2022] Official code for "RegionCLIP: Region-based Language-Image Pretraining"

microsoft
โญ 800 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-03-20 ๐Ÿ“… Created 2022-03-18
57
bryanswkim/Chain-of-Zoom

[NeurIPS'25 Spotlight] Official repository for "Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment"

bryanswkim
โญ 777 Python ๐Ÿ‘ค bryanswkim User ๐Ÿ• Updated 2025-09-27 ๐Ÿ“… Created 2025-05-26
58
ModalMinds/MM-EUREKA

MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning

ModalMinds
โญ 770 Python ๐Ÿ‘ค ModalMinds Organization ๐Ÿ• Updated 2025-09-07 ๐Ÿ“… Created 2025-03-07
59
zli12321/Vision-Language-Models-Overview

A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.

zli12321
โญ 733 HTML ๐Ÿ‘ค zli12321 User ๐Ÿ• Updated 2026-10-13 ๐Ÿ“… Created 2024-11-27
โญ 715 Python ๐Ÿ‘ค SkunkworksAI Organization ๐Ÿ• Updated 2024-03-06 ๐Ÿ“… Created 2023-10-10
61
lupantech/ScienceQA

Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".

lupantech
โญ 715 Python ๐Ÿ‘ค lupantech User ๐Ÿ• Updated 2024-09-19 ๐Ÿ“… Created 2022-10-17
62
kerrj/lerf

Code for LERF: Language Embedded Radiance Fields

kerrj
โญ 710 Python ๐Ÿ‘ค kerrj User ๐Ÿ• Updated 2024-07-09 ๐Ÿ“… Created 2023-04-04
63
taokz/BiomedGPT

BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks

taokz
โญ 707 Python ๐Ÿ‘ค taokz User ๐Ÿ• Updated 2025-07-08 ๐Ÿ“… Created 2023-05-11
65
magic-research/PLLaVA

Official repository for the paper PLLaVA

magic-research
โญ 676 Python ๐Ÿ‘ค magic-research Organization ๐Ÿ• Updated 2024-07-28 ๐Ÿ“… Created 2024-04-18
66
xiaomi-mlab/Orion

[ICCV 2025] Official code of "ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generation"

xiaomi-mlab
โญ 674 Python ๐Ÿ‘ค xiaomi-mlab User ๐Ÿ• Updated 2026-06-22 ๐Ÿ“… Created 2025-03-11
67
RyanWangZf/MedCLIP

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts

RyanWangZf
โญ 652 Python ๐Ÿ‘ค RyanWangZf User ๐Ÿ• Updated 2024-04-12 ๐Ÿ“… Created 2022-02-19
68
run-llama/ParseBench

ParseBench - A Document Parsing Benchmark for AI Agents

run-llama
โญ 650 Python ๐Ÿ‘ค run-llama Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-10
69
zqhang/AnomalyCLIP

Official implementation for AnomalyCLIP (ICLR 2024)

zqhang
โญ 648 Python ๐Ÿ‘ค zqhang User ๐Ÿ• Updated 2025-07-08 ๐Ÿ“… Created 2023-10-19
70
PromtEngineer/localGPT-Vision

Chat with your documents using Vision Language Models. This repo implements an End to End RAG pipeline with both local and proprietary VLMs

PromtEngineer
โญ 633 Python ๐Ÿ‘ค PromtEngineer User ๐Ÿ• Updated 2025-07-26 ๐Ÿ“… Created 2024-10-01
71
xiaomi-research/recogdrive

[ICLR 2026] ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving

xiaomi-research
โญ 632 Python ๐Ÿ‘ค xiaomi-research Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-06-05
72
VectorSpaceLab/Video-XL

๐Ÿ”ฅ๐Ÿ”ฅFirst-ever hour scale video understanding models

VectorSpaceLab
โญ 626 Python ๐Ÿ‘ค VectorSpaceLab Organization ๐Ÿ• Updated 2025-07-14 ๐Ÿ“… Created 2024-09-20
73
Ucas-HaoranWei/Vary-toy

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)

Ucas-HaoranWei
โญ 626 Python ๐Ÿ‘ค Ucas-HaoranWei User ๐Ÿ• Updated 2024-12-30 ๐Ÿ“… Created 2024-01-10
74
opendilab/awesome-multi-modal-reinforcement-learning

A curated list of Multi-Modal Reinforcement Learning resources (continually updated)

opendilab
โญ 621 ๐Ÿ‘ค opendilab Organization ๐Ÿ• Updated 2026-05-30 ๐Ÿ“… Created 2022-09-01
75
thu-coai/Glyph

Official Repository for "Glyph: Scaling Context Windows via Visual-Text Compression"

thu-coai
โญ 612 Python ๐Ÿ‘ค thu-coai Organization ๐Ÿ• Updated 2025-11-04 ๐Ÿ“… Created 2025-10-20
76
levyflux/AViD

Framework that enables fine-tuning of vision-language grounding models on custom datasets

levyflux
โญ 608 Python ๐Ÿ‘ค levyflux User ๐Ÿ• Updated 2026-08-30 ๐Ÿ“… Created 2025-03-19
77
lwpyh/Awesome-MLLM-Reasoning-Collection

A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.

lwpyh
โญ 598 ๐Ÿ‘ค lwpyh User ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2025-03-16
78
THUDM/INFTY

INFTY Engine: An Optimization Toolkit to Support Continual AI

THUDM
โญ 578 Python ๐Ÿ‘ค THUDM Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2025-09-11
81
worldbench/awesome-vla-for-ad

๐ŸŒ Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

worldbench
โญ 530 HTML ๐Ÿ‘ค worldbench Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2025-09-07
82
mbzuai-oryx/XrayGPT

[BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

mbzuai-oryx
โญ 526 Python ๐Ÿ‘ค mbzuai-oryx Organization ๐Ÿ• Updated 2024-08-08 ๐Ÿ“… Created 2023-05-18
83
mll-lab-nu/VAGEN

World model reinforcement learning for multi-turn VLM agents. RL for vision framework (NeurIPS 2025).

mll-lab-nu
โญ 525 Python ๐Ÿ‘ค mll-lab-nu Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-03-04
84
luogen1996/LaVIN

[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"

luogen1996
โญ 525 Python ๐Ÿ‘ค luogen1996 User ๐Ÿ• Updated 2024-01-27 ๐Ÿ“… Created 2023-05-15
86
erwinmsmith/SOMAS

A Trusted Human-Multi-Agent Reinforcement Learning Interaction Framework

erwinmsmith
โญ 502 Python ๐Ÿ‘ค erwinmsmith User ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2025-05-13