Git Stars Git Stars

#vision-language Repositories

Discover 20 active open source GitHub repositories tagged with #vision-language, accumulating 40,771 total stars (averaging 2,038 stars per project). Leading this topic is IDEA-Research/GroundingDINO with 9,509 stars.

20
Total Repositories
40,771
Total Stars
2,038
Avg Stars/Repo
1
IDEA-Research/GroundingDINO

[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

IDEA-Research
โญ 9,509 Python ๐Ÿ‘ค IDEA-Research Organization ๐Ÿ• Updated 2024-08-12 ๐Ÿ“… Created 2023-03-09
2
OFA-Sys/Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

OFA-Sys
โญ 6,056 Jupyter Notebook ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2026-03-31 ๐Ÿ“… Created 2022-07-08
3
salesforce/BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

salesforce
โญ 5,626 Jupyter Notebook ๐Ÿ‘ค salesforce Organization ๐Ÿ• Updated 2024-08-05 ๐Ÿ“… Created 2022-01-25
4
OFA-Sys/OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

OFA-Sys
โญ 2,550 Python ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2024-04-24 ๐Ÿ“… Created 2022-01-29
5
2U1/Qwen-VL-Series-Finetune

An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.

2U1
โญ 1,983 Python ๐Ÿ‘ค 2U1 User ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2024-09-10
6
AlibabaResearch/AdvancedLiterateMachinery

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

AlibabaResearch
โญ 1,832 C++ ๐Ÿ‘ค AlibabaResearch Organization ๐Ÿ• Updated 2026-03-17 ๐Ÿ“… Created 2022-09-28
7
mbzuai-oryx/Video-ChatGPT

[ACL 2024 ๐Ÿ”ฅ] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

mbzuai-oryx
โญ 1,516 Python ๐Ÿ‘ค mbzuai-oryx Organization ๐Ÿ• Updated 2026-09-05 ๐Ÿ“… Created 2023-05-18
8
llm-jp/awesome-japanese-llm

Japanese LLM Summary - Overview of Japanese LLMs

llm-jp
โญ 1,446 TypeScript ๐Ÿ‘ค llm-jp Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2023-07-09
9
OpenDriveLab/DriveLM

[ECCV 2024 Oral] DriveLM: Driving with Graph Visual Question Answering

OpenDriveLab
โญ 1,325 HTML ๐Ÿ‘ค OpenDriveLab Organization ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2023-08-08
10
OFA-Sys/ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

OFA-Sys
โญ 1,063 Python ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2024-10-06 ๐Ÿ“… Created 2023-05-18
11
TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

TinyLLaVA
โญ 1,010 Python ๐Ÿ‘ค TinyLLaVA User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2024-02-21
12
mees/calvin

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

mees
โญ 985 Python ๐Ÿ‘ค mees User ๐Ÿ• Updated 2025-09-08 ๐Ÿ“… Created 2021-07-20
13
SunzeY/AlphaCLIP

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

SunzeY
โญ 876 Jupyter Notebook ๐Ÿ‘ค SunzeY User ๐Ÿ• Updated 2025-07-20 ๐Ÿ“… Created 2023-11-27
14
mbzuai-oryx/LLaVA-pp

๐Ÿ”ฅ๐Ÿ”ฅ LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

mbzuai-oryx
โญ 843 Python ๐Ÿ‘ค mbzuai-oryx Organization ๐Ÿ• Updated 2026-09-05 ๐Ÿ“… Created 2024-04-26
15
longzw1997/Open-GroundingDino

This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.

longzw1997
โญ 840 Python ๐Ÿ‘ค longzw1997 User ๐Ÿ• Updated 2025-07-27 ๐Ÿ“… Created 2023-10-14
16
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
17
Algolzw/daclip-uir

[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.

Algolzw
โญ 799 Python ๐Ÿ‘ค Algolzw User ๐Ÿ• Updated 2024-08-07 ๐Ÿ“… Created 2023-09-30
18
AILab-CVC/SEED

Official implementation of SEED-LLaMA (ICLR 2024).

AILab-CVC
โญ 638 Python ๐Ÿ‘ค AILab-CVC Organization ๐Ÿ• Updated 2024-09-21 ๐Ÿ“… Created 2023-07-15
19
worldbench/awesome-vla-for-ad

๐ŸŒ Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

worldbench
โญ 530 HTML ๐Ÿ‘ค worldbench Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2025-09-07
20
zhaozh10/Awesome-CLIP-in-Medical-Imaging

A Survey on CLIP in Medical Imaging

zhaozh10
โญ 509 ๐Ÿ‘ค zhaozh10 User ๐Ÿ• Updated 2025-03-26 ๐Ÿ“… Created 2023-11-21

Frequently Asked Questions

1

What is the most popular #vision-language repository on GitHub?

The top ranked open source #vision-language project on GitHub is IDEA-Research/GroundingDINO with 9,509 stars. [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

2

Which programming languages are most used in #vision-language repositories?

Among the top ranked #vision-language projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, HTML.

3

How is the #vision-language repository ranking calculated?

We track 20 active open source repositories tagged with #vision-language (500+ stars), totaling 40,771 stars with an average of 2,038 stars per repository. Rankings update daily from the GitHub API.