Git Stars Git Stars

#vision-language-model Repositories

82
Total Repositories
263,383
Total Stars
3,211
Avg Stars/Repo
51
Anionex/dsh-vision-toolkit

[dsh] A more powerful visual toolkit designed for text-only models: one-line installation and usage, direct image recognition by pasting images, multi-image Q&A, screenshot-to-frontend UI restoration, and more๏ฝœDeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.

Anionex
โญ 949 TypeScript ๐Ÿ‘ค Anionex User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-13
52
PKU-YuanGroup/Chat-UniVi

[CVPR 2024 Highlight๐Ÿ”ฅ] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

PKU-YuanGroup
โญ 943 Python ๐Ÿ‘ค PKU-YuanGroup Organization ๐Ÿ• Updated 2024-10-16 ๐Ÿ“… Created 2023-11-13
53
Valen-Team/Valen

Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate with bounding boxes, in place of generated text. Free API, ONNX, GGUF, vLLM and SGLang; fine-tuning code included.

Valen-Team
โญ 932 Python ๐Ÿ‘ค Valen-Team Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-09-23
54
facebookresearch/ShapeR

Code for the ShapeR research paper

facebookresearch
โญ 904 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-04-30 ๐Ÿ“… Created 2026-01-14
55
SkalskiP/top-cvpr-2025-papers

About This repository is a curated collection of the most exciting and influential CVPR 2025 papers. ๐Ÿ”ฅ [Paper + Code + Demo]

SkalskiP
โญ 899 Python ๐Ÿ‘ค SkalskiP User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2025-05-31
56
xlang-ai/OpenCUA

[NeurIPS 2025 Spotlight] OpenCUA: Open Foundations for Computer-Use Agents

xlang-ai
โญ 877 Python ๐Ÿ‘ค xlang-ai Organization ๐Ÿ• Updated 2026-05-25 ๐Ÿ“… Created 2025-06-21
57
SunzeY/AlphaCLIP

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

SunzeY
โญ 876 Jupyter Notebook ๐Ÿ‘ค SunzeY User ๐Ÿ• Updated 2025-07-20 ๐Ÿ“… Created 2023-11-27
59
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
60
mlfoundations/MINT-1T

๐Ÿƒ MINT-1T: A one trillion token multimodal interleaved dataset.

mlfoundations
โญ 828 ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2024-07-31 ๐Ÿ“… Created 2024-06-16
61
zubair-irshad/Awesome-Robotics-3D

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

zubair-irshad
โญ 824 ๐Ÿ‘ค zubair-irshad User ๐Ÿ• Updated 2025-12-17 ๐Ÿ“… Created 2024-08-12
62
huangwl18/VoxPoser

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

huangwl18
โญ 806 Python ๐Ÿ‘ค huangwl18 User ๐Ÿ• Updated 2025-02-20 ๐Ÿ“… Created 2023-11-02
63
zhengli97/Awesome-Prompt-Adapter-Learning-for-VLMs-CLIP

A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.

zhengli97
โญ 802 ๐Ÿ‘ค zhengli97 User ๐Ÿ• Updated 2026-07-17 ๐Ÿ“… Created 2024-03-15
64
2toinf/X-VLA

[ICLR 2026] The offical Implementation of "Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model"

2toinf
โญ 762 C++ ๐Ÿ‘ค 2toinf User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2025-09-25
65
magicrew/doc7

Turn documents into AI-ready Markdown with visual understanding

magicrew
โญ 719 Go ๐Ÿ‘ค magicrew Organization ๐Ÿ• Updated 2026-08-07 ๐Ÿ“… Created 2026-08-02
66
NVlabs/OmniVinci

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

NVlabs
โญ 683 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-08-31 ๐Ÿ“… Created 2025-09-24
67
wanshuiyin/ARIS-in-AI-Offer

Bilingual (Chinese + English) ML / LLM / diffusion / agent interview cheat sheets for AI autumn recruiting โ€” generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML that can be read anywhere โ€” plus a CVโ†’DBLP fact-checked academic homepage generator and hand-authored long-form blogs ๐ŸŒฑ

wanshuiyin
โญ 661 Python ๐Ÿ‘ค wanshuiyin User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-05-19
โญ 650 ๐Ÿ‘ค XiaomiMiMo Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-05-29
โญ 647 Python ๐Ÿ‘ค Visual-Agent Organization ๐Ÿ• Updated 2026-02-26 ๐Ÿ“… Created 2025-10-31
70
NJU-3DV/SpatialVID

[CVPR 2026] SpatialVID: A Large-Scale Video Dataset with Spatial Annotations

NJU-3DV
โญ 614 Python ๐Ÿ‘ค NJU-3DV Organization ๐Ÿ• Updated 2026-04-22 ๐Ÿ“… Created 2025-09-10
71
LAMDA-CL/LAMDA-PILOT

๐ŸŽ‰ PILOT: A Pre-trained Model-Based Continual Learning Toolbox

LAMDA-CL
โญ 614 Python ๐Ÿ‘ค LAMDA-CL Organization ๐Ÿ• Updated 2026-01-29 ๐Ÿ“… Created 2023-08-30
72
linzhiqiu/t2v_metrics

Evaluating text-to-image/video/3D models with VQAScore

linzhiqiu
โญ 607 Python ๐Ÿ‘ค linzhiqiu User ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2023-12-16
73
IuvenisSapiens/ComfyUI_Qwen3-VL-Instruct

The successful integration of Qwen3-VL-Instruct series into the ComfyUI platform has enabled a smooth operation, supporting (but not limited to) text-based queries, video queries, single-image queries, and multi-image queries for generating captions or responses.

IuvenisSapiens
โญ 587 Python ๐Ÿ‘ค IuvenisSapiens User ๐Ÿ• Updated 2025-10-23 ๐Ÿ“… Created 2024-08-31
74
FoundationVision/Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

FoundationVision
โญ 582 Python ๐Ÿ‘ค FoundationVision Organization ๐Ÿ• Updated 2024-06-07 ๐Ÿ“… Created 2024-04-21
75
ictnlp/LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

ictnlp
โญ 575 Python ๐Ÿ‘ค ictnlp Organization ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2025-01-07
76
cambrian-mllm/cambrian-s

Cambrian-S: Towards Spatial Supersensing in Video

cambrian-mllm
โญ 573 Python ๐Ÿ‘ค cambrian-mllm Organization ๐Ÿ• Updated 2026-04-03 ๐Ÿ“… Created 2025-10-13
77
Flame-Code-VLM/Flame-Code-VLM

Flame is an open-source multimodal AI system designed to translate UI design mockups into high-quality React code. It leverages vision-language modeling, automated data synthesis, and structured training workflows to bridge the gap between design and front-end development.

Flame-Code-VLM
โญ 564 Python ๐Ÿ‘ค Flame-Code-VLM Organization ๐Ÿ• Updated 2026-02-11 ๐Ÿ“… Created 2025-02-10
78
OpenGVLab/Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

OpenGVLab
โญ 553 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2024-04-21 ๐Ÿ“… Created 2023-05-10
79
Mengqi-Lei/count-anything

Code and implementation guidelines for the paper โœจCounting Anything. Project Page: https://mengqi-lei.github.io/count-anything-projectpage/

Mengqi-Lei
โญ 545 Python ๐Ÿ‘ค Mengqi-Lei User ๐Ÿ• Updated 2026-08-12 ๐Ÿ“… Created 2026-05-18
80
vulab-AI/Awesome-Spatial-VLMs

[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;

vulab-AI
โญ 525 Python ๐Ÿ‘ค vulab-AI Organization ๐Ÿ• Updated 2026-07-30 ๐Ÿ“… Created 2025-07-10
81
mll-lab-nu/VAGEN

World model reinforcement learning for multi-turn VLM agents. RL for vision framework (NeurIPS 2025).

mll-lab-nu
โญ 525 Python ๐Ÿ‘ค mll-lab-nu Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-03-04
82
Jiaaqiliu/Awesome-VLA-Robotics

A comprehensive list of excellent research papers, models, datasets, and other resources on Visionโ€‘Languageโ€‘Action (VLA) models in robotics.

Jiaaqiliu
โญ 505 ๐Ÿ‘ค Jiaaqiliu User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2025-04-21