Git Stars Git Stars

#vlm Repositories

Discover 89 active open source GitHub repositories tagged with #vlm, accumulating 457,898 total stars (averaging 5,144 stars per project). Leading this topic is huggingface/transformers with 169,339 stars.

89
Total Repositories
457,898
Total Stars
5,144
Avg Stars/Repo
1
huggingface/transformers

๐Ÿค— Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

huggingface
โญ 169,339 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-10-29
2
bytedance/UI-TARS-desktop

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

bytedance
โญ 39,583 TypeScript ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2025-01-19
3
sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-project
โญ 38,899 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-08
4
JuneYaooo/rea-video

Reverse-engineer any video, shot by shot: whether it was filmed, AI-generated, or codedโ€”and how to recreate it. Breakdowns in the open VIDEO.md format. Reverse-engineer any video, shot by shot: see whether it was filmed, AI-generated, or coded, then learn how to recreate it; breakdowns are output in the open VIDEO.md format.

JuneYaooo
โญ 11,577 Python ๐Ÿ‘ค JuneYaooo User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-29
5
StarTrail-org/PixelRAG

https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

StarTrail-org
โญ 10,976 Python ๐Ÿ‘ค StarTrail-org Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-05-29
6
RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

RunanywhereAI
โญ 10,354 C++ ๐Ÿ‘ค RunanywhereAI Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2025-07-22
7
roboflow/notebooks

A collection of tutorials on state-of-the-art computer vision models and techniques. Explore everything from foundational architectures like ResNet to cutting-edge models like RF-DETR, YOLO11, SAM 3, and Qwen3-VL.

roboflow
โญ 9,749 Jupyter Notebook ๐Ÿ‘ค roboflow Organization ๐Ÿ• Updated 2026-09-22 ๐Ÿ“… Created 2022-11-18
8
yzhao062/anomaly-detection-resources

Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!

yzhao062
โญ 9,457 Python ๐Ÿ‘ค yzhao062 User ๐Ÿ• Updated 2026-03-02 ๐Ÿ“… Created 2018-05-16
9
oumi-ai/oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

oumi-ai
โญ 9,441 Python ๐Ÿ‘ค oumi-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-05-07
10
qualcomm/GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

qualcomm
โญ 8,544 Go ๐Ÿ‘ค qualcomm Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-08-16
11
PaddlePaddle/ERNIE

The official repository for ERNIE 4.5 and ERNIEKit โ€“ its industrial-grade development toolkit based on PaddlePaddle.

PaddlePaddle
โญ 7,739 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-07-24 ๐Ÿ“… Created 2019-03-03
12
om-ai-lab/VLM-R1

Solve Visual Understanding with Reinforced VLMs

om-ai-lab
โญ 6,048 Python ๐Ÿ‘ค om-ai-lab Organization ๐Ÿ• Updated 2026-07-07 ๐Ÿ“… Created 2025-02-06
13
OpenBMB/UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

OpenBMB
โญ 5,748 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-16
14
changyeyu/LLM-RL-Visualized

๐ŸŒŸ100+ Original LLM / RL Diagrams ๐Ÿ“š, by the author of "Large Model Algorithms"! ๐Ÿ’ฅ (100+ LLM/RL Algorithm Maps)

changyeyu
โญ 5,032 Python ๐Ÿ‘ค changyeyu User ๐Ÿ• Updated 2026-09-10 ๐Ÿ“… Created 2025-04-26
15
joanrod/star-vector

StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.

joanrod
โญ 4,639 Python ๐Ÿ‘ค joanrod User ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2023-12-11
16
EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

EvolvingLMMs-Lab
โญ 4,501 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-03-07
17
Hunyuan-PromptEnhancer/PromptEnhancer

[CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.

Hunyuan-PromptEnhancer
โญ 3,808 Python ๐Ÿ‘ค Hunyuan-PromptEnhancer Organization ๐Ÿ• Updated 2026-08-18 ๐Ÿ“… Created 2025-09-09
18
modelscope/evalscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

modelscope
โญ 3,715 Python ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-12-07
19
mit-han-lab/llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

mit-han-lab
โญ 3,590 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-07-17 ๐Ÿ“… Created 2023-06-01
20
SoMarkAI/OXR

An open-source document parsing model with state-of-the-art accuracy and speed, using an RSI loop during post-training.

SoMarkAI
โญ 3,549 Python ๐Ÿ‘ค SoMarkAI Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2026-10-05
21
MiniMax-AI/MiniMax-01

The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention

MiniMax-AI
โญ 3,445 Python ๐Ÿ‘ค MiniMax-AI Organization ๐Ÿ• Updated 2025-07-07 ๐Ÿ“… Created 2025-01-14
22
xlang-ai/OSWorld

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

xlang-ai
โญ 3,273 Python ๐Ÿ‘ค xlang-ai Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2023-10-16
23
SkyworkAI/Skywork-R1V

Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.

SkyworkAI
โญ 3,174 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2026-07-29 ๐Ÿ“… Created 2025-03-15
24
SharpAI/DeepCamera

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent โ€” watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

SharpAI
โญ 3,144 JavaScript ๐Ÿ‘ค SharpAI Organization ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2019-03-05
25
QiuYannnn/Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

QiuYannnn
โญ 3,069 Python ๐Ÿ‘ค QiuYannnn User ๐Ÿ• Updated 2024-10-21 ๐Ÿ“… Created 2024-09-21
26
lightseekorg/tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

lightseekorg
โญ 2,944 Python ๐Ÿ‘ค lightseekorg Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-06
27
om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

om-ai-lab
โญ 2,670 Python ๐Ÿ‘ค om-ai-lab Organization ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2024-07-04
28
llmsresearch/paperbanana

Open source implementation and extension of Google Researchโ€™s PaperBanana for automated academic figures, diagrams, and research visuals, expanded to new domains like slide generation.

llmsresearch
โญ 2,496 Python ๐Ÿ‘ค llmsresearch Organization ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2026-02-04
29
zai-org/GLM-V

GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning

zai-org
โญ 2,406 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2025-06-28
30
BAAI-Agents/Cradle

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

BAAI-Agents
โญ 2,394 Python ๐Ÿ‘ค BAAI-Agents Organization ๐Ÿ• Updated 2024-11-07 ๐Ÿ“… Created 2024-03-03
31
heshengtao/comfyui_LLM_party

LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG

heshengtao
โญ 2,393 Python ๐Ÿ‘ค heshengtao User ๐Ÿ• Updated 2026-07-29 ๐Ÿ“… Created 2024-04-13
32
DanOps-1/Gpt-Agreement-Payment

ChatGPT Plus/Team/Pro subscription protocol end-to-end replay toolkit ยท hCaptcha visual solver ยท Anti-fraud mechanism empirical research / End-to-end protocol replay toolkit for ChatGPT Plus/Team/Pro subscription with from-scratch hCaptcha solver and empirical anti-fraud research

DanOps-1
โญ 2,313 Python ๐Ÿ‘ค DanOps-1 User ๐Ÿ• Updated 2026-06-15 ๐Ÿ“… Created 2026-04-27
33
cosmo-wander-ai/cosmo-edge

Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.

cosmo-wander-ai
โญ 2,106 C ๐Ÿ‘ค cosmo-wander-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-09
34
CryptoAILab/Awesome-LM-SSP

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

CryptoAILab
โญ 2,106 ๐Ÿ‘ค CryptoAILab Organization ๐Ÿ• Updated 2026-09-02 ๐Ÿ“… Created 2024-01-09
35
yueliu1999/Awesome-Jailbreak-on-LLMs

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

yueliu1999
โญ 2,034 ๐Ÿ‘ค yueliu1999 User ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2024-06-27
36
NVIDIA-AI-Blueprints/video-search-and-summarization

NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

NVIDIA-AI-Blueprints
โญ 2,003 Python ๐Ÿ‘ค NVIDIA-AI-Blueprints Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-22
37
2U1/Qwen-VL-Series-Finetune

An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.

2U1
โญ 1,983 Python ๐Ÿ‘ค 2U1 User ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2024-09-10
38
browser-use/macOS-use

Make Mac apps accessible for AI agents

browser-use
โญ 1,948 Python ๐Ÿ‘ค browser-use Organization ๐Ÿ• Updated 2025-03-05 ๐Ÿ“… Created 2025-01-23
39
Core-Mate/OpenGUI

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

Core-Mate
โญ 1,814 HTML ๐Ÿ‘ค Core-Mate Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-04-18
40
Tencent/AngelSlim

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Tencent
โญ 1,811 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-07-04
41
software-mansion/react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

software-mansion
โญ 1,794 TypeScript ๐Ÿ‘ค software-mansion Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-10-16
42
coderonion/awesome-yolo-object-detection

๐Ÿš€๐Ÿš€๐Ÿš€ A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

coderonion
โญ 1,747 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-05-31 ๐Ÿ“… Created 2022-02-19
43
zapdos-labs/unblink

Camera monitoring with VLM

zapdos-labs
โญ 1,518 Go ๐Ÿ‘ค zapdos-labs Organization ๐Ÿ• Updated 2026-03-09 ๐Ÿ“… Created 2025-11-05
44
peterdsharpe/AeroSandbox

Aircraft design optimization made fast through computational graph transformations (e.g., automatic differentiation). Composable analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.

peterdsharpe
โญ 1,400 Jupyter Notebook ๐Ÿ‘ค peterdsharpe User ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2019-05-15
45
gokayfem/awesome-vlm-architectures

Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

gokayfem
โญ 1,368 Markdown ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-02-15
46
fpgaminer/joycaption

JoyCaption is an image captioning Visual Language Model (VLM) being built from the ground up as a free, open, and uncensored model for the community to use in training Diffusion models.

fpgaminer
โญ 1,303 Jupyter Notebook ๐Ÿ‘ค fpgaminer User ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2024-10-12
47
zai-org/CogAgent

An open-sourced end-to-end VLM-based GUI Agent

zai-org
โญ 1,201 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2023-11-28
48
InternRobotics/InternNav

InternRobotics' open platform for building generalized navigation foundation models.

InternRobotics
โญ 1,189 Jupyter Notebook ๐Ÿ‘ค InternRobotics Organization ๐Ÿ• Updated 2026-03-10 ๐Ÿ“… Created 2025-07-24
49
RainBowLuoCS/Gamer

Official Implementation of Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agents

RainBowLuoCS
โญ 1,179 ๐Ÿ‘ค RainBowLuoCS User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-10-30
50
momozi1996/awesome-ai-persona-skills

The most comprehensive, continuously updated, and hottest collection of 100+ persona distillation skills on the web | Multi-agent systems | All categories: celebrities/directors/online legends/ancient texts/2D anime/workplace/emotions

momozi1996
โญ 1,129 Shell ๐Ÿ‘ค momozi1996 User ๐Ÿ• Updated 2026-09-02 ๐Ÿ“… Created 2026-04-10

Frequently Asked Questions

1

What is the most popular #vlm repository on GitHub?

The top ranked open source #vlm project on GitHub is huggingface/transformers with 169,339 stars. ๐Ÿค— Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

2

Which programming languages are most used in #vlm repositories?

Among the top ranked #vlm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, Go.

3

How is the #vlm repository ranking calculated?

We track 89 active open source repositories tagged with #vlm (500+ stars), totaling 457,898 stars with an average of 5,144 stars per repository. Rankings update daily from the GitHub API.