Git Stars Git Stars

#vlm Repositories

89
Total Repositories
457,898
Total Stars
5,144
Avg Stars/Repo
51
NVIDIA-NeMo/Automodel

๐Ÿš€ Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

NVIDIA-NeMo
โญ 1,096 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-21
52
BAAI-DCAI/Bunny

A family of lightweight multimodal models.

BAAI-DCAI
โญ 1,049 Python ๐Ÿ‘ค BAAI-DCAI User ๐Ÿ• Updated 2024-11-18 ๐Ÿ“… Created 2024-01-31
53
Valen-Team/Valen

Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate with bounding boxes, in place of generated text. Free API, ONNX, GGUF, vLLM and SGLang; fine-tuning code included.

Valen-Team
โญ 932 Python ๐Ÿ‘ค Valen-Team Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-09-23
54
EvolvingLMMs-Lab/NEO

NEO Series: Native Vision-Language Models from First Principles

EvolvingLMMs-Lab
โญ 931 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2025-10-16
55
candle-org/MindAct

MindSpore + ๐Ÿค—Huggingface: Run any Transformers/Diffusers model on MindSpore with seamless compatibility and acceleration.

candle-org
โญ 921 Python ๐Ÿ‘ค candle-org Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2022-09-23
56
Skythinker616/gpt-assistant-android

ใ€New Agent Mode Addedใ€‘Android full-scenario GPT assistant, can be activated via volume keys for voice interaction, supports networking, photo taking, templates, attachment parsing, agent mode, etc. | GPT assistant for Android, activated via volume keys for voice interaction, supporting features such as networking, taking photos, templates, parsing PDF and Office documents, and agent mode.

Skythinker616
โญ 908 Java ๐Ÿ‘ค Skythinker616 User ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2023-09-13
57
PKU-YuanGroup/UniWorld

UniWorld: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation

PKU-YuanGroup
โญ 896 Python ๐Ÿ‘ค PKU-YuanGroup Organization ๐Ÿ• Updated 2025-12-23 ๐Ÿ“… Created 2024-11-21
58
OpenDCAI/OpenWorldLib

Unified Codebase for Advanced World Models.

OpenDCAI
โญ 892 Python ๐Ÿ‘ค OpenDCAI Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-11-21
59
baidu-baige/LoongForge

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3, and more.

baidu-baige
โญ 881 Python ๐Ÿ‘ค baidu-baige Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-23
60
SkyworkAI/UniPic

Open-source SOTA multi-image editing model

SkyworkAI
โญ 877 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2026-07-13 ๐Ÿ“… Created 2025-07-27
61
Purewhiter/mobilegym

[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training

Purewhiter
โญ 872 Python ๐Ÿ‘ค Purewhiter User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-05-14
62
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
63
OpenDataBox/awesome-data-llm

Official Repository of "LLM ร— DATA" Survey Paper

OpenDataBox
โญ 836 ๐Ÿ‘ค OpenDataBox Organization ๐Ÿ• Updated 2026-10-25 ๐Ÿ“… Created 2024-08-04
64
zubair-irshad/Awesome-Robotics-3D

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

zubair-irshad
โญ 824 ๐Ÿ‘ค zubair-irshad User ๐Ÿ• Updated 2025-12-17 ๐Ÿ“… Created 2024-08-12
65
OpenVGLab/OmniLottie

[CVPR 2026๐Ÿ”ฅ] ๐Ÿง‘โ€๐ŸŽจ OmniLottie, an open-sourced multi-modal instructed vector animation generator that produces Lottie JSONs.

OpenVGLab
โญ 816 Python ๐Ÿ‘ค OpenVGLab Organization ๐Ÿ• Updated 2026-04-06 ๐Ÿ“… Created 2026-01-15
66
coderonion/awesome-llm-and-aigc

๐Ÿš€๐Ÿš€๐Ÿš€A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

coderonion
โญ 810 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2023-02-15
67
FluxVLA/FluxVLA

An all-in-one VLA engineering platform for embodied AI โ€” from data to real-robot deployment.

FluxVLA
โญ 794 Python ๐Ÿ‘ค FluxVLA Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2026-04-01
68
MigoXLab/dingo

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

MigoXLab
โญ 771 Python ๐Ÿ‘ค MigoXLab Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-12-24
69
taco-group/SparkVSR

[ECCV 2026] SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation

taco-group
โญ 752 Python ๐Ÿ‘ค taco-group Organization ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2026-03-16
70
TIGER-AI-Lab/VLM2Vec

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

TIGER-AI-Lab
โญ 705 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2024-10-07
71
hybridgroup/yzma

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

hybridgroup
โญ 677 Go ๐Ÿ‘ค hybridgroup Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-09-21
72
mbzuai-oryx/GeoChat

[CVPR 2024 ๐Ÿ”ฅ] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

mbzuai-oryx
โญ 675 Python ๐Ÿ‘ค mbzuai-oryx Organization ๐Ÿ• Updated 2024-11-28 ๐Ÿ“… Created 2023-11-23
โญ 650 ๐Ÿ‘ค XiaomiMiMo Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-05-29
74
zenstory-ai/video-recap-skills

AI Video Narration Agent Skill Pack: automatically cuts scenes, watches the footage to write narration, adds voice-over and mixes audio to produce the final video, and exports drafts for Jianying/CapCutโ€”no GPU required | Agent skills for narrated video recaps & CapCut drafts

zenstory-ai
โญ 649 Python ๐Ÿ‘ค zenstory-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-05-02
75
huggingface/optimum-intel

๐Ÿค— Optimum Intel: Accelerate inference with Intel optimization tools

huggingface
โญ 631 Jupyter Notebook ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-05-25
76
RobotecAI/rai

RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

RobotecAI
โญ 619 Python ๐Ÿ‘ค RobotecAI Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2024-06-04
77
Fabric-Project/Fabric

Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer

Fabric-Project
โญ 613 Swift ๐Ÿ‘ค Fabric-Project Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2025-04-28
78
THUSI-Lab/GameScaling

Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds. Weights on Hugging Face.

THUSI-Lab
โญ 604 Python ๐Ÿ‘ค THUSI-Lab Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-10-10
79
gokayfem/ComfyUI_VLM_nodes

ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.

gokayfem
โญ 592 Python ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-08-08 ๐Ÿ“… Created 2024-01-24
80
awwaiid/ghostwriter

Use the reMarkable2 as an interface to vision-LLMs (ChatGPT, Claude, Gemini). Ghost in the machine!

awwaiid
โญ 573 Rust ๐Ÿ‘ค awwaiid User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2024-10-06
81
Flame-Code-VLM/Flame-Code-VLM

Flame is an open-source multimodal AI system designed to translate UI design mockups into high-quality React code. It leverages vision-language modeling, automated data synthesis, and structured training workflows to bridge the gap between design and front-end development.

Flame-Code-VLM
โญ 564 Python ๐Ÿ‘ค Flame-Code-VLM Organization ๐Ÿ• Updated 2026-02-11 ๐Ÿ“… Created 2025-02-10
82
vlm-run/vlmrun-hub

A hub for various industry-specific schemas to be used with VLMs.

vlm-run
โญ 555 Python ๐Ÿ‘ค vlm-run Organization ๐Ÿ• Updated 2025-12-15 ๐Ÿ“… Created 2024-11-11
83
OpenEnvision/Awesome-Multimodal-Modeling

Awesome Multimodal Modeling [Covers MLLM, UMM, and NMM]

OpenEnvision
โญ 552 JavaScript ๐Ÿ‘ค OpenEnvision Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-03-27
84
niuzaisheng/ScreenAgent

ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)

niuzaisheng
โญ 547 Python ๐Ÿ‘ค niuzaisheng User ๐Ÿ• Updated 2024-11-25 ๐Ÿ“… Created 2024-01-15
85
worldbench/awesome-vla-for-ad

๐ŸŒ Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

worldbench
โญ 530 HTML ๐Ÿ‘ค worldbench Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2025-09-07
86
vulab-AI/Awesome-Spatial-VLMs

[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;

vulab-AI
โญ 525 Python ๐Ÿ‘ค vulab-AI Organization ๐Ÿ• Updated 2026-07-30 ๐Ÿ“… Created 2025-07-10
87
haoranD/Awesome-Embodied-AI

A curated list of awesome papers on Embodied AI and related research/industry-driven resources.

haoranD
โญ 525 ๐Ÿ‘ค haoranD User ๐Ÿ• Updated 2025-06-03 ๐Ÿ“… Created 2023-07-21
88
coderonion/awesome-cuda-and-hpc

๐Ÿš€๐Ÿš€๐Ÿš€ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

coderonion
โญ 502 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-08-02 ๐Ÿ“… Created 2023-02-23
89
NVlabs/vla0

VLA-0: Building State-of-the-Art VLAs with Zero Modification

NVlabs
โญ 501 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-02-21 ๐Ÿ“… Created 2025-10-14