Git Stars Git Stars

#mllm Repositories

Discover 39 active open source GitHub repositories tagged with #mllm, accumulating 95,941 total stars (averaging 2,460 stars per project). Leading this topic is microsoft/unilm with 22,247 stars.

39
Total Repositories
95,941
Total Stars
2,460
Avg Stars/Repo
1
microsoft/unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

microsoft
โญ 22,247 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-09-21 ๐Ÿ“… Created 2019-07-23
2
simular-ai/Agent-S

Agent S: state-of-the-art open-source agents for computer use

simular-ai
โญ 13,014 Python ๐Ÿ‘ค simular-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-09
3
X-PLUG/MobileAgent

Mobile-Agent: The Powerful GUI Agent Family

X-PLUG
โญ 9,396 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2024-01-26
4
manycore-research/SpatialLM

[NeurIPS 2025] SpatialLM: Training Large Language Models for Structured Indoor Modeling

manycore-research
โญ 5,165 Python ๐Ÿ‘ค manycore-research Organization ๐Ÿ• Updated 2026-06-26 ๐Ÿ“… Created 2025-03-14
5
NVlabs/Eagle

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

NVlabs
โญ 3,861 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2024-06-27
6
atfortes/Awesome-LLM-Reasoning

From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 ๐Ÿ“

atfortes
โญ 3,713 ๐Ÿ‘ค atfortes User ๐Ÿ• Updated 2026-04-20 ๐Ÿ“… Created 2022-11-05
7
robbyant-research/MagicQuill

[CVPR'25] Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

robbyant-research
โญ 3,676 Python ๐Ÿ‘ค robbyant-research Organization ๐Ÿ• Updated 2025-12-03 ๐Ÿ“… Created 2024-11-12
8
NExT-GPT/NExT-GPT

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

NExT-GPT
โญ 3,626 Python ๐Ÿ‘ค NExT-GPT User ๐Ÿ• Updated 2025-05-13 ๐Ÿ“… Created 2023-08-30
9
InternLM/InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM
โญ 2,925 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2023-09-26
10
X-PLUG/mPLUG-DocOwl

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

X-PLUG
โญ 2,407 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-05-30 ๐Ÿ“… Created 2023-07-04
11
cambrian-mllm/cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

cambrian-mllm
โญ 2,013 Python ๐Ÿ‘ค cambrian-mllm Organization ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2024-06-17
12
coderonion/awesome-yolo-object-detection

๐Ÿš€๐Ÿš€๐Ÿš€ A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

coderonion
โญ 1,747 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-05-31 ๐Ÿ“… Created 2022-02-19
13
bytedance/Sa2VA

Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)

bytedance
โญ 1,702 Python ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2025-01-06
14
IDEA-Research/Rex-Omni

[CVPR2026] Detect Anything via Next Point Prediction

IDEA-Research
โญ 1,642 Jupyter Notebook ๐Ÿ‘ค IDEA-Research Organization ๐Ÿ• Updated 2026-02-22 ๐Ÿ“… Created 2025-10-04
15
gokayfem/awesome-vlm-architectures

Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

gokayfem
โญ 1,368 Markdown ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-02-15
16
EvolvingLMMs-Lab/LLaVA-OneVision-2.5

Fully Open Framework for Democratized Multimodal Training

EvolvingLMMs-Lab
โญ 1,245 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2025-09-16
17
BAAI-DCAI/Bunny

A family of lightweight multimodal models.

BAAI-DCAI
โญ 1,049 Python ๐Ÿ‘ค BAAI-DCAI User ๐Ÿ• Updated 2024-11-18 ๐Ÿ“… Created 2024-01-31
18
taco-group/OpenEMMA

OpenEMMA, a permissively licensed open source "reproduction" of Waymoโ€™s EMMA model.

taco-group
โญ 937 Python ๐Ÿ‘ค taco-group Organization ๐Ÿ• Updated 2025-05-13 ๐Ÿ“… Created 2024-10-30
19
EvolvingLMMs-Lab/NEO

NEO Series: Native Vision-Language Models from First Principles

EvolvingLMMs-Lab
โญ 931 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2025-10-16
20
LYL1015/JarvisArt

[NeurIPS' 2025] JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

LYL1015
โญ 880 Python ๐Ÿ‘ค LYL1015 User ๐Ÿ• Updated 2026-04-04 ๐Ÿ“… Created 2025-06-24
21
CircleRadon/Osprey

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

CircleRadon
โญ 843 Python ๐Ÿ‘ค CircleRadon User ๐Ÿ• Updated 2025-08-19 ๐Ÿ“… Created 2023-12-17
22
taco-group/4KAgent

[NeurIPS 2025] 4KAgent: Agentic Any Image to 4K Super-Resolution. An intelligent computer vision agent that can magically restore any image to perfect-4K!

taco-group
โญ 830 Python ๐Ÿ‘ค taco-group Organization ๐Ÿ• Updated 2025-09-24 ๐Ÿ“… Created 2025-05-27
23
MIV-XJTU/FSDrive

[NeurIPS 2025 spotlight] Official implementation for "FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving"

MIV-XJTU
โญ 818 Python ๐Ÿ‘ค MIV-XJTU Organization ๐Ÿ• Updated 2026-05-08 ๐Ÿ“… Created 2025-05-27
24
coderonion/awesome-llm-and-aigc

๐Ÿš€๐Ÿš€๐Ÿš€A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

coderonion
โญ 810 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2023-02-15
25
OpenSenseNova/SenseNova-Vision

Vision as Unified Multimodal Generation

OpenSenseNova
โญ 733 Python ๐Ÿ‘ค OpenSenseNova Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2026-06-29
26
ChocoWu/Awesome-Scene-Graph-Generation

This is a repository for listing papers on scene graph generation and application.

ChocoWu
โญ 731 ๐Ÿ‘ค ChocoWu User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2024-07-07
27
Coobiw/MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

Coobiw
โญ 678 Jupyter Notebook ๐Ÿ‘ค Coobiw User ๐Ÿ• Updated 2025-03-10 ๐Ÿ“… Created 2023-10-24
28
VITA-MLLM/Woodpecker

โœจโœจWoodpecker: Hallucination Correction for Multimodal Large Language Models

VITA-MLLM
โญ 642 Python ๐Ÿ‘ค VITA-MLLM Organization ๐Ÿ• Updated 2024-12-23 ๐Ÿ“… Created 2023-09-26
29
zhipeixu/FakeShield

[ICLR 2025] FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models

zhipeixu
โญ 633 Python ๐Ÿ‘ค zhipeixu User ๐Ÿ• Updated 2026-02-21 ๐Ÿ“… Created 2024-10-03
30
ZebangCheng/Emotion-LLaMA

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

ZebangCheng
โญ 632 Python ๐Ÿ‘ค ZebangCheng User ๐Ÿ• Updated 2026-09-23 ๐Ÿ“… Created 2024-05-22
31
MIV-XJTU/JanusVLN

[ICLR2026] Official implementation for "JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigation"

MIV-XJTU
โญ 599 Python ๐Ÿ‘ค MIV-XJTU Organization ๐Ÿ• Updated 2026-08-17 ๐Ÿ“… Created 2025-09-26
32
gokayfem/ComfyUI_VLM_nodes

ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.

gokayfem
โญ 592 Python ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-08-08 ๐Ÿ“… Created 2024-01-24
33
FoundationVision/Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

FoundationVision
โญ 582 Python ๐Ÿ‘ค FoundationVision Organization ๐Ÿ• Updated 2024-06-07 ๐Ÿ“… Created 2024-04-21
34
SkyworkAI/Vitron

NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing

SkyworkAI
โญ 578 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2024-10-20 ๐Ÿ“… Created 2024-03-18
35
uclanlp/OpenVLHarness

Official Code for OpenVLHarness: Real-World Visual Agentic Tool-Use with Multimodal Memory

uclanlp
โญ 557 Python ๐Ÿ‘ค uclanlp Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2026-10-15
36
OpenEnvision/Awesome-Multimodal-Modeling

Awesome Multimodal Modeling [Covers MLLM, UMM, and NMM]

OpenEnvision
โญ 552 JavaScript ๐Ÿ‘ค OpenEnvision Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-03-27
37
YingqingHe/Awesome-LLMs-meet-Multimodal-Generation

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

YingqingHe
โญ 550 HTML ๐Ÿ‘ค YingqingHe User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2023-11-17
38
lucasjinreal/Crane

A pure Rust-based inference engine for LLMs, VLMs, VLAs, TTS, and OCR, powered by Candle and Rust. An alternative to llama.cpp that's much simpler and cleaner.

lucasjinreal
โญ 534 Rust ๐Ÿ‘ค lucasjinreal User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-03-19
39
vulab-AI/Awesome-Spatial-VLMs

[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;

vulab-AI
โญ 525 Python ๐Ÿ‘ค vulab-AI Organization ๐Ÿ• Updated 2026-07-30 ๐Ÿ“… Created 2025-07-10

Frequently Asked Questions

1

What is the most popular #mllm repository on GitHub?

The top ranked open source #mllm project on GitHub is microsoft/unilm with 22,247 stars. Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

2

Which programming languages are most used in #mllm repositories?

Among the top ranked #mllm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Markdown, JavaScript.

3

How is the #mllm repository ranking calculated?

We track 39 active open source repositories tagged with #mllm (500+ stars), totaling 95,941 stars with an average of 2,460 stars per repository. Rankings update daily from the GitHub API.