Git Stars Git Stars

#multimodal-large-language-models Repositories

Discover 43 active open source GitHub repositories tagged with #multimodal-large-language-models, accumulating 78,032 total stars (averaging 1,814 stars per project). Leading this topic is BradyFU/Awesome-Multimodal-Large-Language-Models with 18,090 stars.

43
Total Repositories
78,032
Total Stars
1,814
Avg Stars/Repo
1
BradyFU/Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

BradyFU
โญ 18,090 ๐Ÿ‘ค BradyFU User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-05-19
2
X-PLUG/MobileAgent

Mobile-Agent: The Powerful GUI Agent Family

X-PLUG
โญ 9,396 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2024-01-26
3
joanrod/star-vector

StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.

joanrod
โญ 4,639 Python ๐Ÿ‘ค joanrod User ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2023-12-11
4
ictnlp/LLaMA-Omni

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

ictnlp
โญ 3,142 Python ๐Ÿ‘ค ictnlp Organization ๐Ÿ• Updated 2025-05-19 ๐Ÿ“… Created 2024-09-10
5
sherlockchou86/VideoPipe

A cross-platform video structuring (video analysis) framework based on CV models & mLLM.

sherlockchou86
โญ 2,994 C++ ๐Ÿ‘ค sherlockchou86 User ๐Ÿ• Updated 2026-02-25 ๐Ÿ“… Created 2022-08-26
6
VITA-MLLM/VITA

โœจโœจ[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

VITA-MLLM
โญ 2,512 Python ๐Ÿ‘ค VITA-MLLM Organization ๐Ÿ• Updated 2025-03-28 ๐Ÿ“… Created 2024-08-10
7
X-PLUG/mPLUG-DocOwl

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

X-PLUG
โญ 2,407 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-05-30 ๐Ÿ“… Created 2023-07-04
8
cambrian-mllm/cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

cambrian-mllm
โญ 2,013 Python ๐Ÿ‘ค cambrian-mllm Organization ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2024-06-17
9
YangLing0818/RPG-DiffusionMaster

[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (RPG)

YangLing0818
โญ 1,841 Jupyter Notebook ๐Ÿ‘ค YangLing0818 User ๐Ÿ• Updated 2025-02-01 ๐Ÿ“… Created 2024-01-22
10
ByteDance-Seed/Seed1.5-VL

Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving state-of-the-art performance on 38 out of 60 public benchmarks.

ByteDance-Seed
โญ 1,581 Jupyter Notebook ๐Ÿ‘ค ByteDance-Seed Organization ๐Ÿ• Updated 2025-06-14 ๐Ÿ“… Created 2025-05-11
11
Osilly/Vision-R1

[ICLR2026] This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Visionโ€‘R1, a reasoning MLLM that leverages coldโ€‘start initialization and RL training to incentivize reasoning capability.

Osilly
โญ 1,558 Python ๐Ÿ‘ค Osilly User ๐Ÿ• Updated 2026-03-20 ๐Ÿ“… Created 2025-02-03
12
EvolvingLMMs-Lab/open-r1-multimodal

A fork to add multimodal model training to open-r1

EvolvingLMMs-Lab
โญ 1,556 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2025-02-08 ๐Ÿ“… Created 2025-01-27
13
ATH-MaaS/Ovis

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

ATH-MaaS
โญ 1,536 Python ๐Ÿ‘ค ATH-MaaS Organization ๐Ÿ• Updated 2026-07-15 ๐Ÿ“… Created 2024-06-13
14
Sun-Haoyuan23/Awesome-RL-based-Reasoning-MLLMs

This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-based Reasoning MLLMs!

Sun-Haoyuan23
โญ 1,449 ๐Ÿ‘ค Sun-Haoyuan23 User ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2025-02-21
15
Henry-23/VideoChat

Real-time voice interactive digital human, customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

Henry-23
โญ 1,333 Python ๐Ÿ‘ค Henry-23 User ๐Ÿ• Updated 2025-12-18 ๐Ÿ“… Created 2024-10-18
16
ATH-MaaS/Awesome-Unified-Multimodal-Models

Awesome Unified Multimodal Models

ATH-MaaS
โญ 1,325 ๐Ÿ‘ค ATH-MaaS Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2025-05-07
17
NVIDIA/audio-flamingo

PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models

NVIDIA
โญ 1,224 ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2025-12-15 ๐Ÿ“… Created 2024-05-20
18
yfzhang114/Awesome-Multimodal-Large-Language-Models

Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models

yfzhang114
โญ 1,211 ๐Ÿ‘ค yfzhang114 User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2024-03-30
19
X-LANCE/SLAM-LLM

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

X-LANCE
โญ 1,072 Python ๐Ÿ‘ค X-LANCE Organization ๐Ÿ• Updated 2026-01-15 ๐Ÿ“… Created 2023-10-23
20
BAAI-DCAI/Bunny

A family of lightweight multimodal models.

BAAI-DCAI
โญ 1,049 Python ๐Ÿ‘ค BAAI-DCAI User ๐Ÿ• Updated 2024-11-18 ๐Ÿ“… Created 2024-01-31
21
yaotingwangofficial/Awesome-MCoT

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

yaotingwangofficial
โญ 1,030 TeX ๐Ÿ‘ค yaotingwangofficial User ๐Ÿ• Updated 2026-10-03 ๐Ÿ“… Created 2025-02-15
22
richard-peng-xia/awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

richard-peng-xia
โญ 986 ๐Ÿ‘ค richard-peng-xia User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2022-07-13
23
daixiangzi/Awesome-Token-Compress

A paper list of some recent works about Token Compress for Vit and VLM

daixiangzi
โญ 966 ๐Ÿ‘ค daixiangzi User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-09-06
24
EvolvingLMMs-Lab/NEO

NEO Series: Native Vision-Language Models from First Principles

EvolvingLMMs-Lab
โญ 931 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2025-10-16
25
MME-Benchmarks/Video-MME

โœจโœจ[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

MME-Benchmarks
โญ 805 ๐Ÿ‘ค MME-Benchmarks Organization ๐Ÿ• Updated 2025-12-08 ๐Ÿ“… Created 2024-06-02
27
LLaVA-VL/LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

LLaVA-VL
โญ 763 Python ๐Ÿ‘ค LLaVA-VL Organization ๐Ÿ• Updated 2024-02-01 ๐Ÿ“… Created 2023-11-07
28
vision-x-nyu/thinking-in-space

Official repo and evaluation implementation of VSI-Bench

vision-x-nyu
โญ 734 Python ๐Ÿ‘ค vision-x-nyu Organization ๐Ÿ• Updated 2025-08-05 ๐Ÿ“… Created 2024-12-14
29
deepglint/unicom

Large-Scale Visual Representation Model

deepglint
โญ 704 Python ๐Ÿ‘ค deepglint Organization ๐Ÿ• Updated 2025-12-08 ๐Ÿ“… Created 2023-02-15
30
wenhaochai/MovieChat

[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

wenhaochai
โญ 698 Python ๐Ÿ‘ค wenhaochai User ๐Ÿ• Updated 2025-01-29 ๐Ÿ“… Created 2023-06-26
31
NVlabs/OmniVinci

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

NVlabs
โญ 683 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-08-31 ๐Ÿ“… Created 2025-09-24
32
Coobiw/MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

Coobiw
โญ 678 Jupyter Notebook ๐Ÿ‘ค Coobiw User ๐Ÿ• Updated 2025-03-10 ๐Ÿ“… Created 2023-10-24
33
FoundationVision/Liquid

(Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators

FoundationVision
โญ 642 Python ๐Ÿ‘ค FoundationVision Organization ๐Ÿ• Updated 2026-06-01 ๐Ÿ“… Created 2024-12-12
34
VITA-MLLM/Woodpecker

โœจโœจWoodpecker: Hallucination Correction for Multimodal Large Language Models

VITA-MLLM
โญ 642 Python ๐Ÿ‘ค VITA-MLLM Organization ๐Ÿ• Updated 2024-12-23 ๐Ÿ“… Created 2023-09-26
35
lwpyh/Awesome-MLLM-Reasoning-Collection

A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.

lwpyh
โญ 598 ๐Ÿ‘ค lwpyh User ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2025-03-16
36
yfzhang114/Thyme

โœจโœจ [ICLR 2026] Think Beyond Images

yfzhang114
โญ 585 Python ๐Ÿ‘ค yfzhang114 User ๐Ÿ• Updated 2025-09-23 ๐Ÿ“… Created 2025-08-17
37
SkyworkAI/Vitron

NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing

SkyworkAI
โญ 578 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2024-10-20 ๐Ÿ“… Created 2024-03-18
38
ictnlp/LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

ictnlp
โญ 575 Python ๐Ÿ‘ค ictnlp Organization ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2025-01-07
39
cambrian-mllm/cambrian-s

Cambrian-S: Towards Spatial Supersensing in Video

cambrian-mllm
โญ 573 Python ๐Ÿ‘ค cambrian-mllm Organization ๐Ÿ• Updated 2026-04-03 ๐Ÿ“… Created 2025-10-13
40
AILab-CVC/SEED-X

Multimodal Models in Real World

AILab-CVC
โญ 560 Jupyter Notebook ๐Ÿ‘ค AILab-CVC Organization ๐Ÿ• Updated 2025-02-24 ๐Ÿ“… Created 2024-03-30
41
YingqingHe/Awesome-LLMs-meet-Multimodal-Generation

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

YingqingHe
โญ 550 HTML ๐Ÿ‘ค YingqingHe User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2023-11-17
42
worldbench/awesome-vla-for-ad

๐ŸŒ Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

worldbench
โญ 530 HTML ๐Ÿ‘ค worldbench Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2025-09-07
43
hustvl/EVF-SAM

Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"

hustvl
โญ 500 Python ๐Ÿ‘ค hustvl Organization ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2024-06-12

Frequently Asked Questions

1

What is the most popular #multimodal-large-language-models repository on GitHub?

The top ranked open source #multimodal-large-language-models project on GitHub is BradyFU/Awesome-Multimodal-Large-Language-Models with 18,090 stars. :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

2

Which programming languages are most used in #multimodal-large-language-models repositories?

Among the top ranked #multimodal-large-language-models projects on GitHub, the most common programming languages are Python, Jupyter Notebook, HTML, C++.

3

How is the #multimodal-large-language-models repository ranking calculated?

We track 43 active open source repositories tagged with #multimodal-large-language-models (500+ stars), totaling 78,032 stars with an average of 1,814 stars per repository. Rankings update daily from the GitHub API.