Git Stars Git Stars

#large-multimodal-models Repositories

Discover 18 active open source GitHub repositories tagged with #large-multimodal-models, accumulating 46,681 total stars (averaging 2,593 stars per project). Leading this topic is chiphuyen/aie-book with 18,372 stars.

18
Total Repositories
46,681
Total Stars
2,593
Avg Stars/Repo
1
chiphuyen/aie-book

[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)

chiphuyen
โญ 18,372 Jupyter Notebook ๐Ÿ‘ค chiphuyen User ๐Ÿ• Updated 2026-07-03 ๐Ÿ“… Created 2024-12-03
2
SkyworkAI/SkyReels-V2

SkyReels-V2: Infinite-length Film Generative model

SkyworkAI
โญ 7,830 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2026-01-29 ๐Ÿ“… Created 2025-04-15
4
VITA-MLLM/VITA

โœจโœจ[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

VITA-MLLM
โญ 2,512 Python ๐Ÿ‘ค VITA-MLLM Organization ๐Ÿ• Updated 2025-03-28 ๐Ÿ“… Created 2024-08-10
5
XueZeyue/DanceGRPO

An official implementation of DanceGRPO: Unleashing GRPO on Visual Generation

XueZeyue
โญ 1,654 Python ๐Ÿ‘ค XueZeyue User ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2025-05-08
6
NVlabs/describe-anything

[ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioning

NVlabs
โญ 1,497 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2025-06-26 ๐Ÿ“… Created 2025-04-04
7
gokayfem/awesome-vlm-architectures

Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

gokayfem
โญ 1,368 Markdown ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-02-15
8
ShareGPT4Omni/ShareGPT4Video

[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"

ShareGPT4Omni
โญ 1,080 Python ๐Ÿ‘ค ShareGPT4Omni Organization ๐Ÿ• Updated 2024-10-09 ๐Ÿ“… Created 2024-06-06
9
TinyLLaVA/TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

TinyLLaVA
โญ 1,010 Python ๐Ÿ‘ค TinyLLaVA User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2024-02-21
10
MinorJerry/WebVoyager

Code for "WebVoyager: WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models"

MinorJerry
โญ 986 Python ๐Ÿ‘ค MinorJerry User ๐Ÿ• Updated 2024-03-04 ๐Ÿ“… Created 2024-01-24
11
richard-peng-xia/awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

richard-peng-xia
โญ 986 ๐Ÿ‘ค richard-peng-xia User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2022-07-13
12
TideDra/lmm-r1

Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.

TideDra
โญ 843 Python ๐Ÿ‘ค TideDra User ๐Ÿ• Updated 2025-05-14 ๐Ÿ“… Created 2025-02-13
13
LLaVA-VL/LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

LLaVA-VL
โญ 763 Python ๐Ÿ‘ค LLaVA-VL Organization ๐Ÿ• Updated 2024-02-01 ๐Ÿ“… Created 2023-11-07
14
smthemex/ComfyUI_EchoMimic

You can using EchoMimic in ComfyUI

smthemex
โญ 697 Python ๐Ÿ‘ค smthemex User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2024-07-13
15
bytedance/vidi

The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"

bytedance
โญ 662 Python ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2025-02-08
16
MMMU-Benchmark/MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

MMMU-Benchmark
โญ 601 Python ๐Ÿ‘ค MMMU-Benchmark Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-11-23
17
ictnlp/LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

ictnlp
โญ 575 Python ๐Ÿ‘ค ictnlp Organization ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2025-01-07

Frequently Asked Questions

1

What is the most popular #large-multimodal-models repository on GitHub?

The top ranked open source #large-multimodal-models project on GitHub is chiphuyen/aie-book with 18,372 stars. [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)

2

Which programming languages are most used in #large-multimodal-models repositories?

Among the top ranked #large-multimodal-models projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Markdown.

3

How is the #large-multimodal-models repository ranking calculated?

We track 18 active open source repositories tagged with #large-multimodal-models (500+ stars), totaling 46,681 stars with an average of 2,593 stars per repository. Rankings update daily from the GitHub API.