Git Stars Git Stars

#multimodal-ai Repositories

Discover 191 active open source GitHub repositories tagged with #multimodal-ai, accumulating 589,873 total stars (averaging 3,088 stars per project). Leading this topic is anthropics/claude-cookbooks with 54,935 stars.

191
Total Repositories
589,873
Total Stars
3,088
Avg Stars/Repo
1
anthropics/claude-cookbooks

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

anthropics
โญ 54,935 Jupyter Notebook ๐Ÿ‘ค anthropics Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-08-15
2
oobabooga/textgen

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

oobabooga
โญ 47,736 Python ๐Ÿ‘ค oobabooga User ๐Ÿ• Updated 2026-08-17 ๐Ÿ“… Created 2022-12-21
โญ 34,316 Python ๐Ÿ‘ค chenfei-wu User ๐Ÿ• Updated 2024-01-06 ๐Ÿ“… Created 2023-03-02
4
google-ai-edge/gallery

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

google-ai-edge
โญ 25,398 Kotlin ๐Ÿ‘ค google-ai-edge Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-31
5
deepseek-ai/DeepSeek-OCR

Contexts Optical Compression

deepseek-ai
โญ 24,180 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-01-27 ๐Ÿ“… Created 2025-10-17
6
QwenLM/Qwen3-VL

Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 20,240 Jupyter Notebook ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2026-01-30 ๐Ÿ“… Created 2024-08-29
7
duixcom/Duix-Avatar

๐Ÿš€ Truly open-source AI avatar(digital human) toolkit for offline video generation and digital human cloning.

duixcom
โญ 16,411 C ๐Ÿ‘ค duixcom Organization ๐Ÿ• Updated 2026-04-21 ๐Ÿ“… Created 2024-12-24
8
facebookresearch/seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

facebookresearch
โญ 11,908 Jupyter Notebook ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2023-08-01
9
m87-labs/moondream

tiny vision language model

m87-labs
โญ 10,167 Python ๐Ÿ‘ค m87-labs Organization ๐Ÿ• Updated 2026-04-20 ๐Ÿ“… Created 2023-12-29
10
opendatalab/PDF-Extract-Kit

A Comprehensive Toolkit for High-Quality PDF Content Extraction

opendatalab
โญ 9,682 Python ๐Ÿ‘ค opendatalab Organization ๐Ÿ• Updated 2025-01-03 ๐Ÿ“… Created 2024-06-27
11
facebookresearch/ImageBind

ImageBind One Embedding Space to Bind Them All

facebookresearch
โญ 9,084 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-11-21 ๐Ÿ“… Created 2023-03-23
12
QwenLM/Qwen-Image

Qwen-Image is a powerful image generation foundation model capable of complex text rendering and precise image editing.

QwenLM
โญ 8,489 Python ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2026-02-10 ๐Ÿ“… Created 2025-08-03
13
NVIDIA/Isaac-GR00T

NVIDIA Isaac GR00T N1.7 - A Foundation Model for Generalist Robots.

NVIDIA
โญ 8,402 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-03-11
14
boson-ai/higgs-audio

Text-audio foundation model from Boson AI

boson-ai
โญ 8,390 Python ๐Ÿ‘ค boson-ai Organization ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2025-07-20
15
LargeWorldModel/LWM

Large World Model -- Modeling Text and Video with Millions Context

LargeWorldModel
โญ 7,391 Python ๐Ÿ‘ค LargeWorldModel Organization ๐Ÿ• Updated 2024-10-19 ๐Ÿ“… Created 2024-02-08
16
tencent-ailab/IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

tencent-ailab
โญ 6,386 Jupyter Notebook ๐Ÿ‘ค tencent-ailab User ๐Ÿ• Updated 2024-06-28 ๐Ÿ“… Created 2023-08-16
17
AILab-CVC/YOLO-World

[CVPR 2024] Real-Time Open-Vocabulary Object Detection

AILab-CVC
โญ 6,385 Python ๐Ÿ‘ค AILab-CVC Organization ๐Ÿ• Updated 2025-02-26 ๐Ÿ“… Created 2024-01-29
18
Jackywine/Bella

Bella is best

Jackywine
โญ 6,325 JavaScript ๐Ÿ‘ค Jackywine User ๐Ÿ• Updated 2026-02-05 ๐Ÿ“… Created 2025-07-16
19
ByteDance-Seed/Bagel

Open-source unified multimodal model

ByteDance-Seed
โญ 6,223 Python ๐Ÿ‘ค ByteDance-Seed Organization ๐Ÿ• Updated 2026-05-04 ๐Ÿ“… Created 2025-04-17
20
ngxson/smolvlm-realtime-webcam

Real-time webcam demo with SmolVLM and llama.cpp server

ngxson
โญ 5,555 HTML ๐Ÿ‘ค ngxson User ๐Ÿ• Updated 2025-05-12 ๐Ÿ“… Created 2025-05-12
21
AgnesAI-Labs/AgnesAI-Models

Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows.

AgnesAI-Labs
โญ 5,299 ๐Ÿ‘ค AgnesAI-Labs Organization ๐Ÿ• Updated 2026-08-18 ๐Ÿ“… Created 2026-04-30
22
deepseek-ai/DeepSeek-VL2

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding

deepseek-ai
โญ 5,297 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-02-26 ๐Ÿ“… Created 2024-12-13
23
cbh123/narrator

David Attenborough narrates your life

cbh123
โญ 4,426 Python ๐Ÿ‘ค cbh123 User ๐Ÿ• Updated 2026-07-23 ๐Ÿ“… Created 2023-11-14
24
Tencent-Hunyuan/HunyuanDiT

Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

Tencent-Hunyuan
โญ 4,292 Jupyter Notebook ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2024-05-10
25
VectorSpaceLab/OmniGen2

OmniGen2: Exploration to Advanced Multimodal Generation. https://arxiv.org/abs/2506.18871

VectorSpaceLab
โญ 4,121 Jupyter Notebook ๐Ÿ‘ค VectorSpaceLab Organization ๐Ÿ• Updated 2026-03-20 ๐Ÿ“… Created 2025-06-06
26
googleapis/python-genai

Google Gen AI Python SDK provides an interface for developers to integrate Google's generative models into their Python applications.

googleapis
โญ 4,084 Python ๐Ÿ‘ค googleapis Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-12-06
27
QwenLM/Qwen2.5-Omni

Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.

QwenLM
โญ 4,021 Jupyter Notebook ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2025-06-12 ๐Ÿ“… Created 2025-03-22
28
amazon-science/mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)

amazon-science
โญ 3,988 Python ๐Ÿ‘ค amazon-science Organization ๐Ÿ• Updated 2024-06-12 ๐Ÿ“… Created 2023-02-02
29
huggingface/smollm

Everything about the SmolLM and SmolVLM family of models

huggingface
โญ 3,960 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2024-11-04
30
songguoxs/gpt4o-image-prompts

Nano Banana(nanobanana),GPT-5(GPT5),GPT-4o(GPT4o) Image Prompts๏ผŒNanobanana Prompts๏ผŒnanobanana prompts

songguoxs
โญ 3,882 JavaScript ๐Ÿ‘ค songguoxs User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2025-04-28
31
FlagAI-Open/FlagAI

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

FlagAI-Open
โญ 3,864 Python ๐Ÿ‘ค FlagAI-Open Organization ๐Ÿ• Updated 2026-07-13 ๐Ÿ“… Created 2022-05-16
32
facebookresearch/sam-audio

The repository provides code for running inference with the Meta Segment Anything Audio Model (SAM-Audio), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

facebookresearch
โญ 3,760 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-05-26 ๐Ÿ“… Created 2025-09-04
33
ZHO-ZHO-ZHO/ZHO-nano-banana-Creation

My ultimate collection of nano-banana creative gameplay! Constantly updating!

ZHO-ZHO-ZHO
โญ 3,715 ๐Ÿ‘ค ZHO-ZHO-ZHO User ๐Ÿ• Updated 2025-09-18 ๐Ÿ“… Created 2025-08-28
34
Kedreamix/Linly-Talker

Digital Avatar Conversational System - Linly-Talker. ๐Ÿ˜„โœจ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. ๐Ÿค๐Ÿค– It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. ๐ŸŒŸ๐Ÿ”ฌ

Kedreamix
โญ 3,483 Python ๐Ÿ‘ค Kedreamix User ๐Ÿ• Updated 2026-02-10 ๐Ÿ“… Created 2023-10-17
35
yoloytang/Awesome-LLMs-for-Video-Understanding

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.

yoloytang
โญ 3,310 ๐Ÿ‘ค yoloytang User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2023-07-16
โญ 3,290 Python ๐Ÿ‘ค google-gemini Organization ๐Ÿ• Updated 2026-07-28 ๐Ÿ“… Created 2025-05-06
โญ 3,186 Python ๐Ÿ‘ค stepfun-ai Organization ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2025-02-08
38
zai-org/GLM-4-Voice

GLM-4-Voice | End-to-End Chinese-English Voice Dialogue Model

zai-org
โญ 3,108 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2024-12-05 ๐Ÿ“… Created 2024-10-24
39
stanford-crfm/helm

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

stanford-crfm
โญ 2,975 Python ๐Ÿ‘ค stanford-crfm Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2021-11-29
40
Mininglamp-AI/Mano-P

Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook โ€” no data leaves your device. Mano-P is an open-source GUI-VLA project that supports local inference on Mac mini/MacBook or via compute stick, enabling purely vision-driven cross-platform GUI automation operations. Data is processed entirely locally, supporting planning and execution of complex multi-step tasks.

Mininglamp-AI
โญ 2,855 ๐Ÿ‘ค Mininglamp-AI Organization ๐Ÿ• Updated 2026-06-25 ๐Ÿ“… Created 2026-03-25
41
Alpha-VLLM/LLaMA2-Accessory

An Open-source Toolkit for LLM Development

Alpha-VLLM
โญ 2,806 Python ๐Ÿ‘ค Alpha-VLLM Organization ๐Ÿ• Updated 2025-01-13 ๐Ÿ“… Created 2023-07-21
42
ishan0102/vimGPT

Browse the web with GPT-4V and Vimium

ishan0102
โญ 2,672 Python ๐Ÿ‘ค ishan0102 User ๐Ÿ• Updated 2024-09-25 ๐Ÿ“… Created 2023-11-07
43
OmniSVG/OmniSVG

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

OmniSVG
โญ 2,666 Python ๐Ÿ‘ค OmniSVG User ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2025-04-07
44
janhq/ichigo

Local realtime voice AI

janhq
โญ 2,493 Python ๐Ÿ‘ค janhq Organization ๐Ÿ• Updated 2025-11-26 ๐Ÿ“… Created 2024-07-02
โญ 2,456 JavaScript ๐Ÿ‘ค volcengine Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-01-10
46
baaivision/Emu3

Next-Token Prediction is All You Need

baaivision
โญ 2,454 Python ๐Ÿ‘ค baaivision Organization ๐Ÿ• Updated 2026-01-12 ๐Ÿ“… Created 2024-09-26
47
XiaoxinHe/Awesome-Graph-LLM

A collection of AWESOME things about Graph-Related LLMs.

XiaoxinHe
โญ 2,452 ๐Ÿ‘ค XiaoxinHe User ๐Ÿ• Updated 2025-11-05 ๐Ÿ“… Created 2023-06-05
48
Nutlope/llama-ocr

Document to Markdown OCR library with Llama 3.2 vision

Nutlope
โญ 2,445 TypeScript ๐Ÿ‘ค Nutlope User ๐Ÿ• Updated 2026-07-12 ๐Ÿ“… Created 2024-11-12
49
facebookresearch/perception_models

State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!

facebookresearch
โญ 2,415 Jupyter Notebook ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-04-13 ๐Ÿ“… Created 2025-04-16
โญ 2,368 Jupyter Notebook ๐Ÿ‘ค mistralai Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-01-05

Frequently Asked Questions

1

What is the most popular #multimodal-ai repository on GitHub?

The top ranked open source #multimodal-ai project on GitHub is anthropics/claude-cookbooks with 54,935 stars. A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

2

Which programming languages are most used in #multimodal-ai repositories?

Among the top ranked #multimodal-ai projects on GitHub, the most common programming languages are Python, Jupyter Notebook, JavaScript, Kotlin.

3

How is the #multimodal-ai repository ranking calculated?

We track 191 active open source repositories tagged with #multimodal-ai (500+ stars), totaling 589,873 stars with an average of 3,088 stars per repository. Rankings update daily from the GitHub API.