Git Stars Git Stars

#multi-modal-ai Repositories

Discover 37 active open source GitHub repositories tagged with #multi-modal-ai, accumulating 152,489 total stars (averaging 4,121 stars per project). Leading this topic is Lordog/dive-into-llms with 55,949 stars.

37
Total Repositories
152,489
Total Stars
4,121
Avg Stars/Repo
1
Lordog/dive-into-llms

"Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series

Lordog
โญ 55,949 Jupyter Notebook ๐Ÿ‘ค Lordog User ๐Ÿ• Updated 2025-10-10 ๐Ÿ“… Created 2024-04-08
2
huggingface/smolagents

๐Ÿค— smolagents: a barebones library for agents that think in code.

huggingface
โญ 30,465 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-12-05
3
lllyasviel/Omost

Your image is almost there!

lllyasviel
โญ 7,661 Python ๐Ÿ‘ค lllyasviel User ๐Ÿ• Updated 2024-07-26 ๐Ÿ“… Created 2024-05-29
4
UX-Decoder/Segment-Everything-Everywhere-All-At-Once

[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"

UX-Decoder
โญ 4,761 Python ๐Ÿ‘ค UX-Decoder Organization ๐Ÿ• Updated 2024-08-19 ๐Ÿ“… Created 2023-04-12
5
mushan0x0/AI0x0.com

A multimodal, multimodel general-purpose global almighty AI query generation desktop floating assistant application

mushan0x0
โญ 3,950 ๐Ÿ‘ค mushan0x0 User ๐Ÿ• Updated 2025-02-06 ๐Ÿ“… Created 2023-02-26
6
wwwzhouhui/dify-for-dsl

This project is a collection of dsl workflow scripts implemented based on the dify open-source project.

wwwzhouhui
โญ 3,884 Python ๐Ÿ‘ค wwwzhouhui User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2024-11-15
7
NVlabs/VILA

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

NVlabs
โญ 3,873 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2024-02-23
8
IDEA-Research/Grounded-SAM-2

Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2

IDEA-Research
โญ 3,807 Jupyter Notebook ๐Ÿ‘ค IDEA-Research Organization ๐Ÿ• Updated 2025-11-11 ๐Ÿ“… Created 2024-08-01
โญ 3,473 ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2025-03-07 ๐Ÿ“… Created 2025-01-19
10
NVIDIA/ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

NVIDIA
โญ 3,101 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-01-21 ๐Ÿ“… Created 2023-10-18
11
fogsightai/fogsight

Fogsight is an AI agent and animation engine powered by Large Language Models.

fogsightai
โญ 2,567 JavaScript ๐Ÿ‘ค fogsightai Organization ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2025-07-17
12
AmberLJC/LLMSys-PaperList

Large Language Model (LLM) Systems Paper List

AmberLJC
โญ 2,332 Python ๐Ÿ‘ค AmberLJC User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2023-06-06
13
thu-ml/RoboticsDiffusionTransformer

RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation

thu-ml
โญ 1,821 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-01-21 ๐Ÿ“… Created 2024-10-07
14
OS-Copilot/OS-Copilot

An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.

OS-Copilot
โญ 1,718 Python ๐Ÿ‘ค OS-Copilot Organization ๐Ÿ• Updated 2024-09-09 ๐Ÿ“… Created 2024-02-02
15
cvlab-columbia/viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

cvlab-columbia
โญ 1,711 Jupyter Notebook ๐Ÿ‘ค cvlab-columbia Organization ๐Ÿ• Updated 2024-01-29 ๐Ÿ“… Created 2023-03-14
16
AK391/ai-gradio

A Python package that makes it easy for developers to create AI apps powered by various AI providers.

AK391
โญ 1,643 Python ๐Ÿ‘ค AK391 User ๐Ÿ• Updated 2025-04-08 ๐Ÿ“… Created 2024-12-14
17
AI-FanGe/OpenAIglasses_for_Navigation

an open framework for blind navigation based on ESP32

AI-FanGe
โญ 1,399 Python ๐Ÿ‘ค AI-FanGe User ๐Ÿ• Updated 2025-11-01 ๐Ÿ“… Created 2025-10-20
18
egoist/chatwise-releases

The fastest AI Chatbot for any LLM

egoist
โญ 1,373 TypeScript ๐Ÿ‘ค egoist User ๐Ÿ• Updated 2026-07-01 ๐Ÿ“… Created 2024-11-05
โญ 1,370 Jupyter Notebook ๐Ÿ‘ค philschmid User ๐Ÿ• Updated 2026-03-03 ๐Ÿ“… Created 2025-02-05
20
TencentQQGYLab/ELLA

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

TencentQQGYLab
โญ 1,269 Python ๐Ÿ‘ค TencentQQGYLab Organization ๐Ÿ• Updated 2024-07-17 ๐Ÿ“… Created 2024-03-07
22
tegnike/aituber-kit

A web application for chatting with AI characters that anyone can easily set up and deploy.

tegnike
โญ 1,147 TypeScript ๐Ÿ‘ค tegnike User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-10-14
23
gabber-dev/gabber

Build AI applications that can see, hear, and speak using your screens, microphones, and cameras as inputs.

gabber-dev
โญ 1,110 Python ๐Ÿ‘ค gabber-dev Organization ๐Ÿ• Updated 2025-12-20 ๐Ÿ“… Created 2025-07-25
24
open-gigaai/giga-models

GigaModels: A Comprehensive Repository and Platform for Multi-modal, Generative, and Perceptual Models

open-gigaai
โญ 1,064 Python ๐Ÿ‘ค open-gigaai Organization ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2025-09-26
25
HarborYuan/ovsam

[ECCV 2024] The official code of paper "Open-Vocabulary SAM".

HarborYuan
โญ 1,034 Python ๐Ÿ‘ค HarborYuan User ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2024-01-05
26
huggingface/AnyLanguageModel

An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.

huggingface
โญ 990 Swift ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-10-05
27
mistralai/mistral-common

Official inference library for pre-processing of Mistral models

mistralai
โญ 965 Python ๐Ÿ‘ค mistralai Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-04-15
28
opendilab/LMDrive

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

opendilab
โญ 905 Jupyter Notebook ๐Ÿ‘ค opendilab Organization ๐Ÿ• Updated 2025-04-14 ๐Ÿ“… Created 2023-12-12
29
dvlab-research/LLaMA-VID

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

JIA-Lab-research
โญ 854 Python ๐Ÿ‘ค JIA-Lab-research Organization ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-11-28
30
thu-ml/RDT2

Official code of RDT 2

thu-ml
โญ 811 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-02-07 ๐Ÿ“… Created 2025-09-19
โญ 696 Go ๐Ÿ‘ค deanxv User ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2024-12-23
32
Alibaba-NLP/ViDoRAG

[EMNLP 2025] ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents

Alibaba-NLP
โญ 670 Python ๐Ÿ‘ค Alibaba-NLP Organization ๐Ÿ• Updated 2026-01-11 ๐Ÿ“… Created 2025-02-25
33
ShihaoZhaoZSH/Uni-ControlNet

[NeurIPS 2023] Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models

ShihaoZhaoZSH
โญ 665 Python ๐Ÿ‘ค ShihaoZhaoZSH User ๐Ÿ• Updated 2024-07-17 ๐Ÿ“… Created 2023-05-23
โญ 590 Python ๐Ÿ‘ค langchain-ai Organization ๐Ÿ• Updated 2025-06-26 ๐Ÿ“… Created 2025-06-23
35
IuvenisSapiens/ComfyUI_Qwen3-VL-Instruct

The successful integration of Qwen3-VL-Instruct series into the ComfyUI platform has enabled a smooth operation, supporting (but not limited to) text-based queries, video queries, single-image queries, and multi-image queries for generating captions or responses.

IuvenisSapiens
โญ 587 Python ๐Ÿ‘ค IuvenisSapiens User ๐Ÿ• Updated 2025-10-23 ๐Ÿ“… Created 2024-08-31
36
moxin-org/Moxin-LLM

Moxin is a family of fully open-source and reproducible LLMs

moxin-org
โญ 526 Python ๐Ÿ‘ค moxin-org Organization ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2024-12-03
37
shansongliu/MuMu-LLaMA

This is the official repository for M2UGen

shansongliu
โญ 512 Jupyter Notebook ๐Ÿ‘ค shansongliu User ๐Ÿ• Updated 2025-01-02 ๐Ÿ“… Created 2023-10-20

Frequently Asked Questions

1

What is the most popular #multi-modal-ai repository on GitHub?

The top ranked open source #multi-modal-ai project on GitHub is Lordog/dive-into-llms with 55,949 stars. "Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series

2

Which programming languages are most used in #multi-modal-ai repositories?

Among the top ranked #multi-modal-ai projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, JavaScript.

3

How is the #multi-modal-ai repository ranking calculated?

We track 37 active open source repositories tagged with #multi-modal-ai (500+ stars), totaling 152,489 stars with an average of 4,121 stars per repository. Rankings update daily from the GitHub API.