Git Stars Git Stars

#multimodal-ai Repositories

191
Total Repositories
589,873
Total Stars
3,088
Avg Stars/Repo
101
Azure/AzurePublicDataset

Microsoft Azure Traces

Azure
โญ 1,231 Jupyter Notebook ๐Ÿ‘ค Azure Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2017-08-18
102
liliu-avril/Awesome-Segment-Anything

This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).

liliu-avril
โญ 1,227 ๐Ÿ‘ค liliu-avril User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-16
โญ 1,216 Python ๐Ÿ‘ค Cerebras Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2022-04-08
104
googleapis/go-genai

Google Gen AI Go SDK provides an interface for developers to integrate Google's generative models into their Go applications.

googleapis
โญ 1,210 Go ๐Ÿ‘ค googleapis Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-12-06
105
MoonshotAI/Kimi-VL

Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities

MoonshotAI
โญ 1,203 ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2025-07-15 ๐Ÿ“… Created 2025-04-09
106
visual-openllm/visual-openllm

something like visual-chatgpt, the open-source version of Wenyiyan

visual-openllm
โญ 1,201 Python ๐Ÿ‘ค visual-openllm Organization ๐Ÿ• Updated 2024-02-24 ๐Ÿ“… Created 2023-03-26
โญ 1,170 Python ๐Ÿ‘ค farzaa User ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2025-07-02
108
UMass-Embodied-AGI/3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

UMass-Embodied-AGI
โญ 1,166 Python ๐Ÿ‘ค UMass-Embodied-AGI Organization ๐Ÿ• Updated 2024-06-06 ๐Ÿ“… Created 2023-07-24
109
YUANZHUO-BNU/metahuman_overview

Digital Human Data Organization

YUANZHUO-BNU
โญ 1,143 ๐Ÿ‘ค YUANZHUO-BNU Organization ๐Ÿ• Updated 2025-01-08 ๐Ÿ“… Created 2023-09-05
110
ATH-MaaS/Pixelle-MCP

An Open-Source Multimodal AIGC Solution based on ComfyUI + MCP + LLM https://pixelle.ai

ATH-MaaS
โญ 1,131 Python ๐Ÿ‘ค ATH-MaaS Organization ๐Ÿ• Updated 2025-12-17 ๐Ÿ“… Created 2025-07-28
โญ 1,115 ๐Ÿ‘ค easydoc-ai User ๐Ÿ• Updated 2025-07-08 ๐Ÿ“… Created 2024-12-25
112
XiaomiMiMo/MiMo-Audio

MiMo-Audio: Audio Language Models are Few-Shot Learners

XiaomiMiMo
โญ 1,095 Python ๐Ÿ‘ค XiaomiMiMo Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-09-19
113
Alpha-VLLM/Lumina-mGPT-2.0

Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modeling

Alpha-VLLM
โญ 1,081 Python ๐Ÿ‘ค Alpha-VLLM Organization ๐Ÿ• Updated 2025-11-03 ๐Ÿ“… Created 2025-04-03
114
trailofbits/anamorpher

image scaling attacks for multi-modal prompt injection

trailofbits
โญ 1,079 Python ๐Ÿ‘ค trailofbits Organization ๐Ÿ• Updated 2026-05-19 ๐Ÿ“… Created 2025-08-20
115
ddupont808/GPT-4V-Act

AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI

ddupont808
โญ 1,062 JavaScript ๐Ÿ‘ค ddupont808 User ๐Ÿ• Updated 2024-12-09 ๐Ÿ“… Created 2023-10-21
116
OSU-NLP-Group/Mind2Web

[NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web" -- the first LLM-based web agent and benchmark for generalist web agents

OSU-NLP-Group
โญ 1,036 Jupyter Notebook ๐Ÿ‘ค OSU-NLP-Group Organization ๐Ÿ• Updated 2025-11-05 ๐Ÿ“… Created 2023-04-21
117
google-gemini/nano-banana-hackathon-kit

The official starter kit for the Nano Banana Hackathon. Clone this repo to get building fast!

google-gemini
โญ 1,028 Jupyter Notebook ๐Ÿ‘ค google-gemini Organization ๐Ÿ• Updated 2025-09-08 ๐Ÿ“… Created 2025-09-04
118
JackAILab/ConsistentID

[TPAMI 2026] ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving

JackAILab
โญ 1,026 Python ๐Ÿ‘ค JackAILab User ๐Ÿ• Updated 2026-01-02 ๐Ÿ“… Created 2024-04-15
119
dtsola/xiaoyaosearch

Xiaoyao Search: Understands your words, reads your images, finds any local file with AI. Making search as easy as chatting.

dtsola
โญ 1,023 Python ๐Ÿ‘ค dtsola User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2025-11-11
โญ 1,014 Python ๐Ÿ‘ค HumanMLLM Organization ๐Ÿ• Updated 2025-03-24 ๐Ÿ“… Created 2025-03-09
121
disler/always-on-ai-assistant

A pattern for an always on AI Assistant powered by Deepseek-V3, RealtimeSTT, and Typer for engineering

disler
โญ 991 Python ๐Ÿ‘ค disler User ๐Ÿ• Updated 2025-01-12 ๐Ÿ“… Created 2025-01-12
122
lancedb/vectordb-recipes

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

lancedb
โญ 991 Jupyter Notebook ๐Ÿ‘ค lancedb Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2023-06-25
123
tech-shrimp/gemini-playground

Deploy a Gemini multimodal chat website in 10 seconds, Severless! You only need to prepare a Gemini API Key, and you can deploy a Gemini multimodal chat website in 10 seconds.

tech-shrimp
โญ 977 JavaScript ๐Ÿ‘ค tech-shrimp User ๐Ÿ• Updated 2026-01-23 ๐Ÿ“… Created 2025-01-03
124
microsoft/MM-REACT

Official repo for MM-REACT

microsoft
โญ 965 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2023-03-15
125
facebookresearch/spiritlm

Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".

facebookresearch
โญ 926 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2024-10-28 ๐Ÿ“… Created 2024-09-06
127
TencentARC/SEED-Story

SEED-Story: Multimodal Long Story Generation with Large Language Model

TencentARC
โญ 879 Python ๐Ÿ‘ค TencentARC Organization ๐Ÿ• Updated 2024-10-11 ๐Ÿ“… Created 2024-07-10
128
InternLM/Intern-S1

A Scientific Multimodal Foundation Model

InternLM
โญ 876 ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2026-09-13 ๐Ÿ“… Created 2025-07-25
129
DirtyHarryLYL/LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

DirtyHarryLYL
โญ 868 ๐Ÿ‘ค DirtyHarryLYL User ๐Ÿ• Updated 2025-03-08 ๐Ÿ“… Created 2023-03-10
130
IDEA-Research/Motion-X

[NeurIPS 2023] Official implementation of the paper "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset"

IDEA-Research
โญ 863 Python ๐Ÿ‘ค IDEA-Research Organization ๐Ÿ• Updated 2025-03-03 ๐Ÿ“… Created 2023-06-12
131
RiseInRose/MiniGPT-4-ZH

MiniGPT-4 Chinese Deployment Translation Refine deployment details

RiseInRose
โญ 859 Python ๐Ÿ‘ค RiseInRose User ๐Ÿ• Updated 2026-05-09 ๐Ÿ“… Created 2023-04-19
โญ 853 Python ๐Ÿ‘ค jiayev User ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2023-12-27
133
allenai/molmo

Code for the Molmo Vision-Language Model

allenai
โญ 851 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2024-12-12 ๐Ÿ“… Created 2024-12-05
134
jrin771/Everything-LLMs-And-Robotics

The world's largest GitHub Repository for LLMs + Robotics

jrin771
โญ 850 ๐Ÿ‘ค jrin771 User ๐Ÿ• Updated 2024-07-14 ๐Ÿ“… Created 2023-05-10
135
TideDra/lmm-r1

Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.

TideDra
โญ 843 Python ๐Ÿ‘ค TideDra User ๐Ÿ• Updated 2025-05-14 ๐Ÿ“… Created 2025-02-13
136
GAIR-NLP/anole

[Extended version ICLR 2025 Blog Track] Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

GAIR-NLP
โญ 841 Python ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2025-06-16 ๐Ÿ“… Created 2024-07-01
137
vimalabs/VIMA

Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"

vimalabs
โญ 841 Python ๐Ÿ‘ค vimalabs Organization ๐Ÿ• Updated 2024-04-18 ๐Ÿ“… Created 2022-10-07
138
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
139
CodeGoat24/UnifiedReward

Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think & UnifiedReward-Flex

CodeGoat24
โญ 831 Python ๐Ÿ‘ค CodeGoat24 User ๐Ÿ• Updated 2026-06-18 ๐Ÿ“… Created 2025-03-04
140
nvidia-cosmos/cosmos-transfer1

Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.

nvidia-cosmos
โญ 830 Python ๐Ÿ‘ค nvidia-cosmos Organization ๐Ÿ• Updated 2026-10-15 ๐Ÿ“… Created 2025-03-02
141
iwyxdxl/WeChatBot_WXAUTO_SE

[No longer maintained] LLM API aggregation conversation tool. Original project repository: https://github.com/KouriChat/KouriChat This project was modified and created by iwyxdxl based on the original project. For learning purposes only, please comply with regulations, do not connect to public platforms or use in any production activities.

iwyxdxl
โญ 816 Python ๐Ÿ‘ค iwyxdxl User ๐Ÿ• Updated 2026-01-15 ๐Ÿ“… Created 2025-03-07
142
webmachinelearning/prompt-api

๐Ÿ’ฌ A proposal for a web API for prompting browser-provided language models

webmachinelearning
โญ 797 Bikeshed ๐Ÿ‘ค webmachinelearning Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-07-01
โญ 790 Jupyter Notebook ๐Ÿ‘ค OptimalScale Organization ๐Ÿ• Updated 2024-08-07 ๐Ÿ“… Created 2023-05-08
144
mlfoundations/datacomp

DataComp: In search of the next generation of multimodal datasets

mlfoundations
โญ 780 Python ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2025-04-28 ๐Ÿ“… Created 2023-04-28
145
ModalMinds/MM-EUREKA

MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning

ModalMinds
โญ 770 Python ๐Ÿ‘ค ModalMinds Organization ๐Ÿ• Updated 2025-09-07 ๐Ÿ“… Created 2025-03-07
146
MewCo-AI/mewco_ai_assistant_comm

Fengyun AI Assistant Community Edition

MewCo-AI
โญ 756 Python ๐Ÿ‘ค MewCo-AI Organization ๐Ÿ• Updated 2026-06-12 ๐Ÿ“… Created 2024-07-09
147
Ruixxxx/Awesome-Vision-Mamba-Models

[Official Repo] Visual Mamba: A Survey and New Outlooks

Ruixxxx
โญ 753 ๐Ÿ‘ค Ruixxxx User ๐Ÿ• Updated 2026-08-17 ๐Ÿ“… Created 2024-04-09
148
IDEA-Research/OpenSeeD

[ICCV 2023] Official implementation of the paper "A Simple Framework for Open-Vocabulary Segmentation and Detection"

IDEA-Research
โญ 745 Python ๐Ÿ‘ค IDEA-Research Organization ๐Ÿ• Updated 2024-01-22 ๐Ÿ“… Created 2023-03-14
149
chflame163/ComfyUI_LayerStyle_Advance

The nodes detached from [ComfyUI Layer Style](https://github.com/chflame163/ComfyUI_LayerStyle) are mainly those with complex requirements for dependency packages.

chflame163
โญ 724 Python ๐Ÿ‘ค chflame163 User ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2024-12-05
150
ComfyUI-Workflow/awesome-comfyui

A collection of awesome custom nodes for ComfyUI

ComfyUI-Workflow
โญ 724 Python ๐Ÿ‘ค ComfyUI-Workflow Organization ๐Ÿ• Updated 2025-07-24 ๐Ÿ“… Created 2024-10-05