Git Stars Git Stars

#multimodal Repositories

183
Total Repositories
700,629
Total Stars
3,828
Avg Stars/Repo
101
alan-ai/alan-sdk-cordova

The Self-Coding System for Your App โ€” Alan AI SDK for Cordova

alan-ai
โญ 1,140 Ruby ๐Ÿ‘ค alan-ai Organization ๐Ÿ• Updated 2025-04-22 ๐Ÿ“… Created 2019-10-23
102
rhymes-ai/Aria

Codebase for Aria - an Open Multimodal Native MoE

rhymes-ai
โญ 1,089 Jupyter Notebook ๐Ÿ‘ค rhymes-ai Organization ๐Ÿ• Updated 2025-01-22 ๐Ÿ“… Created 2024-09-29
103
google-research-datasets/wit

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

google-research-datasets
โญ 1,086 ๐Ÿ‘ค google-research-datasets Organization ๐Ÿ• Updated 2024-09-27 ๐Ÿ“… Created 2021-02-24
104
OpenBMB/VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | Chinese-English Bilingual Multimodal Large Model Series based on CPM Foundation Model

OpenBMB
โญ 1,072 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2024-06-13 ๐Ÿ“… Created 2023-06-30
105
InternRobotics/PointLLM

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

InternRobotics
โญ 1,065 Python ๐Ÿ‘ค InternRobotics Organization ๐Ÿ• Updated 2026-05-15 ๐Ÿ“… Created 2023-08-17
106
OFA-Sys/ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

OFA-Sys
โญ 1,063 Python ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2024-10-06 ๐Ÿ“… Created 2023-05-18
107
WangRongsheng/XrayGLM

๐Ÿฉบ The first Chinese Medical Multimodal Model that Chest Radiographs Summarization.

WangRongsheng
โญ 1,052 Python ๐Ÿ‘ค WangRongsheng User ๐Ÿ• Updated 2024-11-20 ๐Ÿ“… Created 2023-05-23
108
tong-io/tongflow

Agent-Human-Friendly, Modality-First, Enterprise-Level GenAI Workflow Platform

tong-io
โญ 1,048 TypeScript ๐Ÿ‘ค tong-io User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-08
109
yaotingwangofficial/Awesome-MCoT

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

yaotingwangofficial
โญ 1,030 TeX ๐Ÿ‘ค yaotingwangofficial User ๐Ÿ• Updated 2026-10-03 ๐Ÿ“… Created 2025-02-15
110
ArrowLuo/CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

ArrowLuo
โญ 1,017 Python ๐Ÿ‘ค ArrowLuo User ๐Ÿ• Updated 2024-04-12 ๐Ÿ“… Created 2021-04-13
111
lancedb/vectordb-recipes

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

lancedb
โญ 991 Jupyter Notebook ๐Ÿ‘ค lancedb Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2023-06-25
112
Valen-Team/Valen

Open multimodal decision models, 0.8B to 27B, for text, images and video. Decide with probabilities over your own candidates and locate with bounding boxes, in place of generated text. Free API, ONNX, GGUF, vLLM and SGLang; fine-tuning code included.

Valen-Team
โญ 932 Python ๐Ÿ‘ค Valen-Team Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-09-23
113
EvolvingLMMs-Lab/NEO

NEO Series: Native Vision-Language Models from First Principles

EvolvingLMMs-Lab
โญ 931 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2025-10-16
114
shenhao-stu/ohmycaptcha

โšก Self-hostable YesCaptcha-compatible captcha solver built with FastAPI, Playwright, and OpenAI-compatible multimodal models.

shenhao-stu
โญ 912 Python ๐Ÿ‘ค shenhao-stu User ๐Ÿ• Updated 2026-03-09 ๐Ÿ“… Created 2026-03-09
115
facebookresearch/ShapeR

Code for the ShapeR research paper

facebookresearch
โญ 904 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-04-30 ๐Ÿ“… Created 2026-01-14
116
SkalskiP/top-cvpr-2025-papers

About This repository is a curated collection of the most exciting and influential CVPR 2025 papers. ๐Ÿ”ฅ [Paper + Code + Demo]

SkalskiP
โญ 899 Python ๐Ÿ‘ค SkalskiP User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2025-05-31
117
OpenMOSS/AnyGPT

A unified multimodal language model based on discrete sequence modeling

OpenMOSS
โญ 889 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2024-02-18
118
microsoft/rag-time

RAG Time: A 5-week Learning Journey to Mastering RAG

microsoft
โญ 888 Jupyter Notebook ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2025-06-17 ๐Ÿ“… Created 2024-12-11
119
suzuran0y/CCTV-Smartphone-AI-Monitoring

Local monitoring + AI vision โ€” LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.

suzuran0y
โญ 879 Python ๐Ÿ‘ค suzuran0y User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2026-02-26
120
whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

whitecircle
โญ 868 Python ๐Ÿ‘ค whitecircle Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-26
121
OpenMOSS/MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

OpenMOSS
โญ 838 C++ ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-04-08
122
EvolvingLMMs-Lab/lmms-engine

A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.

EvolvingLMMs-Lab
โญ 835 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2025-07-27
123
chipfighter/context-attachment-manager

A local plugin for image-heavy chats in Codex, Claude Code, and other AI agents: earlier images are replaced with short placeholders instead of being sent with every message, the model retrieves the original by its ID (even after compaction), and the prompt cache keeps working.

chipfighter
โญ 812 TypeScript ๐Ÿ‘ค chipfighter User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-24
124
ChaofanTao/Autoregressive-Models-in-Vision-Survey

[TMLR 2025๐Ÿ”ฅ] A survey for the autoregressive models in vision.

ChaofanTao
โญ 805 ๐Ÿ‘ค ChaofanTao User ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2024-07-01
125
nomic-ai/contrastors

Train Models Contrastively in Pytorch

nomic-ai
โญ 791 Python ๐Ÿ‘ค nomic-ai Organization ๐Ÿ• Updated 2025-03-26 ๐Ÿ“… Created 2024-01-30
126
allenai/papermage

library supporting NLP and CV research on scientific papers

allenai
โญ 785 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2024-11-08 ๐Ÿ“… Created 2023-01-14
127
Yangyi-Chen/Multimodal-AND-Large-Language-Models

Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.

Yangyi-Chen
โญ 765 ๐Ÿ‘ค Yangyi-Chen User ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2022-08-28
128
PaddlePaddle/PaddleMIX

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

PaddlePaddle
โญ 721 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-03-06 ๐Ÿ“… Created 2023-07-05
129
magicrew/doc7

Turn documents into AI-ready Markdown with visual understanding

magicrew
โญ 719 Go ๐Ÿ‘ค magicrew Organization ๐Ÿ• Updated 2026-08-07 ๐Ÿ“… Created 2026-08-02
130
OpenMOSS/MOSS-Audio

An open-source model for understanding speech, environmental sounds, and music through captioning, question answering, and reasoning

OpenMOSS
โญ 713 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2026-04-11
131
enoche/MMRec

A Toolbox for MultiModal Recommendation. Integrating 10+ Models...

enoche
โญ 707 Python ๐Ÿ‘ค enoche User ๐Ÿ• Updated 2026-07-14 ๐Ÿ“… Created 2022-08-31
132
TIGER-AI-Lab/VLM2Vec

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

TIGER-AI-Lab
โญ 705 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2024-10-07
133
mv-lab/InstructIR

[ECCV 2024] InstructIR: High-Quality Image Restoration Following Human Instructions https://huggingface.co/spaces/marcosv/InstructIR

mv-lab
โญ 693 Jupyter Notebook ๐Ÿ‘ค mv-lab User ๐Ÿ• Updated 2024-09-26 ๐Ÿ“… Created 2024-01-27
134
henrydaum/second-brain

Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.

henrydaum
โญ 687 Python ๐Ÿ‘ค henrydaum User ๐Ÿ• Updated 2026-09-26 ๐Ÿ“… Created 2025-09-19
135
HRuiCcc/RuiC-card-skill

A universal Agent Skill for holographic trading cardsโ€”compatible with any host and multimodal model. Generate a 3D card webpage from a single sentence, with cards you can drag and rotate, flowing light, and layered depth, plus an editable Blender project.

HRuiCcc
โญ 686 JavaScript ๐Ÿ‘ค HRuiCcc User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2026-09-07
136
zhongkaifu/TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, an iPhone app, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows, macOS, iOS, and Linux with full GPU capability.

zhongkaifu
โญ 681 C# ๐Ÿ‘ค zhongkaifu User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-03
137
Topkiflare74/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

Topkiflare74
โญ 678 ๐Ÿ‘ค Topkiflare74 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
138
redai-studio/Relax

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

redai-studio
โญ 678 Python ๐Ÿ‘ค redai-studio Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-13
139
topapothecarycanal/ai--manus2.0

AI Manus is a general-purpose AI agent system that supports running various tools and operations in a sandbox environment.

topapothecarycanal
โญ 666 ๐Ÿ‘ค topapothecarycanal User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
140
toppatronweave/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

toppatronweave
โญ 665 ๐Ÿ‘ค toppatronweave User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
141
reasoning-survey/Awesome-Reasoning-Foundation-Models

โœจโœจLatest Papers and Benchmarks in Reasoning with Foundation Models

reasoning-survey
โญ 664 ๐Ÿ‘ค reasoning-survey User ๐Ÿ• Updated 2026-09-03 ๐Ÿ“… Created 2023-11-21
142
topconstableinlet67/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

topconstableinlet67
โญ 663 ๐Ÿ‘ค topconstableinlet67 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
143
tornadonovicewhirl40/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

tornadonovicewhirl40
โญ 659 ๐Ÿ‘ค tornadonovicewhirl40 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
144
TitanShieldRavine/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

TitanShieldRavine
โญ 659 ๐Ÿ‘ค TitanShieldRavine User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
145
Ultimateakiln/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

Ultimateakiln
โญ 654 ๐Ÿ‘ค Ultimateakiln User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
146
trackersnailgrip/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

trackersnailgrip
โญ 654 ๐Ÿ‘ค trackersnailgrip User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
147
TrapBladesmith/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

TrapBladesmith
โญ 653 ๐Ÿ‘ค TrapBladesmith User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
148
Torusdrasocket/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

Torusdrasocket
โญ 653 ๐Ÿ‘ค Torusdrasocket User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
149
TremorRatTackle/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

TremorRatTackle
โญ 652 ๐Ÿ‘ค TremorRatTackle User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14
150
violetkomodolimit/ai--manus2.0

AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.

violetkomodolimit
โญ 651 ๐Ÿ‘ค violetkomodolimit User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-11-14