Git Stars Git Stars

#multimodal Repositories

183
Total Repositories
700,629
Total Stars
3,828
Avg Stars/Repo
51
docarray/docarray

Represent, send, store and search multimodal data

docarray
โญ 3,123 Python ๐Ÿ‘ค docarray Organization ๐Ÿ• Updated 2026-03-27 ๐Ÿ“… Created 2021-12-14
52
InternLM/InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM
โญ 2,925 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2023-09-26
53
datachain-ai/datachain

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

datachain-ai
โญ 2,831 Python ๐Ÿ‘ค datachain-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-25
54
autodistill/autodistill

Images to inference with no labeling (use foundation models to train supervised models).

autodistill
โญ 2,802 Python ๐Ÿ‘ค autodistill Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2023-06-06
55
rom1504/clip-retrieval

Easily compute clip embeddings and build a clip retrieval system with them

rom1504
โญ 2,799 Jupyter Notebook ๐Ÿ‘ค rom1504 User ๐Ÿ• Updated 2026-03-28 ๐Ÿ“… Created 2021-06-07
56
roboflow/maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

roboflow
โญ 2,696 Python ๐Ÿ‘ค roboflow Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-11-24
57
genieincodebottle/generative-ai

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

genieincodebottle
โญ 2,675 Jupyter Notebook ๐Ÿ‘ค genieincodebottle User ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-01-09
58
om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

om-ai-lab
โญ 2,670 Python ๐Ÿ‘ค om-ai-lab Organization ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2024-07-04
59
OFA-Sys/OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

OFA-Sys
โญ 2,550 Python ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2024-04-24 ๐Ÿ“… Created 2022-01-29
60
X-PLUG/mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

X-PLUG
โญ 2,541 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-04-02 ๐Ÿ“… Created 2023-04-25
61
InternLM/HuixiangDou

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

InternLM
โญ 2,500 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-12-28
62
AI-Efficiency/Awesome-Model-Quantization

A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

AI-Efficiency
โญ 2,471 ๐Ÿ‘ค AI-Efficiency Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2018-10-18
63
Yutong-Zhou-cv/Awesome-Text-to-Image

(เท†`๊’ณยดเท†) A Survey on Text-to-Image Generation/Synthesis.

Yutong-Zhou-cv
โญ 2,444 ๐Ÿ‘ค Yutong-Zhou-cv User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2020-10-13
64
Stability-AI/stability-sdk

SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)

Stability-AI
โญ 2,436 Jupyter Notebook ๐Ÿ‘ค Stability-AI Organization ๐Ÿ• Updated 2026-05-14 ๐Ÿ“… Created 2022-08-22
65
Turbo1123/roubao

Roubao 2.0 for iPhone: an open-source iOS AI agent with owner-authorized Micro-X UI control, custom models, resumable tasks, and PDF reports. No Wi-Fi, jailbreak, computer, or extra hardware required at runtime (Mac + USB required for setup). Legacy Android version retained.

Turbo1123
โญ 2,422 Swift ๐Ÿ‘ค Turbo1123 User ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2025-12-09
66
OpenGVLab/InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

OpenGVLab
โญ 2,421 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2026-07-02 ๐Ÿ“… Created 2022-11-23
67
NVIDIA-NeMo/DataDesigner

๐ŸŽจ NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

NVIDIA-NeMo
โญ 2,419 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-16
68
X-PLUG/mPLUG-DocOwl

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

X-PLUG
โญ 2,407 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-05-30 ๐Ÿ“… Created 2023-07-04
69
HUANGCHIHHUNGLeo/claude-real-video

Let Claude (or any LLM) actually watch a video โ€” scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.

HUANGCHIHHUNGLeo
โญ 2,329 Python ๐Ÿ‘ค HUANGCHIHHUNGLeo User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-30
70
google-gemini/genai-processors

GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.

google-gemini
โญ 2,125 Python ๐Ÿ‘ค google-gemini Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2025-04-29
71
fikrikarim/parlor

On-device, real-time multimodal AI with features similar to GPT-Live

fikrikarim
โญ 2,117 Python ๐Ÿ‘ค fikrikarim User ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2026-04-05
72
showlab/Show-o

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

showlab
โญ 1,988 Python ๐Ÿ‘ค showlab Organization ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2024-08-09
73
2U1/Qwen-VL-Series-Finetune

An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.

2U1
โญ 1,983 Python ๐Ÿ‘ค 2U1 User ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2024-09-10
74
kyegomez/BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

kyegomez
โญ 1,949 Python ๐Ÿ‘ค kyegomez User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-10-18
75
sgl-project/sglang-omni

High-Performance Serving Runtime for Interactive Superintelligence Systems

sgl-project
โญ 1,882 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-07
76
AlibabaResearch/AdvancedLiterateMachinery

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

AlibabaResearch
โญ 1,832 C++ ๐Ÿ‘ค AlibabaResearch Organization ๐Ÿ• Updated 2026-03-17 ๐Ÿ“… Created 2022-09-28
77
potamides/DeTikZify

Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ.

potamides
โญ 1,831 Python ๐Ÿ‘ค potamides User ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2023-11-27
78
Tencent/WeMM-Embedding

WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.

Tencent
โญ 1,824 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2026-08-25
79
alan-ai/alan-sdk-android

The Self-Coding System for Your App โ€” Alan AI SDK for Android

alan-ai
โญ 1,815 ๐Ÿ‘ค alan-ai Organization ๐Ÿ• Updated 2025-04-22 ๐Ÿ“… Created 2019-10-01
โญ 1,795 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2026-06-15
81
alan-ai/alan-sdk-flutter

The Self-Coding System for Your App โ€” Alan AI SDK for Flutter

alan-ai
โญ 1,768 Ruby ๐Ÿ‘ค alan-ai Organization ๐Ÿ• Updated 2025-04-22 ๐Ÿ“… Created 2020-04-22
82
pixeltable/pixeltable

The backend agents build with - Multimodal database, orchestration, and serving in one file

pixeltable
โญ 1,664 Python ๐Ÿ‘ค pixeltable Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-10
83
alan-ai/alan-sdk-ionic

The Self-Coding System for Your App โ€” Alan AI SDK for Ionic

alan-ai
โญ 1,661 TypeScript ๐Ÿ‘ค alan-ai Organization ๐Ÿ• Updated 2025-04-22 ๐Ÿ“… Created 2020-04-24
84
UbiquitousLearning/mllm

Fast Multimodal LLM on Mobile Devices

UbiquitousLearning
โญ 1,643 C++ ๐Ÿ‘ค UbiquitousLearning User ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2023-08-30
85
verl-project/verl-omni

Multimodal RL training framework for diffusion & omni models

verl-project
โญ 1,560 Python ๐Ÿ‘ค verl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-21
86
ATH-MaaS/Ovis

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

ATH-MaaS
โญ 1,536 Python ๐Ÿ‘ค ATH-MaaS Organization ๐Ÿ• Updated 2026-07-15 ๐Ÿ“… Created 2024-06-13
87
valentinfrlch/ha-llmvision

Visual intelligence for your home.

valentinfrlch
โญ 1,535 Python ๐Ÿ‘ค valentinfrlch User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2024-05-14
88
emcf/thepipe

Get clean data from tricky documents, powered by vision-language models โšก

emcf
โญ 1,529 Python ๐Ÿ‘ค emcf User ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2024-03-22
89
jordanrendric/claude-video-vision

Give Claude the ability to watch and understand videos โ€” Claude Code plugin with frame extraction and multimodal audio analysis

jordanrendric
โญ 1,523 TypeScript ๐Ÿ‘ค jordanrendric User ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2026-03-31
90
llm-jp/awesome-japanese-llm

Japanese LLM Summary - Overview of Japanese LLMs

llm-jp
โญ 1,446 TypeScript ๐Ÿ‘ค llm-jp Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2023-07-09
91
xtreme1-io/xtreme1

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.

xtreme1-io
โญ 1,395 TypeScript ๐Ÿ‘ค xtreme1-io Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2022-08-08
92
dailenson/SDT

This repository is the official implementation of Disentangling Writer and Character Styles for Handwriting Generation (CVPR 2023)

dailenson
โญ 1,393 Python ๐Ÿ‘ค dailenson User ๐Ÿ• Updated 2025-06-26 ๐Ÿ“… Created 2023-03-22
93
gokayfem/awesome-vlm-architectures

Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

gokayfem
โญ 1,368 Markdown ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-02-15
94
Capsize-Games/airunner

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

Capsize-Games
โญ 1,317 Python ๐Ÿ‘ค Capsize-Games Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-03-21
95
ysr666/dsh-vision-router

Eyes for text-only DeepSeek Harness agents: built-in free vision chain (no key) + pixel-level vision tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG trace, cutout, screenshots). One-command install, no Python, image turns work like ordinary tool-calling turns.

ysr666
โญ 1,294 JavaScript ๐Ÿ‘ค ysr666 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-13
96
Anionex/agent-vision-toolkit

Design a better vision toolkit and skills for text-only models to "see" images, supporting multi-image understanding, image Q&A, frontend UI restoration, GUI automation, etc., with optional seamless integration with multiple mainstream agents, and direct recognition of pasted images | A vision toolkit and skill designed for text-only LLMs โ€” image Q&A, long-screenshot OCR, frontend UI restoration, and GUI automation, with optional seamless integration for Codex, Claude Code, Pi, Oh My Pi, and OpenCode

Anionex
โญ 1,267 Python ๐Ÿ‘ค Anionex User ๐Ÿ• Updated 2026-10-13 ๐Ÿ“… Created 2026-08-01
97
unum-cloud/UForm

Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions ๐Ÿ–ผ๏ธ

unum-cloud
โญ 1,253 Cuda ๐Ÿ‘ค unum-cloud Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-02-21
98
Zen4-bit/Proxima

Multi-AI MCP Server - Connect ChatGPT, Claude, Gemini & Perplexity to your coding tools without any API

Zen4-bit
โญ 1,220 JavaScript ๐Ÿ‘ค Zen4-bit User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-02-02
99
nv-tlabs/LLaMA-Mesh

Unifying 3D Mesh Generation with Language Models

nv-tlabs
โญ 1,153 Python ๐Ÿ‘ค nv-tlabs Organization ๐Ÿ• Updated 2025-03-28 ๐Ÿ“… Created 2024-11-14
100
OpenMOSS/MOVA

A foundation model that generates synchronized video and audio in a single model

OpenMOSS
โญ 1,151 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-28