Git Stars Git Stars

#multimodal-ai Repositories

191
Total Repositories
589,873
Total Stars
3,088
Avg Stars/Repo
โญ 715 Python ๐Ÿ‘ค SkunkworksAI Organization ๐Ÿ• Updated 2024-03-06 ๐Ÿ“… Created 2023-10-10
153
stepfun-ai/NextStep-1

[๐Ÿš€ ICLR 2026 Oral] NextStep-1: SOTA Autogressive Image Generation with Continuous Tokens. A research project developed by the StepFunโ€™s Multimodal Intelligence team.

stepfun-ai
โญ 696 Python ๐Ÿ‘ค stepfun-ai Organization ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2025-08-14
154
Yaofang-Liu/Pusa-VidGen

Pusa: Thousands Timesteps Video Diffusion Model

Yaofang-Liu
โญ 685 Python ๐Ÿ‘ค Yaofang-Liu User ๐Ÿ• Updated 2026-02-13 ๐Ÿ“… Created 2025-03-25
155
AlexZhangji/Twitter-Insight-LLM

Twitter data scraping, embedding based image search and more.

AlexZhangji
โญ 685 Jupyter Notebook ๐Ÿ‘ค AlexZhangji User ๐Ÿ• Updated 2024-04-17 ๐Ÿ“… Created 2024-03-05
156
gregsadetsky/sagittarius

A GPT-4/Gemini Voice/Video Exploration Tool

gregsadetsky
โญ 685 TypeScript ๐Ÿ‘ค gregsadetsky User ๐Ÿ• Updated 2024-01-26 ๐Ÿ“… Created 2023-12-11
157
inclusionAI/Ming

Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.

inclusionAI
โญ 683 Jupyter Notebook ๐Ÿ‘ค inclusionAI Organization ๐Ÿ• Updated 2026-07-27 ๐Ÿ“… Created 2025-04-21
158
ATH-MaaS/Agentic-ADK

Agentic ADK is an Agent application development framework launched by Alibaba International AI Business, based on Google-ADK and Ali-LangEngine.

ATH-MaaS
โญ 683 Java ๐Ÿ‘ค ATH-MaaS Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2024-11-08
159
pfrankov/obsidian-local-gpt

Local Ollama and OpenAI-like GPT's assistance for maximum privacy and offline access

pfrankov
โญ 678 TypeScript ๐Ÿ‘ค pfrankov User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2023-12-03
161
zstar1003/FreeTex

A free intelligent formula recognition software

zstar1003
โญ 668 Python ๐Ÿ‘ค zstar1003 User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-05-04
162
snap-research/Panda-70M

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

snap-research
โญ 659 Python ๐Ÿ‘ค snap-research Organization ๐Ÿ• Updated 2024-10-25 ๐Ÿ“… Created 2024-02-14
163
videosdk-live/agents

Open-source framework for developing real-time multimodal conversational AI agents.

videosdk-live
โญ 657 Python ๐Ÿ‘ค videosdk-live Organization ๐Ÿ• Updated 2026-08-07 ๐Ÿ“… Created 2025-05-02
164
yhLeeee/Awesome-LLMs-in-Graph-tasks

A curated collection of research papers exploring the utilization of LLMs for graph-related tasks.

yhLeeee
โญ 657 ๐Ÿ‘ค yhLeeee User ๐Ÿ• Updated 2025-03-21 ๐Ÿ“… Created 2023-11-17
โญ 654 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-03 ๐Ÿ“… Created 2024-05-01
166
bytedance/comfyui-lumi-batcher

ComfyUI Lumi Batcher is a batch processing extension plugin designed for ComfyUI, aiming to improve workflow debugging efficiency. Traditional debugging methods require adjusting parameters one by one, while this tool significantly enhances work efficiency through batch processing capabilities.

bytedance
โญ 651 TypeScript ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-10-10 ๐Ÿ“… Created 2025-05-29
167
Alpha-VLLM/Lumina-mGPT

Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining"

Alpha-VLLM
โญ 648 Python ๐Ÿ‘ค Alpha-VLLM Organization ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2024-08-02
โญ 647 Python ๐Ÿ‘ค Visual-Agent Organization ๐Ÿ• Updated 2026-02-26 ๐Ÿ“… Created 2025-10-31
169
CY-CHENYUE/ComfyUI-Janus-Pro

ComfyUI nodes for Janus-Pro, a unified multimodal understanding and generation framework.

CY-CHENYUE
โญ 647 Python ๐Ÿ‘ค CY-CHENYUE User ๐Ÿ• Updated 2025-01-30 ๐Ÿ“… Created 2025-01-27
170
mit-han-lab/hart

HART: Efficient Visual Generation with Hybrid Autoregressive Transformer

mit-han-lab
โญ 647 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2024-10-16 ๐Ÿ“… Created 2024-10-08
171
SpursGoZmy/Awesome-Tabular-LLMs

We collect papers about "large language models (LLM) for table-related tasks", e.g., using LLM for Table QA task. โ€œTable + LLMโ€ related papers compilation

SpursGoZmy
โญ 640 ๐Ÿ‘ค SpursGoZmy User ๐Ÿ• Updated 2026-04-09 ๐Ÿ“… Created 2023-06-28
โญ 637 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2024-02-15 ๐Ÿ“… Created 2023-12-12
173
PromtEngineer/localGPT-Vision

Chat with your documents using Vision Language Models. This repo implements an End to End RAG pipeline with both local and proprietary VLMs

PromtEngineer
โญ 633 Python ๐Ÿ‘ค PromtEngineer User ๐Ÿ• Updated 2025-07-26 ๐Ÿ“… Created 2024-10-01
174
iSEE-Laboratory/LLMDet

(CVPR 2025 highlightโœจ) Official repository of paper "LLMDet: Learning Strong Open-Vocabulary Object Detectors under the Supervision of Large Language Models"

iSEE-Laboratory
โญ 628 Python ๐Ÿ‘ค iSEE-Laboratory Organization ๐Ÿ• Updated 2026-02-04 ๐Ÿ“… Created 2025-01-30
175
Ucas-HaoranWei/Vary-toy

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)

Ucas-HaoranWei
โญ 626 Python ๐Ÿ‘ค Ucas-HaoranWei User ๐Ÿ• Updated 2024-12-30 ๐Ÿ“… Created 2024-01-10
176
microsoft/CLAP

Learning audio concepts from natural language supervision

microsoft
โญ 625 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-09-18 ๐Ÿ“… Created 2022-11-02
177
vb000/LookOnceToHear

A novel human-interaction method for real-time speech extraction on headphones.

vb000
โญ 615 Python ๐Ÿ‘ค vb000 User ๐Ÿ• Updated 2026-07-22 ๐Ÿ“… Created 2024-05-10
178
thu-coai/Glyph

Official Repository for "Glyph: Scaling Context Windows via Visual-Text Compression"

thu-coai
โญ 612 Python ๐Ÿ‘ค thu-coai Organization ๐Ÿ• Updated 2025-11-04 ๐Ÿ“… Created 2025-10-20
180
levyflux/AViD

Framework that enables fine-tuning of vision-language grounding models on custom datasets

levyflux
โญ 608 Python ๐Ÿ‘ค levyflux User ๐Ÿ• Updated 2026-08-30 ๐Ÿ“… Created 2025-03-19
181
yushangxiao/claude2api

Convert Claude's web service to an API service, supporting image recognition, file upload, thought output...

yushangxiao
โญ 606 Go ๐Ÿ‘ค yushangxiao User ๐Ÿ• Updated 2025-07-01 ๐Ÿ“… Created 2025-03-25
โญ 604 Jupyter Notebook ๐Ÿ‘ค generative-ai-on-aws Organization ๐Ÿ• Updated 2024-10-09 ๐Ÿ“… Created 2023-08-24
184
hkproj/pytorch-paligemma

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation: https://www.youtube.com/watch?v=vAmKB7iPkWw

hkproj
โญ 579 Python ๐Ÿ‘ค hkproj User ๐Ÿ• Updated 2024-12-06 ๐Ÿ“… Created 2024-07-13
โญ 570 Python ๐Ÿ‘ค erwold User ๐Ÿ• Updated 2024-11-26 ๐Ÿ“… Created 2024-11-25
186
fufankeji/DeepSeek-OCR-Web

Out-of-the-box DeepSeek OCR document parsing Web Studio

fufankeji
โญ 568 TypeScript ๐Ÿ‘ค fufankeji User ๐Ÿ• Updated 2025-10-27 ๐Ÿ“… Created 2025-10-23
187
unconv/gpt4v-browsing

Web Scraping with GPT-4 Vision API and Puppeteer

unconv
โญ 563 JavaScript ๐Ÿ‘ค unconv User ๐Ÿ• Updated 2024-01-31 ๐Ÿ“… Created 2023-11-24
189
luogen1996/LaVIN

[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"

luogen1996
โญ 525 Python ๐Ÿ‘ค luogen1996 User ๐Ÿ• Updated 2024-01-27 ๐Ÿ“… Created 2023-05-15
190
SmartFlowAI/Llama3-Tutorial

Llama3-Tutorial (XTuner, LMDeploy, OpenCompass)

SmartFlowAI
โญ 511 Python ๐Ÿ‘ค SmartFlowAI Organization ๐Ÿ• Updated 2024-05-10 ๐Ÿ“… Created 2024-04-19