#multimodal-ai Repositories
Discover 191 active open source GitHub repositories tagged with #multimodal-ai, accumulating 589,873 total stars (averaging 3,088 stars per project). Leading this topic is anthropics/claude-cookbooks with 54,935 stars.
191 repositories total
A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
๐ Truly open-source AI avatar(digital human) toolkit for offline video generation and digital human cloning.
Foundational Models for State-of-the-Art Speech and Text Translation
Qwen-Image is a powerful image generation foundation model capable of complex text rendering and precise image editing.
The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.
Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows.
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding
OmniGen2: Exploration to Advanced Multimodal Generation. https://arxiv.org/abs/2506.18871
Google Gen AI Python SDK provides an interface for developers to integrate Google's generative models into their Python applications.
Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.
Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)
Nano Banana(nanobanana),GPT-5(GPT5),GPT-4o(GPT4o) Image Prompts๏ผNanobanana Prompts๏ผnanobanana prompts
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
The repository provides code for running inference with the Meta Segment Anything Audio Model (SAM-Audio), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
My ultimate collection of nano-banana creative gameplay! Constantly updating!
Digital Avatar Conversational System - Linly-Talker. ๐โจ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. ๐ค๐ค It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. ๐๐ฌ
๐ฅ๐ฅ๐ฅ [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook โ no data leaves your device. Mano-P is an open-source GUI-VLA project that supports local inference on Mac mini/MacBook or via compute stick, enabling purely vision-driven cross-platform GUI automation operations. Data is processed entirely locally, supporting planning and execution of complex multi-step tasks.
[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.
State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
Frequently Asked Questions
What is the most popular #multimodal-ai repository on GitHub?
The top ranked open source #multimodal-ai project on GitHub is anthropics/claude-cookbooks with 54,935 stars. A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.
Which programming languages are most used in #multimodal-ai repositories?
Among the top ranked #multimodal-ai projects on GitHub, the most common programming languages are Python, Jupyter Notebook, JavaScript, Kotlin.
How is the #multimodal-ai repository ranking calculated?
We track 191 active open source repositories tagged with #multimodal-ai (500+ stars), totaling 589,873 stars with an average of 3,088 stars per repository. Rankings update daily from the GitHub API.