#multi-modal-ai Repositories
Discover 37 active open source GitHub repositories tagged with #multi-modal-ai, accumulating 152,489 total stars (averaging 4,121 stars per project). Leading this topic is Lordog/dive-into-llms with 55,949 stars.
37 repositories total
"Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series
[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"
A multimodal, multimodel general-purpose global almighty AI query generation desktop floating assistant application
This project is a collection of dsl workflow scripts implemented based on the dify open-source project.
VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.
Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2
A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
Fogsight is an AI agent and animation engine powered by Large Language Models.
RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation
An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.
Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
A Python package that makes it easy for developers to create AI apps powered by various AI providers.
A web application for chatting with AI characters that anyone can easily set up and deploy.
Build AI applications that can see, hear, and speak using your screens, microphones, and cameras as inputs.
GigaModels: A Comprehensive Repository and Platform for Multi-modal, Generative, and Perceptual Models
An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
[EMNLP 2025] ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents
[NeurIPS 2023] Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models
The successful integration of Qwen3-VL-Instruct series into the ComfyUI platform has enabled a smooth operation, supporting (but not limited to) text-based queries, video queries, single-image queries, and multi-image queries for generating captions or responses.
Frequently Asked Questions
What is the most popular #multi-modal-ai repository on GitHub?
The top ranked open source #multi-modal-ai project on GitHub is Lordog/dive-into-llms with 55,949 stars. "Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series
Which programming languages are most used in #multi-modal-ai repositories?
Among the top ranked #multi-modal-ai projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, JavaScript.
How is the #multi-modal-ai repository ranking calculated?
We track 37 active open source repositories tagged with #multi-modal-ai (500+ stars), totaling 152,489 stars with an average of 4,121 stars per repository. Rankings update daily from the GitHub API.