#large-multimodal-models Repositories
Discover 18 active open source GitHub repositories tagged with #large-multimodal-models, accumulating 46,681 total stars (averaging 2,593 stars per project). Leading this topic is chiphuyen/aie-book with 18,372 stars.
18 repositories total
[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)
โจโจ[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
[ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioning
Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.
[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"
Code for "WebVoyager: WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models"
A collection of resources on applications of multi-modal learning in medical imaging.
Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.
LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
Frequently Asked Questions
What is the most popular #large-multimodal-models repository on GitHub?
The top ranked open source #large-multimodal-models project on GitHub is chiphuyen/aie-book with 18,372 stars. [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)
Which programming languages are most used in #large-multimodal-models repositories?
Among the top ranked #large-multimodal-models projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Markdown.
How is the #large-multimodal-models repository ranking calculated?
We track 18 active open source repositories tagged with #large-multimodal-models (500+ stars), totaling 46,681 stars with an average of 2,593 stars per repository. Rankings update daily from the GitHub API.