#mllm Repositories
Discover 39 active open source GitHub repositories tagged with #mllm, accumulating 95,941 total stars (averaging 2,460 stars per project). Leading this topic is microsoft/unilm with 22,247 stars.
39 repositories total
[NeurIPS 2025] SpatialLM: Training Large Language Models for Structured Indoor Modeling
[CVPR'25] Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System
Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
๐๐๐ A collection of some awesome public YOLO object detection series projects and the related object detection datasets.
Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)
Curated visual catalog of 200+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.
OpenEMMA, a permissively licensed open source "reproduction" of Waymoโs EMMA model.
[NeurIPS' 2025] JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent
[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"
[NeurIPS 2025] 4KAgent: Agentic Any Image to 4K Super-Resolution. An intelligent computer vision agent that can magically restore any image to perfect-4K!
[NeurIPS 2025 spotlight] Official implementation for "FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving"
๐๐๐A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.
This is a repository for listing papers on scene graph generation and application.
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
โจโจWoodpecker: Hallucination Correction for Multimodal Large Language Models
[ICLR 2025] FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning
[ICLR2026] Official implementation for "JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigation"
ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing
Official Code for OpenVLHarness: Real-World Visual Agentic Tool-Use with Multimodal Memory
๐ฅ๐ฅ๐ฅ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
A pure Rust-based inference engine for LLMs, VLMs, VLAs, TTS, and OCR, powered by Candle and Rust. An alternative to llama.cpp that's much simpler and cleaner.
[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;
Frequently Asked Questions
What is the most popular #mllm repository on GitHub?
The top ranked open source #mllm project on GitHub is microsoft/unilm with 22,247 stars. Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Which programming languages are most used in #mllm repositories?
Among the top ranked #mllm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Markdown, JavaScript.
How is the #mllm repository ranking calculated?
We track 39 active open source repositories tagged with #mllm (500+ stars), totaling 95,941 stars with an average of 2,460 stars per repository. Rankings update daily from the GitHub API.