#multi-modal-learning Repositories
Discover 19 active open source GitHub repositories tagged with #multi-modal-learning, accumulating 41,270 total stars (averaging 2,172 stars per project). Leading this topic is mlfoundations/open_clip with 14,278 stars.
19 repositories total
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
This repository contains the official implementation of the research papers, "MobileCLIP" CVPR 2024 and "MobileCLIP2" TMLR August 2025
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning
[ECCV 2024] Official implementation of the paper "X-Pose: Detecting Any Keypoints"
A concise but complete implementation of CLIP with various experimental improvements from recent papers
BiomedParse: A Foundation Model for Joint Segmentation, Detection, and Recognition of Biomedical Objects Across Nine Modalities
BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks
[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI
VisionโLanguageโAction models for Autonomous Driving (VLA4AD) resources, serving as the companion repository to the survey paper โA Survey on VisionโLanguageโAction Models for Autonomous Drivingโ.
Frequently Asked Questions
What is the most popular #multi-modal-learning repository on GitHub?
The top ranked open source #multi-modal-learning project on GitHub is mlfoundations/open_clip with 14,278 stars. An open source implementation of CLIP.
Which programming languages are most used in #multi-modal-learning repositories?
Among the top ranked #multi-modal-learning projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Java.
How is the #multi-modal-learning repository ranking calculated?
We track 19 active open source repositories tagged with #multi-modal-learning (500+ stars), totaling 41,270 stars with an average of 2,172 stars per repository. Rankings update daily from the GitHub API.