#multimodal-learning Repositories
Discover 35 active open source GitHub repositories tagged with #multimodal-learning, accumulating 63,371 total stars (averaging 1,810 stars per project). Leading this topic is apple-aiml-research/ml-ferret with 8,646 stars.
35 repositories total
Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.
Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
A collection of resources on applications of multi-modal learning in medical imaging.
ICCV 2023-2025 Papers: Discover cutting-edge research from ICCV 2023-25, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. โญ support visual intelligence development!
SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.
[CVPR 2023 Highlight & IJCV 2026] GRES: Generalized Referring Expression Segmentation
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
A curated list of awesome vision and language resources (still under construction... stay tuned!)
ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!
[ICCV 2023 & TPAMI 2025] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions
tracking papers, datasets, and models of "large language model (LLM) for time series"
Frequently Asked Questions
What is the most popular #multimodal-learning repository on GitHub?
The top ranked open source #multimodal-learning project on GitHub is apple-aiml-research/ml-ferret with 8,646 stars.
Which programming languages are most used in #multimodal-learning repositories?
Among the top ranked #multimodal-learning projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, HTML.
How is the #multimodal-learning repository ranking calculated?
We track 35 active open source repositories tagged with #multimodal-learning (500+ stars), totaling 63,371 stars with an average of 1,810 stars per repository. Rankings update daily from the GitHub API.