Git Stars Git Stars

#multimodal-deep-learning Repositories

Discover 17 active open source GitHub repositories tagged with #multimodal-deep-learning, accumulating 40,916 total stars (averaging 2,406 stars per project). Leading this topic is salesforce/LAVIS with 11,265 stars.

17
Total Repositories
40,916
Total Stars
2,406
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook C++
1
salesforce/LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce
โญ 11,265 Jupyter Notebook ๐Ÿ‘ค salesforce Organization ๐Ÿ• Updated 2026-06-02 ๐Ÿ“… Created 2022-08-24
2
AI4Finance-Foundation/FinRobot

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

AI4Finance-Foundation
โญ 8,460 Python ๐Ÿ‘ค AI4Finance-Foundation Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2024-02-27
3
KimMeen/Time-LLM

[ICLR 2024] Official implementation of " ๐Ÿฆ™ Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

KimMeen
โญ 2,704 Python ๐Ÿ‘ค KimMeen User ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2024-01-20
4
Yutong-Zhou-cv/Awesome-Text-to-Image

(เท†`๊’ณยดเท†) A Survey on Text-to-Image Generation/Synthesis.

Yutong-Zhou-cv
โญ 2,444 ๐Ÿ‘ค Yutong-Zhou-cv User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2020-10-13
โญ 2,223 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2025-12-16 ๐Ÿ“… Created 2025-05-26
6
kyegomez/BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

kyegomez
โญ 1,949 Python ๐Ÿ‘ค kyegomez User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-10-18
7
Ucas-HaoranWei/Vary

[ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.

Ucas-HaoranWei
โญ 1,888 Python ๐Ÿ‘ค Ucas-HaoranWei User ๐Ÿ• Updated 2024-12-30 ๐Ÿ“… Created 2023-12-07
8
AlibabaResearch/AdvancedLiterateMachinery

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

AlibabaResearch
โญ 1,832 C++ ๐Ÿ‘ค AlibabaResearch Organization ๐Ÿ• Updated 2026-03-17 ๐Ÿ“… Created 2022-09-28
9
jrzaurin/pytorch-widedeep

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch

jrzaurin
โญ 1,415 Python ๐Ÿ‘ค jrzaurin User ๐Ÿ• Updated 2026-04-30 ๐Ÿ“… Created 2017-10-21
10
DWCTOD/CVPR2024-Papers-with-Code-Demo

Collect the latest CVPR (Conference on Computer Vision and Pattern Recognition) results, including papers, code, and demo videos, etc., and welcome recommendations from everyone!

DWCTOD
โญ 1,405 ๐Ÿ‘ค DWCTOD User ๐Ÿ• Updated 2024-04-25 ๐Ÿ“… Created 2021-03-13
11
TheShadow29/awesome-grounding

awesome grounding: A curated list of research papers in visual grounding

TheShadow29
โญ 1,132 ๐Ÿ‘ค TheShadow29 User ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2018-09-03
12
richard-peng-xia/awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

richard-peng-xia
โญ 986 ๐Ÿ‘ค richard-peng-xia User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2022-07-13
14
RyanWangZf/MedCLIP

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts

RyanWangZf
โญ 652 Python ๐Ÿ‘ค RyanWangZf User ๐Ÿ• Updated 2024-04-12 ๐Ÿ“… Created 2022-02-19
15
omriav/blended-latent-diffusion

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

omriav
โญ 627 Jupyter Notebook ๐Ÿ‘ค omriav User ๐Ÿ• Updated 2024-06-04 ๐Ÿ“… Created 2022-06-06
16
MMMU-Benchmark/MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

MMMU-Benchmark
โญ 601 Python ๐Ÿ‘ค MMMU-Benchmark Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-11-23
17
remyxai/VQASynth

Compose multimodal datasets ๐ŸŽน

remyxai
โญ 594 Python ๐Ÿ‘ค remyxai Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-02-17

Frequently Asked Questions

1

What is the most popular #multimodal-deep-learning repository on GitHub?

The top ranked open source #multimodal-deep-learning project on GitHub is salesforce/LAVIS with 11,265 stars. LAVIS - A One-stop Library for Language-Vision Intelligence

2

Which programming languages are most used in #multimodal-deep-learning repositories?

Among the top ranked #multimodal-deep-learning projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++.

3

How is the #multimodal-deep-learning repository ranking calculated?

We track 17 active open source repositories tagged with #multimodal-deep-learning (500+ stars), totaling 40,916 stars with an average of 2,406 stars per repository. Rankings update daily from the GitHub API.