Git Stars Git Stars

#multi-modality Repositories

Discover 12 active open source GitHub repositories tagged with #multi-modality, accumulating 70,749 total stars (averaging 5,895 stars per project). Leading this topic is haotian-liu/LLaVA with 24,232 stars.

12
Total Repositories
70,749
Total Stars
5,895
Avg Stars/Repo
Programming Languages: Python C++
1
haotian-liu/LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

haotian-liu
โญ 24,232 Python ๐Ÿ‘ค haotian-liu User ๐Ÿ• Updated 2024-08-12 ๐Ÿ“… Created 2023-04-17
2
BradyFU/Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

BradyFU
โญ 18,090 ๐Ÿ‘ค BradyFU User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-05-19
3
jina-ai/clip-as-service

๐Ÿ„ Scalable embedding, reasoning, ranking for images and sentences with CLIP

jina-ai
โญ 12,797 Python ๐Ÿ‘ค jina-ai Organization ๐Ÿ• Updated 2024-01-23 ๐Ÿ“… Created 2018-11-12
4
OpenMOSS/MOSS-TTS-Nano

A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation

OpenMOSS
โญ 4,711 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2026-04-10
5
EvolvingLMMs-Lab/Otter

Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

EvolvingLMMs-Lab
โญ 3,283 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2024-03-05 ๐Ÿ“… Created 2023-04-01
6
InternLM/InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM
โญ 2,925 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2023-09-26
7
DLR-RM/3DObjectTracking

Algorithms and Publications on 3D Object Tracking

DLR-RM
โญ 1,026 C++ ๐Ÿ‘ค DLR-RM Organization ๐Ÿ• Updated 2025-08-25 ๐Ÿ“… Created 2020-09-21
8
OpenBMB/VisRAG

Parsing-free RAG supported by VLMs

OpenBMB
โญ 991 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2024-10-14
9
yzhang2016/video-generation-survey

A reading list of video generation

yzhang2016
โญ 732 ๐Ÿ‘ค yzhang2016 User ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2022-11-16
10
NVlabs/Long-RL

Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)

NVlabs
โญ 729 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2025-09-24 ๐Ÿ“… Created 2025-07-08
11
LSXI7/MINIMA

[CVPR 2025] MINIMA: Modality Invariant Image Matching

LSXI7
โญ 682 Python ๐Ÿ‘ค LSXI7 User ๐Ÿ• Updated 2025-10-09 ๐Ÿ“… Created 2024-12-17
12
OpenGVLab/Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

OpenGVLab
โญ 553 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2024-04-21 ๐Ÿ“… Created 2023-05-10

Frequently Asked Questions

1

What is the most popular #multi-modality repository on GitHub?

The top ranked open source #multi-modality project on GitHub is haotian-liu/LLaVA with 24,232 stars. [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

2

Which programming languages are most used in #multi-modality repositories?

Among the top ranked #multi-modality projects on GitHub, the most common programming languages are Python, C++.

3

How is the #multi-modality repository ranking calculated?

We track 12 active open source repositories tagged with #multi-modality (500+ stars), totaling 70,749 stars with an average of 5,895 stars per repository. Rankings update daily from the GitHub API.