#multi-modality Repositories
Discover 12 active open source GitHub repositories tagged with #multi-modality, accumulating 70,749 total stars (averaging 5,895 stars per project). Leading this topic is haotian-liu/LLaVA with 24,232 stars.
12 repositories total
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
๐ Scalable embedding, reasoning, ranking for images and sentences with CLIP
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!
Frequently Asked Questions
What is the most popular #multi-modality repository on GitHub?
The top ranked open source #multi-modality project on GitHub is haotian-liu/LLaVA with 24,232 stars. [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
Which programming languages are most used in #multi-modality repositories?
Among the top ranked #multi-modality projects on GitHub, the most common programming languages are Python, C++.
How is the #multi-modality repository ranking calculated?
We track 12 active open source repositories tagged with #multi-modality (500+ stars), totaling 70,749 stars with an average of 5,895 stars per repository. Rankings update daily from the GitHub API.