#vision-language Repositories
Discover 20 active open source GitHub repositories tagged with #vision-language, accumulating 40,771 total stars (averaging 2,038 stars per project). Leading this topic is IDEA-Research/GroundingDINO with 9,509 stars.
20 repositories total
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
[ACL 2024 ๐ฅ] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
๐ฅ๐ฅ LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.
[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.
๐ Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
Frequently Asked Questions
What is the most popular #vision-language repository on GitHub?
The top ranked open source #vision-language project on GitHub is IDEA-Research/GroundingDINO with 9,509 stars. [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
Which programming languages are most used in #vision-language repositories?
Among the top ranked #vision-language projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, HTML.
How is the #vision-language repository ranking calculated?
We track 20 active open source repositories tagged with #vision-language (500+ stars), totaling 40,771 stars with an average of 2,038 stars per repository. Rankings update daily from the GitHub API.