#multimodal-ai Repositories
191 repositories total
This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).
Google Gen AI Go SDK provides an interface for developers to integrate Google's generative models into their Go applications.
Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
something like visual-chatgpt, the open-source version of Wenyiyan
An Open-Source Multimodal AIGC Solution based on ComfyUI + MCP + LLM https://pixelle.ai
AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI
[NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web" -- the first LLM-based web agent and benchmark for generalist web agents
The official starter kit for the Nano Banana Hackathon. Clone this repo to get building fast!
[TPAMI 2026] ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving
Xiaoyao Search: Understands your words, reads your images, finds any local file with AI. Making search as easy as chatting.
A pattern for an always on AI Assistant powered by Deepseek-V3, RealtimeSTT, and Typer for engineering
Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs
Deploy a Gemini multimodal chat website in 10 seconds, Severless! You only need to prepare a Gemini API Key, and you can deploy a Gemini multimodal chat website in 10 seconds.
Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
Recent LLM-based CV and related works. Welcome to comment/contribute!
[NeurIPS 2023] Official implementation of the paper "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset"
Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.
[Extended version ICLR 2025 Blog Track] Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"
An open-weight 11B model series for long-form and real-time video understanding
Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think & UnifiedReward-Flex
Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.
[No longer maintained] LLM API aggregation conversation tool. Original project repository: https://github.com/KouriChat/KouriChat This project was modified and created by iwyxdxl based on the original project. For learning purposes only, please comply with regulations, do not connect to public platforms or use in any production activities.
๐ฌ A proposal for a web API for prompting browser-provided language models
MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning
[ICCV 2023] Official implementation of the paper "A Simple Framework for Open-Vocabulary Segmentation and Detection"
The nodes detached from [ComfyUI Layer Style](https://github.com/chflame163/ComfyUI_LayerStyle) are mainly those with complex requirements for dependency packages.