#multimodal Repositories
183 repositories total
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
AI Manus is a general-purpose AI agent system that supports running various tools and operations in a sandbox environment.
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"
Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets
๐๏ธ + ๐ฌ + ๐ง = ๐ค Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models for generation and evaluation.
Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio, and screen activity into searchable, timestamped evidence, and proves work with deterministic contractsโnot model opinions. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
Create browser automation as if you were teaching a human using GPT-4 Vision.
Scene-aware storyboard for DeepSeek Harness: 9โ16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
The Self-Coding System for Your App โ Alan AI SDK for React Native
Real-time multimodal desktop agent evolving toward a persistent AI OS interface (0.17 ฮฑ).
Flame is an open-source multimodal AI system designed to translate UI design mockups into high-quality React code. It leverages vision-language modeling, automated data synthesis, and structured training workflows to bridge the gap between design and front-end development.
Official Code for OpenVLHarness: Real-World Visual Agentic Tool-Use with Multimodal Memory
Awesome Multimodal Modeling [Covers MLLM, UMM, and NMM]
Official implementation for "Break-A-Scene: Extracting Multiple Concepts from a Single Image" [SIGGRAPH Asia 2023]
Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"