#llama Repositories
225 repositories total
Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
A Deep Learning NLP repository that summarizes text preprocessing, Topic Models, and downstream tasks of state-of-the-art models such as BERT, GPT, and LLMs using TensorFlow.
Train and Infer Powerful Sentence Embeddings with AnglE | ๐ฅ SOTA on STS and MTEB Leaderboard
[ICLR 2026] A Framework for LLM-based Multi-Agent Reinforced Training and Inference
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
Open Model Engine (OME) โ Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.
A Reactive CLI that generates commit messages for Git and Jujutsu with Ollama, ChatGPT, Gemini, Claude, Mistral and other AI
RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
A high-performance inference system for large language models, designed for production environments.
๐๐๐ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.