#llama Repositories
225 repositories total
โก Pure-Rust WebGPU inference engine โ OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training a medical large model, which includes incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, GRPO.
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
"Big Model White-Box Construction Guide": A completely hand-built Tiny-Universe
Repo for BenCao [original name: HuaTuo (ๅ้ฉผ)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. BenCao (original name: HuaTuo) model repository, instruction fine-tuning of large language models based on Chinese medical knowledge
Only basic Python knowledge required, build large language models from scratch; Gradually build GLM4\Llama3\RWKV6 from scratch, deeply understand the principles of large models.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model โโ A Chinese low-resource llama+lora scheme, structure reference alpaca
Chinese NLP Solutions (Large Models, Data, Models, Training, Inference)
A C#/.NET library to run LLM (๐ฆLLaMA/LLaVA) on your local device efficiently.
A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.
Automatic question answering for local knowledge bases based on LLMs such as LangChain and ChatGLM-6B
InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (Online demo system supporting DragGAN, ChatGPT, ImageBind, SAM).
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Chinese-LLaMA 1&2, Chinese-Falcon base models; ChatFlow Chinese dialogue model; Chinese OpenLLaMA model; NLP pre-training/instruction fine-tuning datasets
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
Professional AI research tool for Zotero: chat with PDFs, search your entire library, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server. Chat with your pocket Zotero on iPhone โ https://www.docsagent.app
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
[EMNLP-2024] Build multimodal language agents for fast prototype and production
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. Unified backend API for open large language models
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG
A secure low code deception runtime framework, leveraging AI for System Virtualization.
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.
FinGLM: Committed to building an open, public welfare, and lasting financial large model project, utilizing open source and openness to promote "AI+Finance".
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
llama and other large language models on iOS and MacOS offline using GGML library.