Git Stars Git Stars

#llama Repositories

225
Total Repositories
1.6M
Total Stars
7,102
Avg Stars/Repo
201
andrewkchan/yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

andrewkchan
โญ 597 C++ ๐Ÿ‘ค andrewkchan User ๐Ÿ• Updated 2025-09-13 ๐Ÿ“… Created 2024-10-02
202
ai-ng/swift

Fast voice assistant powered by Groq, Cartesia, and Vercel.

ai-ng
โญ 590 TypeScript ๐Ÿ‘ค ai-ng Organization ๐Ÿ• Updated 2025-12-04 ๐Ÿ“… Created 2024-05-19
203
FoundationVision/Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

FoundationVision
โญ 582 Python ๐Ÿ‘ค FoundationVision Organization ๐Ÿ• Updated 2024-06-07 ๐Ÿ“… Created 2024-04-21
204
likenneth/honest_llama

Inference-Time Intervention: Eliciting Truthful Answers from a Language Model

likenneth
โญ 581 Python ๐Ÿ‘ค likenneth User ๐Ÿ• Updated 2025-01-28 ๐Ÿ“… Created 2023-05-19
205
ukairia777/tensorflow-nlp-tutorial

A Deep Learning NLP repository that summarizes text preprocessing, Topic Models, and downstream tasks of state-of-the-art models such as BERT, GPT, and LLMs using TensorFlow.

ukairia777
โญ 580 Jupyter Notebook ๐Ÿ‘ค ukairia777 User ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2021-12-30
206
SeanLee97/AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | ๐Ÿ”ฅ SOTA on STS and MTEB Leaderboard

SeanLee97
โญ 576 Python ๐Ÿ‘ค SeanLee97 User ๐Ÿ• Updated 2026-03-22 ๐Ÿ“… Created 2023-10-17
207
TsinghuaC3I/MARTI

[ICLR 2026] A Framework for LLM-based Multi-Agent Reinforced Training and Inference

TsinghuaC3I
โญ 575 Python ๐Ÿ‘ค TsinghuaC3I Organization ๐Ÿ• Updated 2026-08-20 ๐Ÿ“… Created 2025-05-10
208
ictnlp/LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

ictnlp
โญ 575 Python ๐Ÿ‘ค ictnlp Organization ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2025-01-07
209
GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

GURPREETKAURJETHRA
โญ 570 ๐Ÿ‘ค GURPREETKAURJETHRA User ๐Ÿ• Updated 2025-01-24 ๐Ÿ“… Created 2024-03-21
210
xNul/code-llama-for-vscode

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

xNul
โญ 569 Python ๐Ÿ‘ค xNul User ๐Ÿ• Updated 2024-07-31 ๐Ÿ“… Created 2023-08-25
211
kaarthik108/snowChat

Chat snowflake - Text to SQL

kaarthik108
โญ 553 Python ๐Ÿ‘ค kaarthik108 User ๐Ÿ• Updated 2025-02-16 ๐Ÿ“… Created 2023-04-10
212
Noeda/rllama

Rust+OpenCL+AVX2 implementation of LLaMA inference code

Noeda
โญ 551 Rust ๐Ÿ‘ค Noeda User ๐Ÿ• Updated 2024-02-12 ๐Ÿ“… Created 2023-03-11
213
kaito-project/aikit

๐Ÿ—๏ธ Fine-tune, build, and deploy open-source LLMs easily!

kaito-project
โญ 545 Go ๐Ÿ‘ค kaito-project Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-09-20
214
microsoft/sarathi-serve

A low-latency & high-throughput serving engine for LLMs

microsoft
โญ 539 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-11-02
215
DachengLi1/LongChat

Official repository for LongChat and LongEval

DachengLi1
โญ 533 Python ๐Ÿ‘ค DachengLi1 User ๐Ÿ• Updated 2024-05-24 ๐Ÿ“… Created 2023-04-21
216
ome-projects/ome

Open Model Engine (OME) โ€” Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

ome-projects
โญ 529 Go ๐Ÿ‘ค ome-projects Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-19
217
nrl-ai/llama-assistant

AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.

nrl-ai
โญ 529 Python ๐Ÿ‘ค nrl-ai Organization ๐Ÿ• Updated 2025-12-06 ๐Ÿ“… Created 2024-09-26
218
tak-bro/aicommit2

A Reactive CLI that generates commit messages for Git and Jujutsu with Ollama, ChatGPT, Gemini, Claude, Mistral and other AI

tak-bro
โญ 529 TypeScript ๐Ÿ‘ค tak-bro User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2024-01-30
219
apocas/restai

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

apocas
โญ 520 Python ๐Ÿ‘ค apocas User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-05-18
220
TencentARC/LLaMA-Pro

[ACL 2024] Progressive LLaMA with Block Expansion.

TencentARC
โญ 514 Python ๐Ÿ‘ค TencentARC Organization ๐Ÿ• Updated 2024-05-20 ๐Ÿ“… Created 2024-01-02
221
princeton-nlp/LESS

[ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning

princeton-nlp
โญ 511 Jupyter Notebook ๐Ÿ‘ค princeton-nlp Organization ๐Ÿ• Updated 2024-10-20 ๐Ÿ“… Created 2024-01-24
222
toverainc/willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

toverainc
โญ 511 Python ๐Ÿ‘ค toverainc Organization ๐Ÿ• Updated 2026-02-12 ๐Ÿ“… Created 2023-02-03
223
DonTizi/ReMind

Your Local Artificial Memory on your Device.

DonTizi
โญ 507 TypeScript ๐Ÿ‘ค DonTizi User ๐Ÿ• Updated 2024-12-26 ๐Ÿ“… Created 2024-05-22
224
vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

vectorch-ai
โญ 502 C++ ๐Ÿ‘ค vectorch-ai Organization ๐Ÿ• Updated 2025-12-19 ๐Ÿ“… Created 2023-07-24
225
coderonion/awesome-cuda-and-hpc

๐Ÿš€๐Ÿš€๐Ÿš€ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

coderonion
โญ 502 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-08-02 ๐Ÿ“… Created 2023-02-23