#llm-inference-optimization Repositories
Discover 18 active open source GitHub repositories tagged with #llm-inference-optimization, accumulating 44,885 total stars (averaging 2,493 stars per project). Leading this topic is guidance-ai/guidance with 21,828 stars.
18 repositories total
A curated list of 100+ libraries and frameworks for AI engineers building with LLMs
This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.
The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".
Fast inference from large language models via speculative decoding
Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.
RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
Official Repository for "Glyph: Scaling Context Windows via Visual-Text Compression"
Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.
Frequently Asked Questions
What is the most popular #llm-inference-optimization repository on GitHub?
The top ranked open source #llm-inference-optimization project on GitHub is guidance-ai/guidance with 21,828 stars. A guidance language for controlling large language models.
Which programming languages are most used in #llm-inference-optimization repositories?
Among the top ranked #llm-inference-optimization projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript.
How is the #llm-inference-optimization repository ranking calculated?
We track 18 active open source repositories tagged with #llm-inference-optimization (500+ stars), totaling 44,885 stars with an average of 2,493 stars per repository. Rankings update daily from the GitHub API.