Git Stars Git Stars

#model-inference Repositories

Discover 11 active open source GitHub repositories tagged with #model-inference, accumulating 164,137 total stars (averaging 14,921 stars per project). Leading this topic is meta-llama/llama with 59,437 stars.

11
Total Repositories
164,137
Total Stars
14,921
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook C++
1
meta-llama/llama

Inference code for Llama models

meta-llama
โญ 59,437 Python ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2025-01-26 ๐Ÿ“… Created 2023-02-14
2
xai-org/grok-1

Grok open release

xai-org
โญ 50,567 Python ๐Ÿ‘ค xai-org Organization ๐Ÿ• Updated 2024-08-30 ๐Ÿ“… Created 2024-03-17
3
meta-llama/llama3

The official Meta Llama 3 GitHub site

meta-llama
โญ 29,268 Python ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2025-01-26 ๐Ÿ“… Created 2024-03-15
4
bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentoml
โญ 12,610 Python ๐Ÿ‘ค bentoml Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-04-19
โญ 3,007 Python ๐Ÿ‘ค google-research Organization ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2021-11-01
6
BBuf/tvm_mlir_learn

Compiler learning resources collect.

BBuf
โญ 2,791 Python ๐Ÿ‘ค BBuf User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2021-03-16
7
OmniSVG/OmniSVG

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

OmniSVG
โญ 2,666 Python ๐Ÿ‘ค OmniSVG User ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2025-04-07
8
allenai/Olmo-core

PyTorch building blocks for the OLMo ecosystem

allenai
โญ 1,810 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-03-23
9
ibm-granite/granite-tsfm

Foundation Models for Time Series

ibm-granite
โญ 923 Jupyter Notebook ๐Ÿ‘ค ibm-granite Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-02-27
10
llumnix-project/llumnix-ray

Efficient and easy multi-instance LLM serving

llumnix-project
โญ 561 Python ๐Ÿ‘ค llumnix-project Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2024-05-20
11
skeskinen/bert.cpp

ggml implementation of BERT

skeskinen
โญ 500 C++ ๐Ÿ‘ค skeskinen User ๐Ÿ• Updated 2024-02-23 ๐Ÿ“… Created 2023-04-26

Frequently Asked Questions

1

What is the most popular #model-inference repository on GitHub?

The top ranked open source #model-inference project on GitHub is meta-llama/llama with 59,437 stars. Inference code for Llama models

2

Which programming languages are most used in #model-inference repositories?

Among the top ranked #model-inference projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++.

3

How is the #model-inference repository ranking calculated?

We track 11 active open source repositories tagged with #model-inference (500+ stars), totaling 164,137 stars with an average of 14,921 stars per repository. Rankings update daily from the GitHub API.