Git Stars Git Stars

#ai-inference Repositories

Discover 23 active open source GitHub repositories tagged with #ai-inference, accumulating 85,627 total stars (averaging 3,722 stars per project). Leading this topic is black-forest-labs/flux with 25,832 stars.

23
Total Repositories
85,627
Total Stars
3,722
Avg Stars/Repo
1
black-forest-labs/flux

Official inference repo for FLUX.1 models

black-forest-labs
โญ 25,832 Python ๐Ÿ‘ค black-forest-labs Organization ๐Ÿ• Updated 2025-07-31 ๐Ÿ“… Created 2024-08-01
2
Dao-AILab/flash-attention

Fast and memory-efficient exact attention

Dao-AILab
โญ 25,330 Python ๐Ÿ‘ค Dao-AILab Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-05-19
3
bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

bentoml
โญ 8,944 Python ๐Ÿ‘ค bentoml Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2019-04-02
4
AnswerDotAI/llms-txt

The /llms.txt file, helping language models use your website

AnswerDotAI
โญ 2,697 Jupyter Notebook ๐Ÿ‘ค AnswerDotAI Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2024-09-01
โญ 2,230 Python ๐Ÿ‘ค XLabs-AI Organization ๐Ÿ• Updated 2024-11-08 ๐Ÿ“… Created 2024-08-05
โญ 1,821 Python ๐Ÿ‘ค cubiq User ๐Ÿ• Updated 2025-04-14 ๐Ÿ“… Created 2024-01-27
7
Xilinx/Vitis-AI

Vitis AI is Xilinxโ€™s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Xilinx
โญ 1,814 Python ๐Ÿ‘ค Xilinx Organization ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2019-10-16
โญ 1,776 Python ๐Ÿ‘ค airockchip User ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2024-03-14
โญ 1,503 Jupyter Notebook ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-04-27 ๐Ÿ“… Created 2024-03-02
10
sdcb/PaddleSharp

.NET/C# binding for Baidu paddle inference library and PaddleOCR

sdcb
โญ 1,458 C# ๐Ÿ‘ค sdcb User ๐Ÿ• Updated 2026-08-30 ๐Ÿ“… Created 2021-12-16
11
ifindev/fullstack-next-cloudflare

๐Ÿš€ Full-stack Next.js 15 + Cloudflare Workers template with D1 database, R2 storage, Better Auth, and Server Actions. Production-ready with automated CI/CD and generous free tiers.

ifindev
โญ 1,424 TypeScript ๐Ÿ‘ค ifindev User ๐Ÿ• Updated 2025-12-08 ๐Ÿ“… Created 2025-09-12
12
uxlfoundation/scikit-learn-intelex

Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

uxlfoundation
โญ 1,357 Python ๐Ÿ‘ค uxlfoundation Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-08-07
13
DAMO-NLP-SG/VideoLLaMA3

Frontier Multimodal Foundation Models for Image and Video Understanding

DAMO-NLP-SG
โญ 1,174 Jupyter Notebook ๐Ÿ‘ค DAMO-NLP-SG Organization ๐Ÿ• Updated 2025-08-14 ๐Ÿ“… Created 2025-01-19
14
Acly/krita-vision-tools

Krita plugin which adds selection tools to mask objects with a single click, or by drawing a bounding box.

Acly
โญ 1,006 C++ ๐Ÿ‘ค Acly User ๐Ÿ• Updated 2026-06-04 ๐Ÿ“… Created 2023-08-01
โญ 930 C++ ๐Ÿ‘ค TelegramMessenger Organization ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2025-11-30
16
amd/RyzenAI-SW

AMD Ryzenโ„ข AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzenโ„ข AI powered PCs.

amd
โญ 902 Python ๐Ÿ‘ค amd Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-05-12
17
likelovewant/ROCmLibs-for-gfx1103-AMD780M-APU

ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.

likelovewant
โญ 901 ๐Ÿ‘ค likelovewant User ๐Ÿ• Updated 2026-05-18 ๐Ÿ“… Created 2024-03-08
18
RiseInRose/MiniGPT-4-ZH

MiniGPT-4 Chinese Deployment Translation Refine deployment details

RiseInRose
โญ 859 Python ๐Ÿ‘ค RiseInRose User ๐Ÿ• Updated 2026-05-09 ๐Ÿ“… Created 2023-04-19
19
mustafaaljadery/lightning-whisper-mlx

An extremely fast implementation of whisper optimized for Apple Silicon using MLX.

mustafaaljadery
โญ 835 Python ๐Ÿ‘ค mustafaaljadery User ๐Ÿ• Updated 2024-05-08 ๐Ÿ“… Created 2024-03-23
20
intel/openvino-ai-plugins-gimp

GIMP AI plugins with OpenVINO Backend

intel
โญ 810 Python ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2023-02-08
21
DAVIAN-Robotics/EgoX

Code for EgoX: Egocentric Video Generation from a Single Exocentric Video

DAVIAN-Robotics
โญ 769 Python ๐Ÿ‘ค DAVIAN-Robotics Organization ๐Ÿ• Updated 2026-07-10 ๐Ÿ“… Created 2025-12-09
22
uxlfoundation/oneDAL

oneAPI Data Analytics Library (oneDAL)

uxlfoundation
โญ 654 C++ ๐Ÿ‘ค uxlfoundation Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-03-28
23
tmplink/nsfw_detector

Solution for checking file if contain NSFW content.

tmplink
โญ 615 Python ๐Ÿ‘ค tmplink User ๐Ÿ• Updated 2026-01-30 ๐Ÿ“… Created 2024-11-13

Frequently Asked Questions

1

What is the most popular #ai-inference repository on GitHub?

The top ranked open source #ai-inference project on GitHub is black-forest-labs/flux with 25,832 stars. Official inference repo for FLUX.1 models

2

Which programming languages are most used in #ai-inference repositories?

Among the top ranked #ai-inference projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, C#.

3

How is the #ai-inference repository ranking calculated?

We track 23 active open source repositories tagged with #ai-inference (500+ stars), totaling 85,627 stars with an average of 3,722 stars per repository. Rankings update daily from the GitHub API.