Git Stars Git Stars

#machine-learning-inference Repositories

Discover 45 active open source GitHub repositories tagged with #machine-learning-inference, accumulating 127,779 total stars (averaging 2,839 stars per project). Leading this topic is tloen/alpaca-lora with 18,987 stars.

45
Total Repositories
127,779
Total Stars
2,839
Avg Stars/Repo
1
tloen/alpaca-lora

Instruct-tune LLaMA on consumer hardware

tloen
โญ 18,987 Jupyter Notebook ๐Ÿ‘ค tloen User ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-03-13
2
lllyasviel/FramePack

Lets make video diffusion practical!

lllyasviel
โญ 17,293 Python ๐Ÿ‘ค lllyasviel User ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2025-04-12
3
fauxpilot/fauxpilot

FauxPilot - an open-source alternative to GitHub Copilot server

fauxpilot
โญ 14,766 Python ๐Ÿ‘ค fauxpilot Organization ๐Ÿ• Updated 2024-04-09 ๐Ÿ“… Created 2022-08-03
4
facebookresearch/nougat

Implementation of Nougat Neural Optical Understanding for Academic Documents

facebookresearch
โญ 9,997 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-02-21 ๐Ÿ“… Created 2023-06-07
5
apple-aiml-research/ml-fastvlm

This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025

apple-aiml-research
โญ 7,445 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2025-05-01
6
Yuliang-Liu/MonkeyOCR

A lightweight LMM-based Document Parsing Model

Yuliang-Liu
โญ 6,653 Python ๐Ÿ‘ค Yuliang-Liu User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-06-03
7
facebookresearch/sapiens

High-resolution models for human tasks.

facebookresearch
โญ 5,442 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-05-26 ๐Ÿ“… Created 2024-08-13
8
AnswerDotAI/gpu.cpp

A lightweight library for portable low-level GPU computation using WebGPU.

AnswerDotAI
โญ 3,994 C++ ๐Ÿ‘ค AnswerDotAI Organization ๐Ÿ• Updated 2026-08-21 ๐Ÿ“… Created 2024-05-30
9
google/lyra

A Very Low-Bitrate Codec for Speech Compression

google
โญ 3,942 C++ ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2024-08-20 ๐Ÿ“… Created 2021-03-19
10
huggingface/swift-coreml-diffusers

Swift app demonstrating Core ML Stable Diffusion

huggingface
โญ 2,758 Swift ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2025-11-06 ๐Ÿ“… Created 2022-12-13
11
google-coral/coralnpu

A machine learning accelerator core designed for energy-efficient AI at the edge.

google-coral
โญ 2,715 Emacs Lisp ๐Ÿ‘ค google-coral Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-10-02
12
abi/secret-llama

Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

abi
โญ 2,673 TypeScript ๐Ÿ‘ค abi User ๐Ÿ• Updated 2024-06-05 ๐Ÿ“… Created 2024-04-30
13
intel/openvino-plugins-ai-audacity

A set of AI-enabled effects, generators, and analyzers for Audacityยฎ.

intel
โญ 2,163 C++ ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2023-09-06
14
docling-project/docling-serve

Running Docling as an API service

docling-project
โญ 1,930 Python ๐Ÿ‘ค docling-project Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-06
15
inference-labs-inc/inference-network

Proof of Inference - Trustless AI verification

inference-labs-inc
โญ 1,812 Solidity ๐Ÿ‘ค inference-labs-inc Organization ๐Ÿ• Updated 2025-12-11 ๐Ÿ“… Created 2024-05-03
16
microsoft/onnxruntime-inference-examples

Examples for using ONNX Runtime for machine learning inferencing.

microsoft
โญ 1,703 C++ ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2021-04-09
17
nomadkaraoke/python-audio-separator

Easy to use stem (e.g. instrumental/vocals) separation from CLI or as a python package, using a variety of amazing pre-trained models (primarily from UVR)

nomadkaraoke
โญ 1,503 Python ๐Ÿ‘ค nomadkaraoke Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-06-30
18
jbarrow/commonforms

CommonForms โ€” open models to auto-detect PDF form fields

jbarrow
โญ 1,309 Python ๐Ÿ‘ค jbarrow User ๐Ÿ• Updated 2026-06-17 ๐Ÿ“… Created 2025-09-17
19
sqliteai/sqlite-vector

SQLite-Vector is a cross-platform, ultra-efficient SQLite extension that brings vector search capabilities to your embedded database.

sqliteai
โญ 1,221 C ๐Ÿ‘ค sqliteai Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2025-04-07
20
corsix/amx

Apple AMX Instruction Set

corsix
โญ 1,178 C ๐Ÿ‘ค corsix User ๐Ÿ• Updated 2024-12-26 ๐Ÿ“… Created 2022-08-30
21
Text-to-Audio/AudioLCM

PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.

Text-to-Audio
โญ 1,162 Python ๐Ÿ‘ค Text-to-Audio User ๐Ÿ• Updated 2025-07-01 ๐Ÿ“… Created 2024-06-01
22
sdatkinson/NeuralAmpModelerCore

Core DSP library for NAM plugins

sdatkinson
โญ 1,013 C++ ๐Ÿ‘ค sdatkinson User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2023-03-18
23
senstella/parakeet-mlx

An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.

senstella
โญ 999 Python ๐Ÿ‘ค senstella User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-05-03
24
go-skynet/go-llama.cpp

LLama.cpp golang bindings

go-skynet
โญ 945 C++ ๐Ÿ‘ค go-skynet Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-04-03
25
fuxiao0719/GeoWizard

[ECCV'24] GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image

fuxiao0719
โญ 931 Python ๐Ÿ‘ค fuxiao0719 User ๐Ÿ• Updated 2024-12-07 ๐Ÿ“… Created 2024-03-16
26
matatonic/openedai-speech

An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.

matatonic
โญ 839 Python ๐Ÿ‘ค matatonic User ๐Ÿ• Updated 2025-02-02 ๐Ÿ“… Created 2023-11-27
โญ 818 Python ๐Ÿ‘ค DecartAI Organization ๐Ÿ• Updated 2026-10-05 ๐Ÿ“… Created 2025-09-17
28
google/emoji-scavenger-hunt

Emoji Scavenger Hunt is an experiment that leverages the power of neural networks and your phoneโ€™s camera to identify the real world versions of the emojis we use every day.

google
โญ 818 TypeScript ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2025-02-28 ๐Ÿ“… Created 2018-03-22
29
Nutlope/easyedit

The easiest way to edit images in one prompt

Nutlope
โญ 783 TypeScript ๐Ÿ‘ค Nutlope User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-05-28
30
huggingface/ratchet

A cross-platform browser ML framework.

huggingface
โญ 771 Rust ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2024-01-11
โญ 752 Python ๐Ÿ‘ค Open-Magic-Video Organization ๐Ÿ• Updated 2025-02-18 ๐Ÿ“… Created 2025-02-10
32
triton-inference-server/python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

triton-inference-server
โญ 684 C++ ๐Ÿ‘ค triton-inference-server Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2020-09-01
33
knights-analytics/hugot

Onnx transformer pipelines in Golang

knights-analytics
โญ 665 Go ๐Ÿ‘ค knights-analytics Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-01-31
34
Sxela
โญ 660 ๐Ÿ‘ค Sxela User ๐Ÿ• Updated 2024-08-30 ๐Ÿ“… Created 2021-12-05
35
clu0/unet.cu

UNet diffusion model in pure CUDA

clu0
โญ 658 Cuda ๐Ÿ‘ค clu0 User ๐Ÿ• Updated 2024-06-28 ๐Ÿ“… Created 2024-06-28
36
amd/xdna-driver

AMD XDNA Driver (amdxdna.ko) for Linux and XRT SHIM library

amd
โญ 625 C ๐Ÿ‘ค amd Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-01-25
โญ 625 Python ๐Ÿ‘ค RVC-Project Organization ๐Ÿ• Updated 2025-11-05 ๐Ÿ“… Created 2023-10-14
โญ 609 C# ๐Ÿ‘ค Unity-Technologies Organization ๐Ÿ• Updated 2025-02-13 ๐Ÿ“… Created 2019-07-22
39
ecmwf-lab/ai-models

Run AI-based weather forecasting models with ECMWF data

ecmwf-lab
โญ 606 Python ๐Ÿ‘ค ecmwf-lab Organization ๐Ÿ• Updated 2026-08-06 ๐Ÿ“… Created 2023-05-12
40
keijiro/UnityMLStableDiffusion

Core ML Stable Diffusion on Unity

keijiro
โญ 605 C# ๐Ÿ‘ค keijiro User ๐Ÿ• Updated 2024-09-21 ๐Ÿ“… Created 2023-03-20
41
NUS-HPC-AI-Lab/Enhance-A-Video

Enhance-A-Video: Better Generated Video for Free

NUS-HPC-AI-Lab
โญ 595 Python ๐Ÿ‘ค NUS-HPC-AI-Lab Organization ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2024-12-18
42
Gy920/segment-anything-2-real-time

Run Segment Anything Model 2 on a live video stream

Gy920
โญ 587 Jupyter Notebook ๐Ÿ‘ค Gy920 User ๐Ÿ• Updated 2025-06-03 ๐Ÿ“… Created 2024-08-01
43
pharmapsychotic/clip-interrogator-ext

Stable Diffusion WebUI extension for CLIP Interrogator

pharmapsychotic
โญ 537 Python ๐Ÿ‘ค pharmapsychotic User ๐Ÿ• Updated 2024-06-28 ๐Ÿ“… Created 2023-02-11
44
taku910/crfpp

CRF++: Yet Another CRF toolkit

taku910
โญ 512 Shell ๐Ÿ‘ค taku910 User ๐Ÿ• Updated 2025-02-22 ๐Ÿ“… Created 2015-03-14
45
kunzmi/managedCuda

ManagedCUDA aims an easy integration of NVidia's CUDA in .net applications written in C#, Visual Basic or any other .net language.

kunzmi
โญ 508 C# ๐Ÿ‘ค kunzmi User ๐Ÿ• Updated 2026-07-21 ๐Ÿ“… Created 2015-08-01

Frequently Asked Questions

1

What is the most popular #machine-learning-inference repository on GitHub?

The top ranked open source #machine-learning-inference project on GitHub is tloen/alpaca-lora with 18,987 stars. Instruct-tune LLaMA on consumer hardware

2

Which programming languages are most used in #machine-learning-inference repositories?

Among the top ranked #machine-learning-inference projects on GitHub, the most common programming languages are Python, C++, TypeScript, C.

3

How is the #machine-learning-inference repository ranking calculated?

We track 45 active open source repositories tagged with #machine-learning-inference (500+ stars), totaling 127,779 stars with an average of 2,839 stars per repository. Rankings update daily from the GitHub API.