Git Stars Git Stars

#transformer Repositories

Discover 208 active open source GitHub repositories tagged with #transformer, accumulating 1,197,728 total stars (averaging 5,758 stars per project). Leading this topic is huggingface/transformers with 169,339 stars.

208
Total Repositories
1.2M
Total Stars
5,758
Avg Stars/Repo
1
huggingface/transformers

๐Ÿค— Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

huggingface
โญ 169,339 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-10-29
2
vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-project
โญ 97,302 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-02-09
3
labmlai/annotated_deep_learning_paper_implementations

๐Ÿง‘โ€๐Ÿซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐Ÿ“; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ŸŽฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐Ÿง 

labmlai
โญ 67,780 Python ๐Ÿ‘ค labmlai Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2020-08-25
4
ggml-org/whisper.cpp

Port of OpenAI's Whisper model in C/C++

ggml-org
โญ 55,392 C++ ๐Ÿ‘ค ggml-org Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-09-25
5
p-e-w/heretic

Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more

p-e-w
โญ 42,437 Python ๐Ÿ‘ค p-e-w User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-09-21
6
sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-project
โญ 38,899 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-08
7
fishaudio/fish-speech

SOTA Open Source TTS

fishaudio
โญ 33,820 Python ๐Ÿ‘ค fishaudio Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2023-10-10
8
open-mmlab/mmdetection

OpenMMLab Detection Toolbox and Benchmark

open-mmlab
โญ 32,234 Python ๐Ÿ‘ค open-mmlab Organization ๐Ÿ• Updated 2024-08-21 ๐Ÿ“… Created 2018-08-22
9
SYSTRAN/faster-whisper

Faster Whisper transcription with CTranslate2

SYSTRAN
โญ 26,924 Python ๐Ÿ‘ค SYSTRAN Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2023-02-11
10
lukasmasuch/best-of-ml-python

A ranked list of awesome machine learning Python libraries. Updated weekly.

lukasmasuch
โญ 23,877 ๐Ÿ‘ค lukasmasuch User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2020-11-29
11
amusi/CVPR2026-Papers-with-Code

CVPR 2026 Papers and Open-Source Project Collection

amusi
โญ 22,969 ๐Ÿ‘ค amusi User ๐Ÿ• Updated 2026-03-08 ๐Ÿ“… Created 2020-02-26
12
nndl/nndl

Qiu Xipengโ€™s Neural Networks and Deep Learning, Second Edition and General Education Edition: E-book, Table of Contents, Learning Resources, and Errata

nndl
โญ 19,627 ๐Ÿ‘ค nndl Organization ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2016-09-06
13
FlashML-org/FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

FlashML-org
โญ 17,522 Python ๐Ÿ‘ค FlashML-org User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-20
14
datawhalechina/leedl-tutorial

ใ€ŠHung-yi Lee Deep Learning Tutorialใ€‹(Recommended by Professor Hung-yi Lee ๐Ÿ‘, Apple Books ๐ŸŽ), PDF Download Link: https://github.com/datawhalechina/leedl-tutorial/releases

datawhalechina
โญ 16,879 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2019-07-02
15
alibaba/MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

alibaba
โญ 16,589 C++ ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-04-15
โญ 16,519 Python ๐Ÿ‘ค GeeeekExplorer User ๐Ÿ• Updated 2026-04-26 ๐Ÿ“… Created 2025-06-09
17
lukas-blecher/LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.

lukas-blecher
โญ 16,430 Python ๐Ÿ‘ค lukas-blecher User ๐Ÿ• Updated 2025-01-18 ๐Ÿ“… Created 2020-12-11
18
graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

graykode
โญ 14,826 Jupyter Notebook ๐Ÿ‘ค graykode User ๐Ÿ• Updated 2024-02-21 ๐Ÿ“… Created 2019-01-09
19
BlinkDL/RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

BlinkDL
โญ 14,786 Python ๐Ÿ‘ค BlinkDL User ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2021-08-08
20
EleutherAI/lm-evaluation-harness

A framework for few-shot evaluation of language models.

EleutherAI
โญ 14,515 Python ๐Ÿ‘ค EleutherAI Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2020-08-28
21
cfug/dio

A powerful HTTP client for Dart and Flutter, which supports global settings, Interceptors, FormData, aborting and canceling a request, files uploading and downloading, requests timeout, custom adapters, etc.

cfug
โญ 12,843 Dart ๐Ÿ‘ค cfug Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2018-04-20
22
PaddlePaddle/PaddleSpeech

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

PaddlePaddle
โญ 12,713 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-08-12 ๐Ÿ“… Created 2017-11-14
23
FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

FareedKhan-dev
โญ 12,523 C ๐Ÿ‘ค FareedKhan-dev User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-08-01
24
huggingface/text-generation-inference

Large Language Model Text Generation Inference

huggingface
โญ 10,812 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2022-10-08
25
zyddnys/manga-image-translator

Translate manga/images โ€” translate text in all kinds of images with one click https://cotrans.touhou.ai/ https://greasyfork.org/en/scripts/437569-cotrans-manga-image-translator-regular-edition

zyddnys
โญ 10,626 Python ๐Ÿ‘ค zyddnys User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2021-02-18
26
bigscience-workshop/petals

Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

bigscience-workshop
โญ 9,864 Python ๐Ÿ‘ค bigscience-workshop Organization ๐Ÿ• Updated 2024-09-07 ๐Ÿ“… Created 2022-06-12
27
open-mmlab/mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

open-mmlab
โญ 9,527 Python ๐Ÿ‘ค open-mmlab Organization ๐Ÿ• Updated 2024-08-13 ๐Ÿ“… Created 2020-06-14
28
PaddlePaddle/PaddleSeg

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

PaddlePaddle
โญ 9,417 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-02-05 ๐Ÿ“… Created 2019-08-26
29
OptimalScale/LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

OptimalScale
โญ 8,482 Python ๐Ÿ‘ค OptimalScale Organization ๐Ÿ• Updated 2026-08-10 ๐Ÿ“… Created 2023-03-27
30
jessevig/bertviz

BertViz: Visualize Attention in Transformer Models

jessevig
โญ 8,220 Python ๐Ÿ‘ค jessevig User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2018-12-16
31
openai/jukebox

Code for the paper "Jukebox: A Generative Model for Music"

openai
โญ 8,037 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2024-06-19 ๐Ÿ“… Created 2020-04-29
32
vllm-project/vllm-omni

A framework for efficient model inference with omni-modality models

vllm-project
โญ 7,884 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-09-11
33
Morizeyao/GPT2-Chinese

Chinese version of GPT2 training code, using BERT tokenizer.

Morizeyao
โญ 7,609 Python ๐Ÿ‘ค Morizeyao User ๐Ÿ• Updated 2024-04-25 ๐Ÿ“… Created 2019-05-31
34
InternLM/MindSearch

๐Ÿ” An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

InternLM
โญ 6,885 JavaScript ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-07-04 ๐Ÿ“… Created 2024-07-28
35
vllm-project/semantic-router

An open, programmable decision layer for models and compute.

vllm-project
โญ 6,514 Go ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-08-26
36
zhouhaoyi/Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

zhouhaoyi
โญ 6,510 Python ๐Ÿ‘ค zhouhaoyi User ๐Ÿ• Updated 2025-06-20 ๐Ÿ“… Created 2020-12-07
37
NVIDIA/FasterTransformer

Transformer related optimization, including BERT, GPT

NVIDIA
โญ 6,376 C++ ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2024-03-27 ๐Ÿ“… Created 2021-04-02
38
cactus-compute/engine

2-bit quantization, kernels, and runtime for consumer devices.

cactus-compute
โญ 6,200 C++ ๐Ÿ‘ค cactus-compute Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-04-23
39
timeseriesAI/tsai

Time series Timeseries Deep Learning Machine Learning Python Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai

timeseriesAI
โญ 6,151 Jupyter Notebook ๐Ÿ‘ค timeseriesAI Organization ๐Ÿ• Updated 2026-07-23 ๐Ÿ“… Created 2019-09-30
40
bentrevett/pytorch-seq2seq

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

bentrevett
โญ 5,664 Jupyter Notebook ๐Ÿ‘ค bentrevett User ๐Ÿ• Updated 2024-01-20 ๐Ÿ“… Created 2018-07-17
41
WeThinkIn/AIGC-Interview-Book

ใ€Three Years of Interviews, Five Years of Practice Testsใ€‘An interview resources platform for AIGC/LLM/AI Agent algorithm engineers. It covers practical interview and written-test insights and core enduring knowledge across the AI industry, including AIGC, large language models (LLMs), AI Agents, embodied intelligence, traditional deep learning, computer vision, natural language processing, autonomous driving, machine learning, reinforcement learning, big data mining, world models, the metaverse, AGI, and more.

WeThinkIn
โญ 5,282 Python ๐Ÿ‘ค WeThinkIn User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-10-14
42
JingyunLiang/SwinIR

SwinIR: Image Restoration Using Swin Transformer (official repository)

JingyunLiang
โญ 5,263 Python ๐Ÿ‘ค JingyunLiang User ๐Ÿ• Updated 2024-05-14 ๐Ÿ“… Created 2021-08-16
43
wenet-e2e/wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit

wenet-e2e
โญ 5,258 Python ๐Ÿ‘ค wenet-e2e Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2020-11-17
44
cmhungsteve/Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

cmhungsteve
โญ 4,987 ๐Ÿ‘ค cmhungsteve User ๐Ÿ• Updated 2024-07-30 ๐Ÿ“… Created 2021-09-15
45
deepseek-ai/Engram

Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

deepseek-ai
โญ 4,835 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2026-01-12
46
thunlp/OpenPrompt

An Open-Source Framework for Prompt-Learning.

thunlp
โญ 4,792 Python ๐Ÿ‘ค thunlp Organization ๐Ÿ• Updated 2024-07-16 ๐Ÿ“… Created 2021-09-30
47
origin-brain/beat-ai

The ultimate guide to AI for beginners, free from obscurity and elitism, easy for everyone from students to engineers to master. It covers everything from neural networks to large models, high-level design to microscopic principles, and engineering implementation to algorithmic foundations. After finishing this, you will fully understand why the seemingly humble ability of 'next-token prediction' can change the world, and discover that AI is not as mysterious or unattainable as you once thought. Let's just beat it!

origin-brain
โญ 4,739 JavaScript ๐Ÿ‘ค origin-brain Organization ๐Ÿ• Updated 2026-08-20 ๐Ÿ“… Created 2021-12-29
48
hyunwoongko/transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

hyunwoongko
โญ 4,609 Python ๐Ÿ‘ค hyunwoongko User ๐Ÿ• Updated 2025-07-15 ๐Ÿ“… Created 2019-10-15
49
huawei-noah/Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

huawei-noah
โญ 4,417 Python ๐Ÿ‘ค huawei-noah Organization ๐Ÿ• Updated 2025-03-15 ๐Ÿ“… Created 2019-11-16
50
Nixtla/neuralforecast

Scalable and user friendly neural :brain: forecasting algorithms.

Nixtla
โญ 4,318 Python ๐Ÿ‘ค Nixtla Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2021-04-26

Frequently Asked Questions

1

What is the most popular #transformer repository on GitHub?

The top ranked open source #transformer project on GitHub is huggingface/transformers with 169,339 stars. ๐Ÿค— Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

2

Which programming languages are most used in #transformer repositories?

Among the top ranked #transformer projects on GitHub, the most common programming languages are Python, C++, Jupyter Notebook, JavaScript.

3

How is the #transformer repository ranking calculated?

We track 208 active open source repositories tagged with #transformer (500+ stars), totaling 1,197,728 stars with an average of 5,758 stars per repository. Rankings update daily from the GitHub API.