Git Stars Git Stars

#transformers Repositories

Discover 273 active open source GitHub repositories tagged with #transformers, accumulating 1,416,375 total stars (averaging 5,188 stars per project). Leading this topic is microsoft/generative-ai-for-beginners with 123,942 stars.

273
Total Repositories
1.4M
Total Stars
5,188
Avg Stars/Repo
1
microsoft/generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI

microsoft
โญ 123,942 Jupyter Notebook ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-06-19
2
rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

rasbt
โญ 108,745 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-07-23
3
rohitg00/ai-engineering-from-scratch

Learn AI Engineering! Learn it. Build it. Ship it for others.

rohitg00
โญ 79,725 Python ๐Ÿ‘ค rohitg00 User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-03-18
4
hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

hiyouga
โญ 76,171 Python ๐Ÿ‘ค hiyouga User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-28
5
labmlai/annotated_deep_learning_paper_implementations

๐Ÿง‘โ€๐Ÿซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐Ÿ“; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ŸŽฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐Ÿง 

labmlai
โญ 67,780 Python ๐Ÿ‘ค labmlai Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2020-08-25
6
zai-org/ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model

zai-org
โญ 41,224 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2024-06-27 ๐Ÿ“… Created 2023-03-13
7
hpcaitech/Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

hpcaitech
โญ 29,943 Python ๐Ÿ‘ค hpcaitech Organization ๐Ÿ• Updated 2026-04-09 ๐Ÿ“… Created 2024-02-20
8
lucidrains/vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

lucidrains
โญ 25,588 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2020-10-03
9
amusi/CVPR2026-Papers-with-Code

CVPR 2026 Papers and Open-Source Project Collection

amusi
โญ 22,969 ๐Ÿ‘ค amusi User ๐Ÿ• Updated 2026-03-08 ๐Ÿ“… Created 2020-02-26
10
huggingface/peft

๐Ÿค— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

huggingface
โญ 21,910 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-11-25
11
QwenLM/Qwen3-VL

Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 20,240 Jupyter Notebook ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2026-01-30 ๐Ÿ“… Created 2024-08-29
12
stas00/ml-engineering

Machine Learning Engineering Open Book

stas00
โญ 19,738 Python ๐Ÿ‘ค stas00 User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-09-02
13
NVIDIA/Megatron-LM

Ongoing research training transformer models at scale

NVIDIA
โญ 18,449 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-03-21
14
arc53/DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

arc53
โญ 18,374 Python ๐Ÿ‘ค arc53 Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-02-02
15
rasbt/deeplearning-models

A collection of various deep learning architectures, models, and tips

rasbt
โญ 17,641 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-09-26 ๐Ÿ“… Created 2019-06-05
16
huggingface/transformers.js

State-of-the-art Machine Learning for the web. Run ๐Ÿค— Transformers directly in your browser, with no need for a server!

huggingface
โญ 16,439 JavaScript ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-02-13
17
BlinkDL/RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

BlinkDL
โญ 14,786 Python ๐Ÿ‘ค BlinkDL User ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2021-08-08
18
neuml/txtai

๐Ÿ’ก All-in-one AI framework for semantic search, LLM orchestration and language model workflows

neuml
โญ 13,696 Python ๐Ÿ‘ค neuml Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-08-09
19
zai-org/ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | Open Bilingual Chat LLMs

zai-org
โญ 13,680 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2025-01-13 ๐Ÿ“… Created 2023-10-26
20
FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

FareedKhan-dev
โญ 13,281 Python ๐Ÿ‘ค FareedKhan-dev User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-01-12
21
PaddlePaddle/PaddleNLP

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

PaddlePaddle
โญ 13,000 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-05-23 ๐Ÿ“… Created 2021-02-05
22
data-privacy-stack/presidio

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

data-privacy-stack
โญ 11,994 Python ๐Ÿ‘ค data-privacy-stack Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2018-05-04
23
speechbrain/speechbrain

A PyTorch-based Speech Toolkit

speechbrain
โญ 11,946 Python ๐Ÿ‘ค speechbrain Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2020-04-28
24
openvinotoolkit/openvino

OpenVINOโ„ข is an open source toolkit for optimizing and deploying AI inference

openvinotoolkit
โญ 11,869 C++ ๐Ÿ‘ค openvinotoolkit Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-10-15
25
qubvel-org/segmentation_models.pytorch

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

qubvel-org
โญ 11,813 Python ๐Ÿ‘ค qubvel-org Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2019-03-01
26
NielsRogge/Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

NielsRogge
โญ 11,787 Jupyter Notebook ๐Ÿ‘ค NielsRogge User ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2020-08-31
27
huggingface/tokenizers

๐Ÿ’ฅ Fast State-of-the-Art Tokenizers optimized for Research and Production

huggingface
โญ 11,270 Rust ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-11-01
28
MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

MakazhanAlpamys
โญ 10,703 Python ๐Ÿ‘ค MakazhanAlpamys User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-20
29
niedev/RTranslator

Open source real-time translation app for Android that runs locally

niedev
โญ 10,702 Java ๐Ÿ‘ค niedev User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2020-03-30
30
OpenRLHF/OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

OpenRLHF
โญ 10,173 Python ๐Ÿ‘ค OpenRLHF Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2023-07-30
31
NVlabs/Sana

SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling

NVlabs
โญ 9,862 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2024-10-11
32
xorbitsai/inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

xorbitsai
โญ 9,667 Python ๐Ÿ‘ค xorbitsai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-14
33
FoundationVision/VAR

[NeurIPS 2024 Best Paper Award][GPT beats diffusion๐Ÿ”ฅ] [scaling laws in visual generation๐Ÿ“ˆ] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

FoundationVision
โญ 8,766 Jupyter Notebook ๐Ÿ‘ค FoundationVision Organization ๐Ÿ• Updated 2025-11-10 ๐Ÿ“… Created 2024-04-01
34
intel/ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

intel
โญ 8,659 Python ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2025-10-14 ๐Ÿ“… Created 2016-08-29
35
Neywa-Labs/mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Neywa-Labs
โญ 8,315 Python ๐Ÿ‘ค Neywa-Labs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-11-27
36
jessevig/bertviz

BertViz: Visualize Attention in Transformer Models

jessevig
โญ 8,220 Python ๐Ÿ‘ค jessevig User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2018-12-16
37
MaartenGr/BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

MaartenGr
โญ 7,966 Python ๐Ÿ‘ค MaartenGr User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2020-09-22
38
lucidrains/PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

lucidrains
โญ 7,858 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2022-12-09
39
EleutherAI/gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

EleutherAI
โญ 7,475 Python ๐Ÿ‘ค EleutherAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-12-22
40
vladmandic/sdnext

SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

vladmandic
โญ 7,380 Python ๐Ÿ‘ค vladmandic User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-12-24
41
argosopentech/argos-translate

Open-source offline translation library written in Python

argosopentech
โญ 6,682 Python ๐Ÿ‘ค argosopentech User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2020-04-07
42
argmaxinc/argmax-oss-swift

On-device Speech AI for Apple Silicon

argmaxinc
โญ 6,471 Swift ๐Ÿ‘ค argmaxinc Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-01-26
43
amazon-science/chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

amazon-science
โญ 6,335 Python ๐Ÿ‘ค amazon-science Organization ๐Ÿ• Updated 2026-10-05 ๐Ÿ“… Created 2024-02-23
44
SkalskiP/courses

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

SkalskiP
โญ 6,256 Python ๐Ÿ‘ค SkalskiP User ๐Ÿ• Updated 2024-04-22 ๐Ÿ“… Created 2023-04-02
45
z-lab/dflash

DFlash: Block Diffusion for Flash Speculative Decoding

z-lab
โญ 6,254 Python ๐Ÿ‘ค z-lab Organization ๐Ÿ• Updated 2026-08-18 ๐Ÿ“… Created 2026-01-04
โญ 6,148 ๐Ÿ‘ค ImagineAILab Organization ๐Ÿ• Updated 2025-01-28 ๐Ÿ“… Created 2024-09-15
47
OFA-Sys/Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

OFA-Sys
โญ 6,056 Jupyter Notebook ๐Ÿ‘ค OFA-Sys Organization ๐Ÿ• Updated 2026-03-31 ๐Ÿ“… Created 2022-07-08
48
Michael-A-Kuykendall/shimmy

โšก Pure-Rust WebGPU inference engine โ€” OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Michael-A-Kuykendall
โญ 6,020 Rust ๐Ÿ‘ค Michael-A-Kuykendall User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2025-08-28
49
lucidrains/x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers

lucidrains
โญ 5,966 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2020-10-24
50
huggingface/alignment-handbook

Robust recipes to align language models with human and AI preferences

huggingface
โญ 5,716 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-23 ๐Ÿ“… Created 2023-08-25

Frequently Asked Questions

1

What is the most popular #transformers repository on GitHub?

The top ranked open source #transformers project on GitHub is microsoft/generative-ai-for-beginners with 123,942 stars. 21 Lessons, Get Started Building with Generative AI

2

Which programming languages are most used in #transformers repositories?

Among the top ranked #transformers projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Rust, JavaScript.

3

How is the #transformers repository ranking calculated?

We track 273 active open source repositories tagged with #transformers (500+ stars), totaling 1,416,375 stars with an average of 5,188 stars per repository. Rankings update daily from the GitHub API.