Git Stars Git Stars

#transformers Repositories

273
Total Repositories
1.4M
Total Stars
5,188
Avg Stars/Repo
201
TRI-ML/prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

TRI-ML
โญ 894 Python ๐Ÿ‘ค TRI-ML Organization ๐Ÿ• Updated 2024-07-04 ๐Ÿ“… Created 2024-02-13
202
explosion/curated-transformers

A PyTorch library of curated Transformer models and their composable components

explosion
โญ 894 Python ๐Ÿ‘ค explosion Organization ๐Ÿ• Updated 2024-04-17 ๐Ÿ“… Created 2022-09-14
203
dvgodoy/FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

dvgodoy
โญ 878 Jupyter Notebook ๐Ÿ‘ค dvgodoy User ๐Ÿ• Updated 2026-02-28 ๐Ÿ“… Created 2024-08-15
204
moment-timeseries-foundation-model/moment

MOMENT: A Family of Open Time-series Foundation Models, ICML'24

moment-timeseries-foundation-model
โญ 878 TypeScript ๐Ÿ‘ค moment-timeseries-foundation-model Organization ๐Ÿ• Updated 2026-02-10 ๐Ÿ“… Created 2024-05-10
205
valeman/Transformers_And_LLM_Are_What_You_Dont_Need

The best repository showing why transformers might not be the answer for time series forecasting and showcasing the best SOTA non transformer models.

valeman
โญ 869 ๐Ÿ‘ค valeman User ๐Ÿ• Updated 2026-02-12 ๐Ÿ“… Created 2023-06-20
206
whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

whitecircle
โญ 868 Python ๐Ÿ‘ค whitecircle Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-26
207
UCSB-AI/MiniGPT-5

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

UCSB-AI
โญ 865 Python ๐Ÿ‘ค UCSB-AI Organization ๐Ÿ• Updated 2025-05-08 ๐Ÿ“… Created 2023-10-02
208
eloialonso/iris

Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%.

eloialonso
โญ 861 Python ๐Ÿ‘ค eloialonso User ๐Ÿ• Updated 2024-10-14 ๐Ÿ“… Created 2022-08-23
209
IST-DASLab/sparsegpt

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

IST-DASLab
โญ 859 Python ๐Ÿ‘ค IST-DASLab Organization ๐Ÿ• Updated 2024-08-20 ๐Ÿ“… Created 2023-03-20
210
lucidrains/meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

lucidrains
โญ 858 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2024-12-24 ๐Ÿ“… Created 2023-11-29
211
abhimishra91/transformers-tutorials

Github repo with tutorials to fine tune transformers for diff NLP tasks

abhimishra91
โญ 857 Jupyter Notebook ๐Ÿ‘ค abhimishra91 User ๐Ÿ• Updated 2024-04-01 ๐Ÿ“… Created 2020-05-04
212
qiufengqijun/mini_qwen

This is a project to train large language models from scratch, including pre-training, fine-tuning, and direct preference optimization, with the model having 1B parameters and supporting Chinese and English.

qiufengqijun
โญ 849 Python ๐Ÿ‘ค qiufengqijun User ๐Ÿ• Updated 2025-02-18 ๐Ÿ“… Created 2025-01-18
213
divagr18/qwenputer

A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.

divagr18
โญ 840 Python ๐Ÿ‘ค divagr18 User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-10-19
214
johnmai-dev/ChatMLX

๐Ÿค–โœจChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

johnmai-dev
โญ 830 Swift ๐Ÿ‘ค johnmai-dev User ๐Ÿ• Updated 2025-03-12 ๐Ÿ“… Created 2024-03-05
215
NeuromatchAcademy/course-content-dl

NMA deep learning course

NeuromatchAcademy
โญ 819 Jupyter Notebook ๐Ÿ‘ค NeuromatchAcademy Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2021-04-12
216
mukel/llama3.java

Llama 3+ inference in pure Java

mukel
โญ 818 Java ๐Ÿ‘ค mukel User ๐Ÿ• Updated 2026-04-24 ๐Ÿ“… Created 2024-04-25
217
VinAIResearch/PhoBERT

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

VinAIResearch
โญ 811 ๐Ÿ‘ค VinAIResearch Organization ๐Ÿ• Updated 2026-08-04 ๐Ÿ“… Created 2020-03-03
218
DaoyuanLi2816/can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

DaoyuanLi2816
โญ 796 Python ๐Ÿ‘ค DaoyuanLi2816 User ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2026-05-16
219
lucidrains/phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

lucidrains
โญ 792 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2022-09-29
220
nomic-ai/contrastors

Train Models Contrastively in Pytorch

nomic-ai
โญ 791 Python ๐Ÿ‘ค nomic-ai Organization ๐Ÿ• Updated 2025-03-26 ๐Ÿ“… Created 2024-01-30
221
haoliuhl/ringattention

Large Context Attention

haoliuhl
โญ 774 Python ๐Ÿ‘ค haoliuhl User ๐Ÿ• Updated 2025-10-13 ๐Ÿ“… Created 2023-06-01
222
CodeWithKyrian/transformers-php

Transformers PHP is a toolkit for PHP developers to add machine learning magic to their projects easily.

CodeWithKyrian
โญ 764 PHP ๐Ÿ‘ค CodeWithKyrian User ๐Ÿ• Updated 2025-09-15 ๐Ÿ“… Created 2024-03-12
223
vgel/repeng

A library for making RepE control vectors

vgel
โญ 760 Jupyter Notebook ๐Ÿ‘ค vgel User ๐Ÿ• Updated 2025-09-24 ๐Ÿ“… Created 2024-01-21
224
Avarok-Cybersecurity/atlas

Pure Rust Inference Engine

Avarok-Cybersecurity
โญ 737 Rust ๐Ÿ‘ค Avarok-Cybersecurity Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-05-05
225
SkalskiP/top-cvpr-2024-papers

This repository is a curated collection of the most exciting and influential CVPR 2024 papers. ๐Ÿ”ฅ [Paper + Code + Demo]

SkalskiP
โญ 734 Python ๐Ÿ‘ค SkalskiP User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2024-04-10
226
ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

ghimiresunil
โญ 734 Jupyter Notebook ๐Ÿ‘ค ghimiresunil User ๐Ÿ• Updated 2026-03-13 ๐Ÿ“… Created 2023-05-28
227
tomaarsen/attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

tomaarsen
โญ 733 Python ๐Ÿ‘ค tomaarsen User ๐Ÿ• Updated 2024-04-10 ๐Ÿ“… Created 2023-10-02
228
ankane/transformers-ruby

State-of-the-art transformers for Ruby

ankane
โญ 729 Ruby ๐Ÿ‘ค ankane User ๐Ÿ• Updated 2026-04-09 ๐Ÿ“… Created 2024-08-19
229
qq456cvb
โญ 728 Python ๐Ÿ‘ค qq456cvb User ๐Ÿ• Updated 2026-06-13 ๐Ÿ“… Created 2020-12-22
230
ymcui/MacBERT

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

ymcui
โญ 728 ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2020-09-22
231
monologg/JointBERT

Pytorch implementation of JointBERT: "BERT for Joint Intent Classification and Slot Filling"

monologg
โญ 727 Python ๐Ÿ‘ค monologg User ๐Ÿ• Updated 2024-01-11 ๐Ÿ“… Created 2019-11-14
232
AdityaNG/kan-gpt

The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling

AdityaNG
โญ 726 Python ๐Ÿ‘ค AdityaNG User ๐Ÿ• Updated 2024-11-25 ๐Ÿ“… Created 2024-05-02
233
labmlai/inspectus

LLM Analytics

labmlai
โญ 718 TypeScript ๐Ÿ‘ค labmlai Organization ๐Ÿ• Updated 2026-07-08 ๐Ÿ“… Created 2024-05-20
234
kmeng01/rome

Locating and editing factual associations in GPT (NeurIPS 2022)

kmeng01
โญ 713 Python ๐Ÿ‘ค kmeng01 User ๐Ÿ• Updated 2024-04-20 ๐Ÿ“… Created 2022-02-11
235
zhongkaifu/TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, an iPhone app, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows, macOS, iOS, and Linux with full GPU capability.

zhongkaifu
โญ 681 C# ๐Ÿ‘ค zhongkaifu User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-03
236
magic-research/PLLaVA

Official repository for the paper PLLaVA

magic-research
โญ 676 Python ๐Ÿ‘ค magic-research Organization ๐Ÿ• Updated 2024-07-28 ๐Ÿ“… Created 2024-04-18
237
lucidrains/magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

lucidrains
โญ 664 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2025-01-12 ๐Ÿ“… Created 2023-10-10
238
KiaBush/persian-text-to-ipa-byt5

Persian (Farsi) grapheme-to-phoneme conversion to the International Phonetic Alphabet (IPA) using a fine-tuned ByT5 model.

KiaBush
โญ 661 Python ๐Ÿ‘ค KiaBush Organization ๐Ÿ• Updated 2026-08-02 ๐Ÿ“… Created 2026-08-02
239
sunrainyg/RandOpt

Official Codebase for "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" (ICML 2026 Spotlight)

sunrainyg
โญ 660 Python ๐Ÿ‘ค sunrainyg User ๐Ÿ• Updated 2026-09-21 ๐Ÿ“… Created 2026-02-18
240
LeapLabTHU/Agent-Attention

Official repository of Agent Attention (ECCV2024)

LeapLabTHU
โญ 657 Python ๐Ÿ‘ค LeapLabTHU User ๐Ÿ• Updated 2024-11-17 ๐Ÿ“… Created 2023-12-12
241
lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

lucidrains
โญ 655 Python ๐Ÿ‘ค lucidrains User ๐Ÿ• Updated 2024-12-27 ๐Ÿ“… Created 2023-05-15
242
SkalskiP/top-cvpr-2023-papers

This repository is a curated collection of the most exciting and influential CVPR 2023 papers. ๐Ÿ”ฅ [Paper + Code]

SkalskiP
โญ 649 Python ๐Ÿ‘ค SkalskiP User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2023-06-15
243
tue-mps/eomt

[CVPR 2025 Highlight] Official code and models for Encoder-only Mask Transformer (EoMT).

tue-mps
โญ 648 Jupyter Notebook ๐Ÿ‘ค tue-mps Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2024-12-02
244
OliBomby/Mapperatorinator

An AI framework for generating and modding osu! beatmaps for all gamemodes from spectrogram inputs.

OliBomby
โญ 646 Python ๐Ÿ‘ค OliBomby User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-05-22
245
webis-de/small-text

Active Learning for Text Classification in Python

webis-de
โญ 646 Python ๐Ÿ‘ค webis-de Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2021-05-24
246
pysentimiento/pysentimiento

A Python multilingual toolkit for Sentiment Analysis and Social NLP tasks

pysentimiento
โญ 639 Jupyter Notebook ๐Ÿ‘ค pysentimiento Organization ๐Ÿ• Updated 2024-07-09 ๐Ÿ“… Created 2020-09-04
247
google-deepmind/searchless_chess

Grandmaster-Level Chess Without Search

google-deepmind
โญ 634 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2025-01-10 ๐Ÿ“… Created 2024-04-09
248
huggingface/optimum-intel

๐Ÿค— Optimum Intel: Accelerate inference with Intel optimization tools

huggingface
โญ 631 Jupyter Notebook ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-05-25
249
monologg/KoELECTRA

Pretrained ELECTRA Model for Korean

monologg
โญ 627 Python ๐Ÿ‘ค monologg User ๐Ÿ• Updated 2024-02-19 ๐Ÿ“… Created 2020-04-20
250
radarFudan/Awesome-state-space-models

Collection of papers on state-space models

radarFudan
โญ 622 Python ๐Ÿ‘ค radarFudan User ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2023-10-15