Git Stars Git Stars

#transformer Repositories

208
Total Repositories
1.2M
Total Stars
5,758
Avg Stars/Repo
51
dk-liang/Awesome-Visual-Transformer

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

dk-liang
โญ 3,584 ๐Ÿ‘ค dk-liang User ๐Ÿ• Updated 2025-01-07 ๐Ÿ“… Created 2020-12-03
52
PaddlePaddle/awesome-DeepLearning

Deep Learning introductory courses, advanced courses, featured courses, academic cases, industry practice cases, deep learning knowledge encyclopedia and interview question bank The course, case and knowledge of Deep Learning and AI

PaddlePaddle
โญ 3,541 Jupyter Notebook ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-12-11
53
towhee-io/towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

towhee-io
โญ 3,444 Python ๐Ÿ‘ค towhee-io Organization ๐Ÿ• Updated 2024-10-18 ๐Ÿ“… Created 2021-07-13
54
NVlabs/SegFormer

Official PyTorch implementation of SegFormer

NVlabs
โญ 3,273 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2024-08-02 ๐Ÿ“… Created 2021-06-11
55
imbue-bit/AlphaGPT

Open-source automated factor factory based on deep reinforcement learning.

imbue-bit
โญ 3,264 Python ๐Ÿ‘ค imbue-bit User ๐Ÿ• Updated 2026-06-12 ๐Ÿ“… Created 2026-01-08
56
ddz16/TSFpaper

This repository contains a reading list of papers on Time Series Forecasting/Prediction (TSF) and Spatio-Temporal Forecasting/Prediction (STF). These papers are mainly categorized according to the type of model.

ddz16
โญ 3,202 ๐Ÿ‘ค ddz16 User ๐Ÿ• Updated 2026-08-14 ๐Ÿ“… Created 2022-06-29
57
vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

vllm-project
โญ 3,128 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-29
58
microsoft/torchscale

Foundation Architecture for (M)LLMs

microsoft
โญ 3,128 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-04-11 ๐Ÿ“… Created 2022-11-17
59
guillaume-be/rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2, ...)

guillaume-be
โญ 3,092 Rust ๐Ÿ‘ค guillaume-be User ๐Ÿ• Updated 2026-01-13 ๐Ÿ“… Created 2020-01-25
60
AutoArk/GPA

[AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny model!

AutoArk
โญ 3,054 Python ๐Ÿ‘ค AutoArk Organization ๐Ÿ• Updated 2026-05-25 ๐Ÿ“… Created 2025-12-16
61
datawhalechina/learn-nlp-with-transformers

we want to create a repo to illustrate usage of transformers in chinese

datawhalechina
โญ 3,050 Shell ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2024-08-18 ๐Ÿ“… Created 2021-04-11
62
datawhalechina/diy-llm

Covers pre-training data, Tokenizers, Transformers, MoE, distributed training, scaling laws, inference, and alignment. 6 progressive coding assignments for full-stack LLM learning.

datawhalechina
โญ 3,035 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-24
63
pytorch/ao

PyTorch native quantization for training and inference

pytorch
โญ 3,032 Python ๐Ÿ‘ค pytorch Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-11-03
64
sovrasov/flops-counter.pytorch

Flops counter for neural networks in pytorch framework

sovrasov
โญ 2,981 Python ๐Ÿ‘ค sovrasov User ๐Ÿ• Updated 2025-08-20 ๐Ÿ“… Created 2018-08-17
65
posthtml/posthtml

PostHTML is a tool to transform HTML/XML with JS plugins

posthtml
โญ 2,962 JavaScript ๐Ÿ‘ค posthtml Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-06-24
66
iscyy/ultralyticsPro

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ Focusing on YOLO11, YOLOv8, TYOLOv12, YOLOv10, RT-DETR, YOLOv7, YOLOv5 improved models, Support to improve backbone, neck, head, loss, IoU, NMS and other modules๐Ÿš€

iscyy
โญ 2,955 Python ๐Ÿ‘ค iscyy User ๐Ÿ• Updated 2025-12-15 ๐Ÿ“… Created 2022-08-05
67
qingsongedu/time-series-transformers-review

A professionally curated list of awesome resources (paper, code, data, etc.) on transformers in time series.

qingsongedu
โญ 2,935 ๐Ÿ‘ค qingsongedu User ๐Ÿ• Updated 2024-08-08 ๐Ÿ“… Created 2022-03-01
68
amusi/ICCV2025-Papers-with-Code

Collection of ICCV 2025 Papers and Open-Source Projects

amusi
โญ 2,880 ๐Ÿ‘ค amusi User ๐Ÿ• Updated 2025-07-06 ๐Ÿ“… Created 2021-07-23
69
Charmve/computer-vision-in-action

A computer vision closed-loop learning platform where code can be run interactively online. Learning closed-loop "Computer Vision in Action: Algorithms and Applications" Chinese ebook, source code, reader exchange community (continuously updating...) ๐Ÿ“˜ Online ebook https://charmve.github.io/computer-vision-in-action/ ๐Ÿ‘‡Project homepage

Charmve
โญ 2,813 Jupyter Notebook ๐Ÿ‘ค Charmve User ๐Ÿ• Updated 2024-05-27 ๐Ÿ“… Created 2021-04-29
70
InterviewReady/ai-engineering-resources

Research papers and blogs to transition to AI Engineering

InterviewReady
โญ 2,670 ๐Ÿ‘ค InterviewReady Organization ๐Ÿ• Updated 2025-11-19 ๐Ÿ“… Created 2025-05-13
71
swz30/Restormer

[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

swz30
โญ 2,665 Python ๐Ÿ‘ค swz30 User ๐Ÿ• Updated 2025-10-23 ๐Ÿ“… Created 2021-10-19
72
X-PLUG/mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

X-PLUG
โญ 2,541 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-04-02 ๐Ÿ“… Created 2023-04-25
73
young-geng/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

young-geng
โญ 2,505 Python ๐Ÿ‘ค young-geng User ๐Ÿ• Updated 2024-08-13 ๐Ÿ“… Created 2022-11-22
74
microsoft/Graphormer

Graphormer is a general-purpose deep learning backbone for molecular modeling.

microsoft
โญ 2,486 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2021-05-27
75
curiousily/Getting-Things-Done-with-Pytorch

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BER

curiousily
โญ 2,478 Jupyter Notebook ๐Ÿ‘ค curiousily User ๐Ÿ• Updated 2024-06-30 ๐Ÿ“… Created 2020-01-31
76
ppogg/YOLOv5-Lite

๐Ÿ…๐Ÿ…๐Ÿ…YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

ppogg
โญ 2,463 C++ ๐Ÿ‘ค ppogg User ๐Ÿ• Updated 2024-06-22 ๐Ÿ“… Created 2021-08-16
77
AIStream-Peelout/flow-forecast

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).

AIStream-Peelout
โญ 2,308 Python ๐Ÿ‘ค AIStream-Peelout Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2019-08-15
78
Alpha-VLLM/Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

Alpha-VLLM
โญ 2,251 Python ๐Ÿ‘ค Alpha-VLLM Organization ๐Ÿ• Updated 2025-02-16 ๐Ÿ“… Created 2024-03-28
79
DepthAnything/Video-Depth-Anything

[CVPR 2025 Highlight] Video Depth Anything: Consistent Depth Estimation for Super-Long Videos

DepthAnything
โญ 2,229 Python ๐Ÿ‘ค DepthAnything Organization ๐Ÿ• Updated 2025-10-07 ๐Ÿ“… Created 2025-01-21
80
Xnhyacinth/Awesome-LLM-Long-Context-Modeling

๐Ÿ“ฐ Must-read papers and blogs on LLM based Long Context Modeling ๐Ÿ”ฅ

Xnhyacinth
โญ 2,191 ๐Ÿ‘ค Xnhyacinth User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-09-17
81
thuml/iTransformer

Official implementation for "iTransformer: Inverted Transformers Are Effective for Time Series Forecasting" (ICLR 2024 Spotlight)

thuml
โญ 2,175 Python ๐Ÿ‘ค thuml Organization ๐Ÿ• Updated 2025-07-17 ๐Ÿ“… Created 2023-10-19
82
MoonshotAI/MoBA

MoBA: Mixture of Block Attention for Long-Context LLMs

MoonshotAI
โญ 2,122 Python ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2025-04-03 ๐Ÿ“… Created 2025-02-17
83
microsoft/aici

AICI: Prompts as (Wasm) Programs

microsoft
โญ 2,077 Rust ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2025-01-22 ๐Ÿ“… Created 2023-09-26
84
FireRedTeam/FireRedASR

Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR benchmarks, while also offering outstanding singing lyrics recognition capability.

FireRedTeam
โญ 2,014 Python ๐Ÿ‘ค FireRedTeam Organization ๐Ÿ• Updated 2026-02-25 ๐Ÿ“… Created 2025-01-24
85
qusong0627/QuantMind

QuantMind (Quantitative Brain) Open Source Edition is an AI-native, multi-market quantitative trading platform designed for individual developers and quantitative research and investment teams. It deeply integrates Microsoft Qlib, RD-Agent factor evolution, and the all-in-one QuantBot Workbench, providing a complete closed loop covering the mining of 300+ dimensional factors, a model factory with 13 machine learning and deep learning models, high-performance Qlib backtesting, batch cross-sectional inference, 24/7 real-time public-opinion sentiment analysis, deep integration with TongdaXin (sector push notifications, alert radar, and lightning order placement), and live and simulated trading. It supports A-shares, Hong Kong stocks, U.S. stocks, futures, and blockchain. It is free for commercial use and can be deployed privately with a single click using Docker Compose. Data and models are fully localized to safeguard strategy privacy, with all features available without entry barriers or limitations.

qusong0627
โญ 1,951 Python ๐Ÿ‘ค qusong0627 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-15
86
Fafa-DL/Awesome-Backbones

Integrate deep learning models for image classification | Backbone learning/comparison/magic modification project

Fafa-DL
โญ 1,941 Python ๐Ÿ‘ค Fafa-DL User ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2022-01-04
87
safe-graph/graph-fraud-detection-papers

A curated list of Graph/Transformer-based fraud, anomaly, and outlier detection papers & resources

safe-graph
โญ 1,908 ๐Ÿ‘ค safe-graph Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2019-11-21
88
nndeploy/nndeploy

An Easy-to-Use and High-Performance AI Deployment Framework | An Easy-to-Use and High-Performance AI Deployment Framework

nndeploy
โญ 1,904 C++ ๐Ÿ‘ค nndeploy Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-08-08
89
jsksxs360/How-to-use-Transformers

Transformers Library Quick Start Tutorial

jsksxs360
โญ 1,892 Python ๐Ÿ‘ค jsksxs360 User ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2022-09-19
90
yongzhuo/Keras-TextClassification

Chinese long text classification, short sentence classification, multi-label classification, two-sentence similarity (Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short), character/word/sentence vector embedding layer (embeddings) and network layer (graph) construction base class, FastText, TextCNN, CharCNN, TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, Capsule Network-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

yongzhuo
โญ 1,810 Python ๐Ÿ‘ค yongzhuo User ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2019-06-13
91
SqueezeAILab/LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

SqueezeAILab
โญ 1,808 Python ๐Ÿ‘ค SqueezeAILab Organization ๐Ÿ• Updated 2024-07-10 ๐Ÿ“… Created 2023-12-06
92
kristerkari/react-native-svg-transformer

Import SVG files in your React Native project the same way that you would in a Web application.

kristerkari
โญ 1,737 JavaScript ๐Ÿ‘ค kristerkari User ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2018-08-02
93
SHI-Labs/OneFormer

[CVPR 2023] OneFormer: One Transformer to Rule Universal Image Segmentation

SHI-Labs
โญ 1,690 Jupyter Notebook ๐Ÿ‘ค SHI-Labs Organization ๐Ÿ• Updated 2024-10-03 ๐Ÿ“… Created 2022-11-02
94
elixir-nx/bumblebee

Pre-trained Neural Network models in Axon (+ ๐Ÿค— Models integration)

elixir-nx
โญ 1,675 Elixir ๐Ÿ‘ค elixir-nx Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2022-05-03
95
yoshitomo-matsubara/torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. ๐Ÿ† 28 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc. have been implemented so far. ๐ŸŽ Trained models, training logs, and configurations are available to ensure reproducibility and benchmarking.

yoshitomo-matsubara
โญ 1,636 Python ๐Ÿ‘ค yoshitomo-matsubara User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2019-12-18
96
PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

PKU-Alignment
โญ 1,624 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-05-15
97
PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

PaddlePaddle
โญ 1,613 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-01-04 ๐Ÿ“… Created 2019-12-16
98
microsoft/Semi-supervised-learning

A Unified Semi-Supervised Learning Codebase (NeurIPS'22)

microsoft
โญ 1,590 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2022-05-05
99
WeiboAI/VibeThinker

Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B

WeiboAI
โญ 1,589 Python ๐Ÿ‘ค WeiboAI Organization ๐Ÿ• Updated 2026-08-14 ๐Ÿ“… Created 2025-11-04
100
ELS-RD/kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

ELS-RD
โญ 1,584 Jupyter Notebook ๐Ÿ‘ค ELS-RD Organization ๐Ÿ• Updated 2024-02-16 ๐Ÿ“… Created 2022-08-05