Git Stars Git Stars

#self-attention Repositories

Discover 13 active open source GitHub repositories tagged with #self-attention, accumulating 59,926 total stars (averaging 4,609 stars per project). Leading this topic is datawhalechina/leedl-tutorial with 16,879 stars.

13
Total Repositories
59,926
Total Stars
4,609
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook Go
1
datawhalechina/leedl-tutorial

ใ€ŠHung-yi Lee Deep Learning Tutorialใ€‹(Recommended by Professor Hung-yi Lee ๐Ÿ‘, Apple Books ๐ŸŽ), PDF Download Link: https://github.com/datawhalechina/leedl-tutorial/releases

datawhalechina
โญ 16,879 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2019-07-02
2
naklecha/llama3-from-scratch

llama3 implementation one matrix multiplication at a time

naklecha
โญ 15,215 Jupyter Notebook ๐Ÿ‘ค naklecha User ๐Ÿ• Updated 2024-05-23 ๐Ÿ“… Created 2024-05-19
3
zhouhaoyi/Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

zhouhaoyi
โญ 6,510 Python ๐Ÿ‘ค zhouhaoyi User ๐Ÿ• Updated 2025-06-20 ๐Ÿ“… Created 2020-12-07
4
afshinea/stanford-cme-295-transformers-large-language-models

VIP cheatsheet for Stanford's CME 295 Transformers and Large Language Models

afshinea
โญ 5,110 ๐Ÿ‘ค afshinea User ๐Ÿ• Updated 2026-09-13 ๐Ÿ“… Created 2025-03-23
5
cmhungsteve/Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

cmhungsteve
โญ 4,987 ๐Ÿ‘ค cmhungsteve User ๐Ÿ• Updated 2024-07-30 ๐Ÿ“… Created 2021-09-15
6
heykeetae/Self-Attention-GAN

Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)

heykeetae
โญ 2,603 Python ๐Ÿ‘ค heykeetae User ๐Ÿ• Updated 2024-04-22 ๐Ÿ“… Created 2018-05-28
7
CASIA-IVA-Lab/DANet

Dual Attention Network for Scene Segmentation (CVPR2019)

CASIA-IVA-Lab
โญ 2,451 Python ๐Ÿ‘ค CASIA-IVA-Lab Organization ๐Ÿ• Updated 2024-12-23 ๐Ÿ“… Created 2018-09-11
8
NVlabs/MambaVision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

NVlabs
โญ 2,255 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-11 ๐Ÿ“… Created 2024-06-10
9
openseg-group/openseg.pytorch

The official Pytorch implementation of OCNet, OCRNet, and SegFix.

openseg-group
โญ 1,227 Python ๐Ÿ‘ค openseg-group Organization ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-01-21
10
NVlabs/FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

NVlabs
โญ 921 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2025-07-22 ๐Ÿ“… Created 2023-05-19
11
zakirullin/gpt-go

Tiny GPT implemented from scratch in pure Go. Optimized for understanding. Trained on Jules Verne books.

zakirullin
โญ 643 Go ๐Ÿ‘ค zakirullin User ๐Ÿ• Updated 2025-10-08 ๐Ÿ“… Created 2025-04-16
12
chsiang426/ML-2021-notes

NTU Professor Li Hongyi's Machine Learning (Machine Learning) 2021 Spring Course Notes

chsiang426
โญ 610 ๐Ÿ‘ค chsiang426 User ๐Ÿ• Updated 2026-08-16 ๐Ÿ“… Created 2023-03-31
13
WenjieDu/SAITS

The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-series imputation (impute multivariate incomplete time series containing NaN missing data/values with machine learning). https://arxiv.org/abs/2202.08516

WenjieDu
โญ 521 Python ๐Ÿ‘ค WenjieDu User ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2021-12-07

Frequently Asked Questions

1

What is the most popular #self-attention repository on GitHub?

The top ranked open source #self-attention project on GitHub is datawhalechina/leedl-tutorial with 16,879 stars. ใ€ŠHung-yi Lee Deep Learning Tutorialใ€‹(Recommended by Professor Hung-yi Lee ๐Ÿ‘, Apple Books ๐ŸŽ), PDF Download Link: https://github.com/datawhalechina/leedl-tutorial/releases

2

Which programming languages are most used in #self-attention repositories?

Among the top ranked #self-attention projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Go.

3

How is the #self-attention repository ranking calculated?

We track 13 active open source repositories tagged with #self-attention (500+ stars), totaling 59,926 stars with an average of 4,609 stars per repository. Rankings update daily from the GitHub API.