Git Stars Git Stars

#attention-is-all-you-need Repositories

Discover 8 active open source GitHub repositories tagged with #attention-is-all-you-need, accumulating 18,584 total stars (averaging 2,323 stars per project). Leading this topic is jadore801120/attention-is-all-you-need-pytorch with 9,576 stars.

8
Total Repositories
18,584
Total Stars
2,323
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
jadore801120/attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

jadore801120
โญ 9,576 Python ๐Ÿ‘ค jadore801120 User ๐Ÿ• Updated 2024-04-16 ๐Ÿ“… Created 2017-06-14
2
linto-ai/whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

linto-ai
โญ 2,860 Python ๐Ÿ‘ค linto-ai Organization ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2023-01-13
3
amitshekhariitbhu/llm-internals

Learn LLM internals step by step - from tokenization to attention to inference optimization.

amitshekhariitbhu
โญ 1,774 ๐Ÿ‘ค amitshekhariitbhu User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-12
4
awslabs/sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

awslabs
โญ 1,217 Python ๐Ÿ‘ค awslabs Organization ๐Ÿ• Updated 2024-10-24 ๐Ÿ“… Created 2017-06-08
5
hkproj/pytorch-transformer

Attention is all you need implementation

hkproj
โญ 1,140 Jupyter Notebook ๐Ÿ‘ค hkproj User ๐Ÿ• Updated 2024-06-08 ๐Ÿ“… Created 2023-05-18
6
kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

kyegomez
โญ 715 Python ๐Ÿ‘ค kyegomez User ๐Ÿ• Updated 2024-01-07 ๐Ÿ“… Created 2023-07-06
7
feifeibear/long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

feifeibear
โญ 697 Python ๐Ÿ‘ค feifeibear User ๐Ÿ• Updated 2026-09-16 ๐Ÿ“… Created 2024-03-27
8
FreedomIntelligence/TextClassificationBenchmark

A Benchmark of Text Classification in PyTorch

FreedomIntelligence
โญ 606 Python ๐Ÿ‘ค FreedomIntelligence Organization ๐Ÿ• Updated 2024-04-20 ๐Ÿ“… Created 2017-12-13

Frequently Asked Questions

1

What is the most popular #attention-is-all-you-need repository on GitHub?

The top ranked open source #attention-is-all-you-need project on GitHub is jadore801120/attention-is-all-you-need-pytorch with 9,576 stars. A PyTorch implementation of the Transformer model in "Attention is All You Need".

2

Which programming languages are most used in #attention-is-all-you-need repositories?

Among the top ranked #attention-is-all-you-need projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #attention-is-all-you-need repository ranking calculated?

We track 8 active open source repositories tagged with #attention-is-all-you-need (500+ stars), totaling 18,584 stars with an average of 2,323 stars per repository. Rankings update daily from the GitHub API.