#attention Repositories
Discover 29 active open source GitHub repositories tagged with #attention, accumulating 203,649 total stars (averaging 7,022 stars per project). Leading this topic is labmlai/annotated_deep_learning_paper_implementations with 67,780 stars.
29 repositories total
๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
SGLang is a high-performance serving framework for large language models and multimodal models.
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
๐ Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.โญโญโญ
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
This repository primarily contains notes on studying top-conference papers related to NLP algorithm engineers.
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
Replication of simple CV Projects including attention, classification, detection, keypoint detection, etc.
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
Multi-label text classification, multi-label classification, text classification, multi-label, classifier, text classification, BERT, seq2seq, attention, multi-label-classification
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
EEG Transformer 2.0. i. Convolutional Transformer for EEG Decoding. ii. Novel visualization - Class Activation Topography.
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
Keras beit,caformer,CMT,CoAtNet,convnext,davit,dino,efficientdet,edgenext,efficientformer,efficientnet,eva,fasternet,fastervit,fastvit,flexivit,gcvit,ghostnet,gpvit,hornet,hiera,iformer,inceptionnext,lcnet,levit,maxvit,mobilevit,moganet,nat,nfnets,pvt,swin,tinynet,tinyvit,uniformer,volo,vanillanet,yolor,yolov7,yolov8,yolox,gpt2,llama2, alias kecam
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model for efficient time-series imputation (impute multivariate incomplete time series containing NaN missing data/values with machine learning). https://arxiv.org/abs/2202.08516
Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss
Frequently Asked Questions
What is the most popular #attention repository on GitHub?
The top ranked open source #attention project on GitHub is labmlai/annotated_deep_learning_paper_implementations with 67,780 stars. ๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
Which programming languages are most used in #attention repositories?
Among the top ranked #attention projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Cuda, C++.
How is the #attention repository ranking calculated?
We track 29 active open source repositories tagged with #attention (500+ stars), totaling 203,649 stars with an average of 7,022 stars per repository. Rankings update daily from the GitHub API.