#transformer-architecture Repositories
Discover 147 active open source GitHub repositories tagged with #transformer-architecture, accumulating 594,368 total stars (averaging 4,043 stars per project). Leading this topic is karpathy/nanoGPT with 64,617 stars.
147 repositories total
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
The repository provides code for running inference and finetuning with the Meta Segment Anything Model 3 (SAM 3), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
Qwen-Image is a powerful image generation foundation model capable of complex text rendering and precise image editing.
Large Model Fundamentals: Understand Large Model Fundamentals in One Article
This is a simple technical็งๆฎ tutorial project, mainly focusing on explaining some interesting, cutting-edge technical concepts and principles. Each article strives to be completed within 5 minutes of reading.
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
Using Bert, ERNIE for Chinese text classification
"Build a Large Language Model (From Scratch)" is an e-book that delves into the principles and implementation of large language models, suitable for learners who wish to deeply understand the architecture, training process, and application development of large models like GPT. To enable more Chinese readers to access this highly valuable textbook, I have decided to translate it into Chinese and share it as open source via GitHub.
[CVPR2025 Highlight] Video Generation Foundation Models: https://saiyan-world.github.io/goku/
Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.
An official implementation of PatchTST: "A Time Series is Worth 64 Words: Long-term Forecasting with Transformers." (ICLR 2023) https://arxiv.org/abs/2211.14730
This is the official repository for The Hundred-Page Language Models Book by Andriy Burkov
A LLM trained only on data from certain time periods to reduce modern bias
Frequently Asked Questions
What is the most popular #transformer-architecture repository on GitHub?
The top ranked open source #transformer-architecture project on GitHub is karpathy/nanoGPT with 64,617 stars. The simplest, fastest repository for training/finetuning medium-sized GPTs.
Which programming languages are most used in #transformer-architecture repositories?
Among the top ranked #transformer-architecture projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Makefile, TypeScript.
How is the #transformer-architecture repository ranking calculated?
We track 147 active open source repositories tagged with #transformer-architecture (500+ stars), totaling 594,368 stars with an average of 4,043 stars per repository. Rankings update daily from the GitHub API.