#transformers Repositories
Discover 273 active open source GitHub repositories tagged with #transformers, accumulating 1,416,375 total stars (averaging 5,188 stars per project). Leading this topic is microsoft/generative-ai-for-beginners with 123,942 stars.
273 repositories total
Learn AI Engineering! Learn it. Build it. Ship it for others.
๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
State-of-the-art Machine Learning for the web. Run ๐ค Transformers directly in your browser, with no need for a server!
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
๐ก All-in-one AI framework for semantic search, LLM orchestration and language model workflows
A straightforward method for training your LLM, from downloading data to generating text.
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
OpenVINOโข is an open source toolkit for optimizing and deploying AI inference
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
This repository contains demos I made with the Transformers library by HuggingFace.
๐ฅ Fast State-of-the-Art Tokenizers optimized for Research and Production
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
[NeurIPS 2024 Best Paper Award][GPT beats diffusion๐ฅ] [scaling laws in visual generation๐] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
โก Pure-Rust WebGPU inference engine โ OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Robust recipes to align language models with human and AI preferences
Frequently Asked Questions
What is the most popular #transformers repository on GitHub?
The top ranked open source #transformers project on GitHub is microsoft/generative-ai-for-beginners with 123,942 stars. 21 Lessons, Get Started Building with Generative AI
Which programming languages are most used in #transformers repositories?
Among the top ranked #transformers projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Rust, JavaScript.
How is the #transformers repository ranking calculated?
We track 273 active open source repositories tagged with #transformers (500+ stars), totaling 1,416,375 stars with an average of 5,188 stars per repository. Rankings update daily from the GitHub API.