Git Stars Git Stars

#byte-pair-encoding Repositories

Discover 4 active open source GitHub repositories tagged with #byte-pair-encoding, accumulating 53,827 total stars (averaging 13,456 stars per project). Leading this topic is karpathy/minGPT with 23,215 stars.

4
Total Repositories
53,827
Total Stars
13,456
Avg Stars/Repo
Programming Languages: Python C++

4 repositories total

1
karpathy/minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

karpathy
⭐ 23,215 Python 👤 karpathy User 🕐 Updated 2024-08-15 📅 Created 2020-08-17
2
openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

openai
⭐ 19,698 Python 👤 openai Organization 🕐 Updated 2026-11-08 📅 Created 2022-12-01
3
karpathy/minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

karpathy
⭐ 10,241 Python 👤 karpathy User 🕐 Updated 2024-07-01 📅 Created 2024-02-16

Frequently Asked Questions

1

What is the most popular #byte-pair-encoding repository on GitHub?

The top ranked open source #byte-pair-encoding project on GitHub is karpathy/minGPT with 23,215 stars. A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

2

Which programming languages are most used in #byte-pair-encoding repositories?

Among the top ranked #byte-pair-encoding projects on GitHub, the most common programming languages are Python, C++.

3

How is the #byte-pair-encoding repository ranking calculated?

We track 4 active open source repositories tagged with #byte-pair-encoding (500+ stars), totaling 53,827 stars with an average of 13,456 stars per repository. Rankings update daily from the GitHub API.