Git Stars Git Stars

#bert Repositories

Discover 109 active open source GitHub repositories tagged with #bert, accumulating 287,319 total stars (averaging 2,635 stars per project). Leading this topic is datawhalechina/leedl-tutorial with 16,879 stars.

109
Total Repositories
287,319
Total Stars
2,635
Avg Stars/Repo
1
datawhalechina/leedl-tutorial

ใ€ŠHung-yi Lee Deep Learning Tutorialใ€‹(Recommended by Professor Hung-yi Lee ๐Ÿ‘, Apple Books ๐ŸŽ), PDF Download Link: https://github.com/datawhalechina/leedl-tutorial/releases

datawhalechina
โญ 16,879 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2019-07-02
2
graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

graykode
โญ 14,826 Jupyter Notebook ๐Ÿ‘ค graykode User ๐Ÿ• Updated 2024-02-21 ๐Ÿ“… Created 2019-01-09
3
PaddlePaddle/PaddleNLP

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

PaddlePaddle
โญ 13,000 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-05-23 ๐Ÿ“… Created 2021-02-05
4
jina-ai/clip-as-service

๐Ÿ„ Scalable embedding, reasoning, ranking for images and sentences with CLIP

jina-ai
โญ 12,797 Python ๐Ÿ‘ค jina-ai Organization ๐Ÿ• Updated 2024-01-23 ๐Ÿ“… Created 2018-11-12
5
NielsRogge/Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

NielsRogge
โญ 11,787 Jupyter Notebook ๐Ÿ‘ค NielsRogge User ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2020-08-31
6
huggingface/tokenizers

๐Ÿ’ฅ Fast State-of-the-Art Tokenizers optimized for Research and Production

huggingface
โญ 11,270 Rust ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-11-01
7
ymcui/Chinese-BERT-wwm

Pre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm Series Models)

ymcui
โญ 10,232 Python ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2019-06-19
8
brightmart/nlp_chinese_corpus

Large Scale Chinese Corpus for NLP

brightmart
โญ 9,937 ๐Ÿ‘ค brightmart User ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2019-02-08
9
fishaudio/Bert-VITS2

vits2 backbone with multilingual-bert

fishaudio
โญ 8,804 Python ๐Ÿ‘ค fishaudio Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-07-29
10
jessevig/bertviz

BertViz: Visualize Attention in Transformer Models

jessevig
โญ 8,220 Python ๐Ÿ‘ค jessevig User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2018-12-16
11
MaartenGr/BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

MaartenGr
โญ 7,966 Python ๐Ÿ‘ค MaartenGr User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2020-09-22
12
NVIDIA/FasterTransformer

Transformer related optimization, including BERT, GPT

NVIDIA
โญ 6,376 C++ ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2024-03-27 ๐Ÿ“… Created 2021-04-02
13
lonePatient/awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models, High-Quality Chinese Pretrained Models & Large Models & Multimodal Models & Large Language Models Collection

lonePatient
โญ 5,618 Python ๐Ÿ‘ค lonePatient User ๐Ÿ• Updated 2026-08-30 ๐Ÿ“… Created 2019-05-25
14
Turing-Project/WriteGPT

Developed by Turing's Cat, the first generation of creative AI, based on open-source GPT2.0 | Scalable, evolvable

Turing-Project
โญ 5,318 Python ๐Ÿ‘ค Turing-Project Organization ๐Ÿ• Updated 2024-03-31 ๐Ÿ“… Created 2020-09-29
15
bentrevett/pytorch-sentiment-analysis

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

bentrevett
โญ 4,573 Jupyter Notebook ๐Ÿ‘ค bentrevett User ๐Ÿ• Updated 2024-03-27 ๐Ÿ“… Created 2017-12-13
16
CLUEbenchmark/CLUE

Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

CLUEbenchmark
โญ 4,288 Python ๐Ÿ‘ค CLUEbenchmark Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2019-11-22
17
MaartenGr/KeyBERT

Minimal keyword extraction with BERT

MaartenGr
โญ 4,225 Python ๐Ÿ‘ค MaartenGr User ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2020-10-22
18
JohnSnowLabs/spark-nlp

State of the Art Natural Language Processing

JohnSnowLabs
โญ 4,162 Scala ๐Ÿ‘ค JohnSnowLabs Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2017-09-24
19
km1994/nlp_paper_study

This repository primarily contains notes on studying top-conference papers related to NLP algorithm engineers.

km1994
โญ 4,035 C++ ๐Ÿ‘ค km1994 User ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2019-05-18
20
yuanzhoulvpi2017/zero_nlp

Chinese NLP Solutions (Large Models, Data, Models, Training, Inference)

yuanzhoulvpi2017
โญ 3,832 Jupyter Notebook ๐Ÿ‘ค yuanzhoulvpi2017 User ๐Ÿ• Updated 2025-08-05 ๐Ÿ“… Created 2023-02-05
21
christianversloot/machine-learning-articles

๐Ÿง ๐Ÿ’ฌ Articles I wrote about machine learning, archived from MachineCurve.com.

christianversloot
โญ 3,665 ๐Ÿ‘ค christianversloot User ๐Ÿ• Updated 2024-06-28 ๐Ÿ“… Created 2022-02-15
22
ben1234560/AiLearning-Theory-Applying

Quick start to AI theory and applied practice: basic knowledge, Transformer, NLP, ML, DL, competitions. Includes abundant annotations and datasets, striving for everyone to understand and reproduce.

ben1234560
โญ 3,592 Jupyter Notebook ๐Ÿ‘ค ben1234560 User ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2020-10-25
23
PaddlePaddle/awesome-DeepLearning

Deep Learning introductory courses, advanced courses, featured courses, academic cases, industry practice cases, deep learning knowledge encyclopedia and interview question bank The course, case and knowledge of Deep Learning and AI

PaddlePaddle
โญ 3,541 Jupyter Notebook ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-12-11
24
ddangelov/Top2Vec

Top2Vec learns jointly embedded topic, document and word vectors.

ddangelov
โญ 3,107 Python ๐Ÿ‘ค ddangelov User ๐Ÿ• Updated 2024-11-14 ๐Ÿ“… Created 2020-03-20
25
dbiir/UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

dbiir
โญ 3,102 Python ๐Ÿ‘ค dbiir Organization ๐Ÿ• Updated 2024-05-09 ๐Ÿ“… Created 2019-04-10
26
guillaume-be/rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2, ...)

guillaume-be
โญ 3,092 Rust ๐Ÿ‘ค guillaume-be User ๐Ÿ• Updated 2026-01-13 ๐Ÿ“… Created 2020-01-25
27
CVI-SZU/Linly

Chinese-LLaMA 1&2, Chinese-Falcon base models; ChatFlow Chinese dialogue model; Chinese OpenLLaMA model; NLP pre-training/instruction fine-tuning datasets

CVI-SZU
โญ 3,057 Python ๐Ÿ‘ค CVI-SZU Organization ๐Ÿ• Updated 2024-04-14 ๐Ÿ“… Created 2023-03-21
28
datawhalechina/learn-nlp-with-transformers

we want to create a repo to illustrate usage of transformers in chinese

datawhalechina
โญ 3,050 Shell ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2024-08-18 ๐Ÿ“… Created 2021-04-11
29
adapter-hub/adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

adapter-hub
โญ 2,832 Python ๐Ÿ‘ค adapter-hub Organization ๐Ÿ• Updated 2026-04-26 ๐Ÿ“… Created 2020-04-21
30
brightmart/roberta_zh

RoBERTa Chinese Pre-trained Model: RoBERTa for Chinese

brightmart
โญ 2,765 Python ๐Ÿ‘ค brightmart User ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2019-09-02
31
curiousily/Getting-Things-Done-with-Pytorch

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BER

curiousily
โญ 2,478 Jupyter Notebook ๐Ÿ‘ค curiousily User ๐Ÿ• Updated 2024-06-30 ๐Ÿ“… Created 2020-01-31
32
asyml/texar

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

asyml
โญ 2,391 Python ๐Ÿ‘ค asyml Organization ๐Ÿ• Updated 2026-07-21 ๐Ÿ“… Created 2017-07-22
33
BrikerMan/Kashgari

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

BrikerMan
โญ 2,387 Python ๐Ÿ‘ค BrikerMan User ๐Ÿ• Updated 2024-09-03 ๐Ÿ“… Created 2019-01-19
34
beir-cellar/beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

beir-cellar
โญ 2,310 Python ๐Ÿ‘ค beir-cellar Organization ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2021-01-18
35
namisan/mt-dnn

Multi-Task Deep Neural Networks for Natural Language Understanding

namisan
โญ 2,257 Python ๐Ÿ‘ค namisan User ๐Ÿ• Updated 2024-03-07 ๐Ÿ“… Created 2019-02-19
36
alibaba/EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

alibaba
โญ 2,180 Python ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2024-11-27 ๐Ÿ“… Created 2022-04-06
37
alibaba/AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine Intelligence of Damo) Lab

alibaba
โญ 2,049 Python ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2024-03-19 ๐Ÿ“… Created 2021-05-21
38
hila-chefer/Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

hila-chefer
โญ 1,967 Jupyter Notebook ๐Ÿ‘ค hila-chefer User ๐Ÿ• Updated 2024-01-24 ๐Ÿ“… Created 2020-11-23
39
appvision-ai/fast-bert

Super easy library for BERT based NLP models

appvision-ai
โญ 1,915 Python ๐Ÿ‘ค appvision-ai Organization ๐Ÿ• Updated 2024-08-19 ๐Ÿ“… Created 2019-04-18
40
jsksxs360/How-to-use-Transformers

Transformers Library Quick Start Tutorial

jsksxs360
โญ 1,892 Python ๐Ÿ‘ค jsksxs360 User ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2022-09-19
41
nlpodyssey/spago

Self-contained Machine Learning and Natural Language Processing library in Go

nlpodyssey
โญ 1,850 Go ๐Ÿ‘ค nlpodyssey Organization ๐Ÿ• Updated 2025-04-01 ๐Ÿ“… Created 2020-01-05
42
yongzhuo/Keras-TextClassification

Chinese long text classification, short sentence classification, multi-label classification, two-sentence similarity (Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short), character/word/sentence vector embedding layer (embeddings) and network layer (graph) construction base class, FastText, TextCNN, CharCNN, TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, Capsule Network-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

yongzhuo
โญ 1,810 Python ๐Ÿ‘ค yongzhuo User ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2019-06-13
43
AnswerDotAI/ModernBERT

Bringing BERT into modernity via both architecture changes and scaling

AnswerDotAI
โญ 1,784 Python ๐Ÿ‘ค AnswerDotAI Organization ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2024-05-13
44
lihanghang/NLP-Knowledge-Graph

Tracking, researching, and applying cutting-edge technologies such as natural language processing, knowledge graphs, large language models, and agents.

lihanghang
โญ 1,778 JavaScript ๐Ÿ‘ค lihanghang User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2019-01-29
45
PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

PaddlePaddle
โญ 1,613 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-01-04 ๐Ÿ“… Created 2019-12-16
46
Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Tencent
โญ 1,546 C++ ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2025-07-18 ๐Ÿ“… Created 2020-04-20
47
honeyandme/RAGQnASystem

This project designed and implemented an intelligent medical Q&A system based on Knowledge Graph RAG and Large Language Models. Built upon the DiseaseKG medical dataset and utilizing Neo4j, the system constructs a domain-specific knowledge graph containing 44,000 entities and 310,000 relationships. By combining BERT-based named entity recognition with 32B model-based intent recognition, the system effectively mitigates hallucinations in medical scenarios through precise graph retrieval and controlled answer generation, significantly enhancing the accuracy and reliability of the responses.

honeyandme
โญ 1,510 Jupyter Notebook ๐Ÿ‘ค honeyandme User ๐Ÿ• Updated 2026-05-29 ๐Ÿ“… Created 2024-05-16
48
ymcui/Chinese-ELECTRA

Pre-trained Chinese ELECTRA (ELECTRA pre-trained model Chinese)

ymcui
โญ 1,433 Python ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2020-03-23
49
SKTBrain/KoBERT

Korean BERT pre-trained cased (KoBERT)

SKTBrain
โญ 1,411 Python ๐Ÿ‘ค SKTBrain Organization ๐Ÿ• Updated 2025-06-14 ๐Ÿ“… Created 2019-09-23
50
explosion/spacy-transformers

๐Ÿ›ธ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

explosion
โญ 1,411 Python ๐Ÿ‘ค explosion Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2019-07-26

Frequently Asked Questions

1

What is the most popular #bert repository on GitHub?

The top ranked open source #bert project on GitHub is datawhalechina/leedl-tutorial with 16,879 stars. ใ€ŠHung-yi Lee Deep Learning Tutorialใ€‹(Recommended by Professor Hung-yi Lee ๐Ÿ‘, Apple Books ๐ŸŽ), PDF Download Link: https://github.com/datawhalechina/leedl-tutorial/releases

2

Which programming languages are most used in #bert repositories?

Among the top ranked #bert projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, Rust.

3

How is the #bert repository ranking calculated?

We track 109 active open source repositories tagged with #bert (500+ stars), totaling 287,319 stars with an average of 2,635 stars per repository. Rankings update daily from the GitHub API.