Git Stars Git Stars

#bert Repositories

109
Total Repositories
287,319
Total Stars
2,635
Avg Stars/Repo
51
keyu-tian/SparK

[ICLR'23 Spotlight๐Ÿ”ฅ] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

keyu-tian
โญ 1,363 Python ๐Ÿ‘ค keyu-tian User ๐Ÿ• Updated 2024-01-23 ๐Ÿ“… Created 2023-01-05
52
synrc/n2o

โญ• N2O: Distributed WebSocket Application Server ISO 20922

synrc
โญ 1,340 Erlang ๐Ÿ‘ค synrc Organization ๐Ÿ• Updated 2026-06-04 ๐Ÿ“… Created 2013-03-29
53
Tongjilibo/bert4torch

An elegent pytorch implement of transformers

Tongjilibo
โญ 1,323 Python ๐Ÿ‘ค Tongjilibo User ๐Ÿ• Updated 2026-05-16 ๐Ÿ“… Created 2022-03-12
54
unitaryai/detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using โšก PyTorch Lightning and ๐Ÿค— Transformers.

unitaryai
โญ 1,320 Python ๐Ÿ‘ค unitaryai Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2020-09-23
55
DengBoCong/nlp-paper

Relevant papers in the field of Natural Language Processing (with reading notes), model reproduction, and data processing (code includes both TensorFlow and PyTorch versions)

DengBoCong
โญ 1,314 Python ๐Ÿ‘ค DengBoCong User ๐Ÿ• Updated 2024-01-05 ๐Ÿ“… Created 2020-09-05
56
nlpyang/PreSumm

code for EMNLP 2019 paper Text Summarization with Pretrained Encoders

nlpyang
โญ 1,304 Python ๐Ÿ‘ค nlpyang User ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-08-15
57
NVIDIA-Merlin/Transformers4Rec

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

NVIDIA-Merlin
โญ 1,283 Python ๐Ÿ‘ค NVIDIA-Merlin Organization ๐Ÿ• Updated 2026-08-23 ๐Ÿ“… Created 2021-04-14
58
MilaNLProc/contextualized-topic-models

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

MilaNLProc
โญ 1,272 Python ๐Ÿ‘ค MilaNLProc Organization ๐Ÿ• Updated 2025-07-24 ๐Ÿ“… Created 2020-04-04
59
unum-cloud/UForm

Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions ๐Ÿ–ผ๏ธ

unum-cloud
โญ 1,253 Cuda ๐Ÿ‘ค unum-cloud Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-02-21
60
PlayVoice/vits_chinese

Best practice TTS based on BERT and VITS with some Natural Speech Features Of Microsoft; Support ONNX streaming out!

PlayVoice
โญ 1,224 Python ๐Ÿ‘ค PlayVoice Organization ๐Ÿ• Updated 2024-02-05 ๐Ÿ“… Created 2021-09-27
61
openvinotoolkit/nncf

Neural Network Compression Framework for enhanced OpenVINOโ„ข inference

openvinotoolkit
โญ 1,221 Python ๐Ÿ‘ค openvinotoolkit Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2020-05-13
62
ashishpatel26/Treasure-of-Transformers

๐Ÿ’ Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. ๐Ÿ›ซโ˜‘๏ธ

ashishpatel26
โญ 1,168 Jupyter Notebook ๐Ÿ‘ค ashishpatel26 User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2021-12-13
63
datawhalechina/base-llm

Full-stack algorithm tutorial from NLP to LLM, online reading address: https://datawhalechina.github.io/base-llm/

datawhalechina
โญ 1,150 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2025-08-19
64
cedrickchee/awesome-transformer-nlp

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

cedrickchee
โญ 1,124 ๐Ÿ‘ค cedrickchee User ๐Ÿ• Updated 2024-10-27 ๐Ÿ“… Created 2019-01-13
65
Tencent/TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Tencent
โญ 1,086 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2024-08-04 ๐Ÿ“… Created 2022-09-26
66
CLUEbenchmark/CLUECorpus2020

Large-scale Pre-Training Corpus for Chinese 100G ไธญๆ–‡้ข„่ฎญ็ปƒ่ฏญๆ–™

CLUEbenchmark
โญ 1,022 ๐Ÿ‘ค CLUEbenchmark Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2020-01-25
67
GaoQ1/rasa_chatbot_cn

Building a Chinese dialogue system based on the newest version of rasa(Building a dialogue system based on the latest version of rasa)

GaoQ1
โญ 985 Python ๐Ÿ‘ค GaoQ1 User ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2018-08-16
68
shibing624/textgen

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. Text generation models, implemented training and prediction of models including LLaMA, ChatGLM, BLOOM, GPT2, Seq2Seq, BART, T5, UDA, etc., ready to use.

shibing624
โญ 981 Python ๐Ÿ‘ค shibing624 User ๐Ÿ• Updated 2024-09-14 ๐Ÿ“… Created 2021-04-07
69
naver/splade

SPLADE: sparse neural search (SIGIR21, SIGIR22)

naver
โญ 960 Python ๐Ÿ‘ค naver Organization ๐Ÿ• Updated 2024-05-03 ๐Ÿ“… Created 2021-07-14
70
Denis2054/Transformers-for-NLP-2nd-Edition

Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI, HuggingGPT, and more.

Denis2054
โญ 948 Jupyter Notebook ๐Ÿ‘ค Denis2054 User ๐Ÿ• Updated 2024-01-04 ๐Ÿ“… Created 2022-03-03
71
grammarly/gector

Official implementation of the papers "GECToR โ€“ Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)"

grammarly
โญ 944 Python ๐Ÿ‘ค grammarly Organization ๐Ÿ• Updated 2024-05-21 ๐Ÿ“… Created 2020-05-21
72
explosion/curated-transformers

A PyTorch library of curated Transformer models and their composable components

explosion
โญ 894 Python ๐Ÿ‘ค explosion Organization ๐Ÿ• Updated 2024-04-17 ๐Ÿ“… Created 2022-09-14
73
abhimishra91/transformers-tutorials

Github repo with tutorials to fine tune transformers for diff NLP tasks

abhimishra91
โญ 857 Jupyter Notebook ๐Ÿ‘ค abhimishra91 User ๐Ÿ• Updated 2024-04-01 ๐Ÿ“… Created 2020-05-04
74
neuralmind-ai/portuguese-bert

Portuguese pre-trained BERT models

neuralmind-ai
โญ 853 Python ๐Ÿ‘ค neuralmind-ai Organization ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2020-01-14
75
VinAIResearch/PhoBERT

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

VinAIResearch
โญ 811 ๐Ÿ‘ค VinAIResearch Organization ๐Ÿ• Updated 2026-08-04 ๐Ÿ“… Created 2020-03-03
76
MaartenGr/PolyFuzz

Fuzzy string matching, grouping, and evaluation.

MaartenGr
โญ 800 Python ๐Ÿ‘ค MaartenGr User ๐Ÿ• Updated 2025-07-10 ๐Ÿ“… Created 2020-11-21
77
hellonlp/classifier-multi-label

Multi-label text classification, multi-label classification, text classification, multi-label, classifier, text classification, BERT, seq2seq, attention, multi-label-classification

hellonlp
โญ 800 Python ๐Ÿ‘ค hellonlp User ๐Ÿ• Updated 2024-12-11 ๐Ÿ“… Created 2020-07-13
78
yao8839836/kg-bert

KG-BERT: BERT for Knowledge Graph Completion

yao8839836
โญ 796 Python ๐Ÿ‘ค yao8839836 User ๐Ÿ• Updated 2025-07-23 ๐Ÿ“… Created 2019-09-04
79
Tencent/PatrickStar

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Tencent
โญ 772 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2025-11-18 ๐Ÿ“… Created 2021-04-02
80
Ricardokevins/Bert-In-Relation-Extraction

Extracting relationships between entities using Bert

Ricardokevins
โญ 751 Python ๐Ÿ‘ค Ricardokevins User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-10-24
81
primeqa/primeqa

The prime repository for state-of-the-art Multilingual Question Answering research and development.

primeqa
โญ 739 Python ๐Ÿ‘ค primeqa Organization ๐Ÿ• Updated 2025-09-18 ๐Ÿ“… Created 2022-06-15
82
ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

ghimiresunil
โญ 734 Jupyter Notebook ๐Ÿ‘ค ghimiresunil User ๐Ÿ• Updated 2026-03-13 ๐Ÿ“… Created 2023-05-28
83
ymcui/MacBERT

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

ymcui
โญ 728 ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2020-09-22
84
moein-shariatnia/OpenAI-CLIP

Simple implementation of OpenAI CLIP model in PyTorch.

moein-shariatnia
โญ 727 Jupyter Notebook ๐Ÿ‘ค moein-shariatnia User ๐Ÿ• Updated 2025-10-18 ๐Ÿ“… Created 2021-04-07
85
monologg/JointBERT

Pytorch implementation of JointBERT: "BERT for Joint Intent Classification and Slot Filling"

monologg
โญ 727 Python ๐Ÿ‘ค monologg User ๐Ÿ• Updated 2024-01-11 ๐Ÿ“… Created 2019-11-14
86
IndicoDataSolutions/finetune

Scikit-learn style model finetuning for NLP

IndicoDataSolutions
โญ 719 Python ๐Ÿ‘ค IndicoDataSolutions Organization ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2018-06-12
87
onejune2018/Awesome-LLM-Eval

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. A curated list of tools, benchmarks/datasets, demos, leaderboards, and large models, primarily focused on the evaluation of foundation large models, aiming to explore the technological boundaries of generative AI.

onejune2018
โญ 661 ๐Ÿ‘ค onejune2018 User ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-04-26
88
IndoNLP/indonlu

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

IndoNLP
โญ 635 Jupyter Notebook ๐Ÿ‘ค IndoNLP Organization ๐Ÿ• Updated 2024-11-16 ๐Ÿ“… Created 2020-09-12
89
KRLabsOrg/LettuceDetect

Span-level grounding verification for RAG, code, and tool-grounded AI outputs.

KRLabsOrg
โญ 627 Python ๐Ÿ‘ค KRLabsOrg Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-02-05
90
KLUE-benchmark/KLUE

๐Ÿ“– Korean NLU Benchmark

KLUE-benchmark
โญ 606 ๐Ÿ‘ค KLUE-benchmark Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2020-11-16
โญ 603 Python ๐Ÿ‘ค google-research Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2019-10-31
92
VinAIResearch/BERTweet

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

VinAIResearch
โญ 602 Python ๐Ÿ‘ค VinAIResearch Organization ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2020-05-06
93
mlwithme/BertWithPretrained

An implementation of the BERT model and its related downstream tasks based on the PyTorch framework. @่ทŸๆˆ‘ๅญฆๆœบๅ™จๅญฆไน 

mlwithme
โญ 601 Python ๐Ÿ‘ค mlwithme User ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2021-08-10
94
PacktPublishing/Transformers-for-Natural-Language-Processing

Transformers for Natural Language Processing, published by Packt

PacktPublishing
โญ 594 Jupyter Notebook ๐Ÿ‘ค PacktPublishing Organization ๐Ÿ• Updated 2026-03-02 ๐Ÿ“… Created 2021-01-18
โญ 593 ๐Ÿ‘ค changwookjun User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2019-05-21
96
ukairia777/tensorflow-nlp-tutorial

A Deep Learning NLP repository that summarizes text preprocessing, Topic Models, and downstream tasks of state-of-the-art models such as BERT, GPT, and LLMs using TensorFlow.

ukairia777
โญ 580 Jupyter Notebook ๐Ÿ‘ค ukairia777 User ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2021-12-30
97
codelion/adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

codelion
โญ 577 Python ๐Ÿ‘ค codelion User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-01-12
98
stefan-it/turkish-bert

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models

stefan-it
โญ 576 Python ๐Ÿ‘ค stefan-it User ๐Ÿ• Updated 2025-03-04 ๐Ÿ“… Created 2020-02-02
99
Afool4U/MIGPT

Low-latency version of MIGPT based on API streaming dialogues

Afool4U
โญ 574 Python ๐Ÿ‘ค Afool4U User ๐Ÿ• Updated 2025-06-01 ๐Ÿ“… Created 2023-03-13
100
hellotransformers/Natural_Language_Processing_with_Transformers

Natural Language Processing with Transformers Chinese translation, the most authoritative Transformers tutorial

hellotransformers
โญ 574 ๐Ÿ‘ค hellotransformers Organization ๐Ÿ• Updated 2025-02-25 ๐Ÿ“… Created 2022-02-12