Git Stars Git Stars

#roberta Repositories

Discover 19 active open source GitHub repositories tagged with #roberta, accumulating 61,557 total stars (averaging 3,239 stars per project). Leading this topic is microsoft/LoRA with 13,111 stars.

19
Total Repositories
61,557
Total Stars
3,239
Avg Stars/Repo
Programming Languages: Python Rust C++
1
microsoft/LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

microsoft
โญ 13,111 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-12-17 ๐Ÿ“… Created 2021-06-18
2
ymcui/Chinese-BERT-wwm

Pre-Training with Whole Word Masking for Chinese BERT (Chinese BERT-wwm Series Models)

ymcui
โญ 10,232 Python ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2019-06-19
3
jessevig/bertviz

BertViz: Visualize Attention in Transformer Models

jessevig
โญ 8,220 Python ๐Ÿ‘ค jessevig User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2018-12-16
4
lonePatient/awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models, High-Quality Chinese Pretrained Models & Large Models & Multimodal Models & Large Language Models Collection

lonePatient
โญ 5,618 Python ๐Ÿ‘ค lonePatient User ๐Ÿ• Updated 2026-08-30 ๐Ÿ“… Created 2019-05-25
5
CLUEbenchmark/CLUE

Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

CLUEbenchmark
โญ 4,288 Python ๐Ÿ‘ค CLUEbenchmark Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2019-11-22
6
dbiir/UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

dbiir
โญ 3,102 Python ๐Ÿ‘ค dbiir Organization ๐Ÿ• Updated 2024-05-09 ๐Ÿ“… Created 2019-04-10
7
guillaume-be/rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2, ...)

guillaume-be
โญ 3,092 Rust ๐Ÿ‘ค guillaume-be User ๐Ÿ• Updated 2026-01-13 ๐Ÿ“… Created 2020-01-25
8
brightmart/roberta_zh

RoBERTa Chinese Pre-trained Model: RoBERTa for Chinese

brightmart
โญ 2,765 Python ๐Ÿ‘ค brightmart User ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2019-09-02
9
fhamborg/news-please

news-please - an integrated web crawler and information extractor for news that just works

fhamborg
โญ 2,494 Python ๐Ÿ‘ค fhamborg User ๐Ÿ• Updated 2026-04-14 ๐Ÿ“… Created 2016-12-18
10
Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Tencent
โญ 1,546 C++ ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2025-07-18 ๐Ÿ“… Created 2020-04-20
11
Tencent/TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Tencent
โญ 1,086 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2024-08-04 ๐Ÿ“… Created 2022-09-26
12
CLUEbenchmark/CLUECorpus2020

Large-scale Pre-Training Corpus for Chinese 100G ไธญๆ–‡้ข„่ฎญ็ปƒ่ฏญๆ–™

CLUEbenchmark
โญ 1,022 ๐Ÿ‘ค CLUEbenchmark Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2020-01-25
13
grammarly/gector

Official implementation of the papers "GECToR โ€“ Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)"

grammarly
โญ 944 Python ๐Ÿ‘ค grammarly Organization ๐Ÿ• Updated 2024-05-21 ๐Ÿ“… Created 2020-05-21
14
explosion/curated-transformers

A PyTorch library of curated Transformer models and their composable components

explosion
โญ 894 Python ๐Ÿ‘ค explosion Organization ๐Ÿ• Updated 2024-04-17 ๐Ÿ“… Created 2022-09-14
15
VinAIResearch/PhoBERT

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

VinAIResearch
โญ 811 ๐Ÿ‘ค VinAIResearch Organization ๐Ÿ• Updated 2026-08-04 ๐Ÿ“… Created 2020-03-03
16
KLUE-benchmark/KLUE

๐Ÿ“– Korean NLU Benchmark

KLUE-benchmark
โญ 606 ๐Ÿ‘ค KLUE-benchmark Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2020-11-16
17
VinAIResearch/BERTweet

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

VinAIResearch
โญ 602 Python ๐Ÿ‘ค VinAIResearch Organization ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2020-05-06
18
codelion/adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

codelion
โญ 577 Python ๐Ÿ‘ค codelion User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-01-12
19
EricFillion/happy-transformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

EricFillion
โญ 547 Python ๐Ÿ‘ค EricFillion User ๐Ÿ• Updated 2026-01-10 ๐Ÿ“… Created 2019-10-06

Frequently Asked Questions

1

What is the most popular #roberta repository on GitHub?

The top ranked open source #roberta project on GitHub is microsoft/LoRA with 13,111 stars. Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

2

Which programming languages are most used in #roberta repositories?

Among the top ranked #roberta projects on GitHub, the most common programming languages are Python, Rust, C++.

3

How is the #roberta repository ranking calculated?

We track 19 active open source repositories tagged with #roberta (500+ stars), totaling 61,557 stars with an average of 3,239 stars per repository. Rankings update daily from the GitHub API.