Git Stars Git Stars

#pre-trained-model Repositories

Discover 10 active open source GitHub repositories tagged with #pre-trained-model, accumulating 35,819 total stars (averaging 3,581 stars per project). Leading this topic is microsoft/unilm with 22,247 stars.

10
Total Repositories
35,819
Total Stars
3,581
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
microsoft/unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

microsoft
โญ 22,247 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-09-21 ๐Ÿ“… Created 2019-07-23
2
thunlp/OpenPrompt

An Open-Source Framework for Prompt-Learning.

thunlp
โญ 4,792 Python ๐Ÿ‘ค thunlp Organization ๐Ÿ• Updated 2024-07-16 ๐Ÿ“… Created 2021-09-30
3
ymcui/Chinese-ELECTRA

Pre-trained Chinese ELECTRA (ELECTRA pre-trained model Chinese)

ymcui
โญ 1,433 Python ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2020-03-23
4
zjunlp/KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

zjunlp
โญ 1,387 Python ๐Ÿ‘ค zjunlp Organization ๐Ÿ• Updated 2025-01-11 ๐Ÿ“… Created 2023-04-01
5
keyu-tian/SparK

[ICLR'23 Spotlight๐Ÿ”ฅ] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

keyu-tian
โญ 1,363 Python ๐Ÿ‘ค keyu-tian User ๐Ÿ• Updated 2024-01-23 ๐Ÿ“… Created 2023-01-05
6
zjunlp/KnowledgeEditingPapers

Must-read Papers on Knowledge Editing for Large Language Models.

zjunlp
โญ 1,257 ๐Ÿ‘ค zjunlp Organization ๐Ÿ• Updated 2026-08-20 ๐Ÿ“… Created 2022-12-06
7
deepmodeling/Uni-Mol

Official Repository for the Uni-Mol Series Methods

deepmodeling
โญ 1,112 Python ๐Ÿ‘ค deepmodeling Organization ๐Ÿ• Updated 2025-05-29 ๐Ÿ“… Created 2022-05-22
8
NVlabs/FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

NVlabs
โญ 921 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2025-07-22 ๐Ÿ“… Created 2023-05-19
9
MrGiovanni/ModelsGenesis

[MICCAI 2019 Young Scientist Award] [MedIA Best Paper Award] Models Genesis: self-supervised pre-training for 3D medical images. Learns transferable representations from unlabeled CT and MRI volumes, then fine-tunes for downstream segmentation and classification. Keras and PyTorch weights included.

MrGiovanni
โญ 796 Jupyter Notebook ๐Ÿ‘ค MrGiovanni User ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2019-07-24
10
mims-harvard/TFC-pretraining

Self-supervised contrastive learning for time series via time-frequency consistency

mims-harvard
โญ 510 Python ๐Ÿ‘ค mims-harvard Organization ๐Ÿ• Updated 2024-05-07 ๐Ÿ“… Created 2022-03-12

Frequently Asked Questions

1

What is the most popular #pre-trained-model repository on GitHub?

The top ranked open source #pre-trained-model project on GitHub is microsoft/unilm with 22,247 stars. Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

2

Which programming languages are most used in #pre-trained-model repositories?

Among the top ranked #pre-trained-model projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #pre-trained-model repository ranking calculated?

We track 10 active open source repositories tagged with #pre-trained-model (500+ stars), totaling 35,819 stars with an average of 3,581 stars per repository. Rankings update daily from the GitHub API.