Git Stars Git Stars

#commoncrawl Repositories

Discover 2 active open source GitHub repositories tagged with #commoncrawl, accumulating 7,491 total stars (averaging 3,745 stars per project). Leading this topic is togethercomputer/RedPajama-Data with 4,997 stars.

2
Total Repositories
7,491
Total Stars
3,745
Avg Stars/Repo
Programming Languages: Python

2 repositories total

1
togethercomputer/RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

togethercomputer
⭐ 4,997 Python 👤 togethercomputer Organization 🕐 Updated 2026-06-03 📅 Created 2023-04-14
2
fhamborg/news-please

news-please - an integrated web crawler and information extractor for news that just works

fhamborg
⭐ 2,494 Python 👤 fhamborg User 🕐 Updated 2026-04-14 📅 Created 2016-12-18

Frequently Asked Questions

1

What is the most popular #commoncrawl repository on GitHub?

The top ranked open source #commoncrawl project on GitHub is togethercomputer/RedPajama-Data with 4,997 stars. The RedPajama-Data repository contains code for preparing large datasets for training large language models.

2

Which programming languages are most used in #commoncrawl repositories?

Among the top ranked #commoncrawl projects on GitHub, the most common programming languages are Python.

3

How is the #commoncrawl repository ranking calculated?

We track 2 active open source repositories tagged with #commoncrawl (500+ stars), totaling 7,491 stars with an average of 3,745 stars per repository. Rankings update daily from the GitHub API.