#commoncrawl Repositories
Discover 2 active open source GitHub repositories tagged with #commoncrawl, accumulating 7,491 total stars (averaging 3,745 stars per project). Leading this topic is togethercomputer/RedPajama-Data with 4,997 stars.
2 repositories total
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
news-please - an integrated web crawler and information extractor for news that just works
Frequently Asked Questions
What is the most popular #commoncrawl repository on GitHub?
The top ranked open source #commoncrawl project on GitHub is togethercomputer/RedPajama-Data with 4,997 stars. The RedPajama-Data repository contains code for preparing large datasets for training large language models.
Which programming languages are most used in #commoncrawl repositories?
Among the top ranked #commoncrawl projects on GitHub, the most common programming languages are Python.
How is the #commoncrawl repository ranking calculated?
We track 2 active open source repositories tagged with #commoncrawl (500+ stars), totaling 7,491 stars with an average of 3,745 stars per repository. Rankings update daily from the GitHub API.