Git Stars Git Stars

#large-scale-data-processing Repositories

Discover 5 active open source GitHub repositories tagged with #large-scale-data-processing, accumulating 21,718 total stars (averaging 4,343 stars per project). Leading this topic is google-deepmind/alphafold with 14,950 stars.

5
Total Repositories
21,718
Total Stars
4,343
Avg Stars/Repo
Programming Languages: Python HTML C++
1
google-deepmind/alphafold

Open source code for AlphaFold 2.

google-deepmind
โญ 14,950 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2026-04-22 ๐Ÿ“… Created 2021-06-17
2
huggingface/datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

huggingface
โญ 3,428 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-06-14
3
NVIDIA-NeMo/Curator

Scalable data pre processing and curation toolkit for LLMs

NVIDIA-NeMo
โญ 1,866 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-03-14
4
data-prep-kit/data-prep-kit

Open source project for data preparation for GenAI applications

data-prep-kit
โญ 968 HTML ๐Ÿ‘ค data-prep-kit Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2024-04-08
5
m-schuetz/SimLOD

Simultaneous LOD Generation and Rendering for Point Clouds

m-schuetz
โญ 510 C++ ๐Ÿ‘ค m-schuetz User ๐Ÿ• Updated 2024-09-05 ๐Ÿ“… Created 2023-10-05

Frequently Asked Questions

1

What is the most popular #large-scale-data-processing repository on GitHub?

The top ranked open source #large-scale-data-processing project on GitHub is google-deepmind/alphafold with 14,950 stars. Open source code for AlphaFold 2.

2

Which programming languages are most used in #large-scale-data-processing repositories?

Among the top ranked #large-scale-data-processing projects on GitHub, the most common programming languages are Python, HTML, C++.

3

How is the #large-scale-data-processing repository ranking calculated?

We track 5 active open source repositories tagged with #large-scale-data-processing (500+ stars), totaling 21,718 stars with an average of 4,343 stars per repository. Rankings update daily from the GitHub API.