Git Stars Git Stars

#large-scale-data Repositories

Discover 8 active open source GitHub repositories tagged with #large-scale-data, accumulating 54,846 total stars (averaging 6,855 stars per project). Leading this topic is facebookresearch/faiss with 41,842 stars.

8
Total Repositories
54,846
Total Stars
6,855
Avg Stars/Repo
1
facebookresearch/faiss

A library for efficient similarity search and clustering of dense vectors.

facebookresearch
โญ 41,842 C++ ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2017-02-07
2
togethercomputer/RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

togethercomputer
โญ 4,997 Python ๐Ÿ‘ค togethercomputer Organization ๐Ÿ• Updated 2026-06-03 ๐Ÿ“… Created 2023-04-14
3
gabrielpetersson/fast-grid

World's most performant DOM-based web table. Try it! fast-grid.vercel.app/

gabrielpetersson
โญ 2,204 TypeScript ๐Ÿ‘ค gabrielpetersson User ๐Ÿ• Updated 2024-10-31 ๐Ÿ“… Created 2023-04-28
4
openai/Video-Pre-Training

Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos

openai
โญ 1,740 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2025-09-03 ๐Ÿ“… Created 2022-06-22
5
Activision/caldera

Caldera data set from Call of Dutyยฎ: Warzoneโ„ข

Activision
โญ 1,214 Python ๐Ÿ‘ค Activision Organization ๐Ÿ• Updated 2025-04-29 ๐Ÿ“… Created 2024-07-26
6
lolishinshi/imsearch

Large-scale similar image search based on feature point matching

lolishinshi
โญ 1,132 Rust ๐Ÿ‘ค lolishinshi Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2021-09-09
7
dask/dask-ml

Scalable Machine Learning with Dask

dask
โญ 950 Python ๐Ÿ‘ค dask Organization ๐Ÿ• Updated 2025-09-27 ๐Ÿ“… Created 2017-06-15
8
mlfoundations/datacomp

DataComp: In search of the next generation of multimodal datasets

mlfoundations
โญ 780 Python ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2025-04-28 ๐Ÿ“… Created 2023-04-28

Frequently Asked Questions

1

What is the most popular #large-scale-data repository on GitHub?

The top ranked open source #large-scale-data project on GitHub is facebookresearch/faiss with 41,842 stars. A library for efficient similarity search and clustering of dense vectors.

2

Which programming languages are most used in #large-scale-data repositories?

Among the top ranked #large-scale-data projects on GitHub, the most common programming languages are Python, C++, TypeScript, Rust.

3

How is the #large-scale-data repository ranking calculated?

We track 8 active open source repositories tagged with #large-scale-data (500+ stars), totaling 54,846 stars with an average of 6,855 stars per repository. Rankings update daily from the GitHub API.