Git Stars Git Stars

#semantic-deduplication Repositories

Discover 2 active open source GitHub repositories tagged with #semantic-deduplication, accumulating 2,844 total stars (averaging 1,422 stars per project). Leading this topic is NVIDIA-NeMo/Curator with 1,866 stars.

2
Total Repositories
2,844
Total Stars
1,422
Avg Stars/Repo
Programming Languages: Python

2 repositories total

1
NVIDIA-NeMo/Curator

Scalable data pre processing and curation toolkit for LLMs

NVIDIA-NeMo
⭐ 1,866 Python 👤 NVIDIA-NeMo Organization 🕐 Updated 2026-11-19 📅 Created 2024-03-14
2
MinishLab/semhash

Fast Multimodal Semantic Deduplication & Filtering

MinishLab
⭐ 979 Python 👤 MinishLab Organization 🕐 Updated 2026-11-11 📅 Created 2024-10-13

Frequently Asked Questions

1

What is the most popular #semantic-deduplication repository on GitHub?

The top ranked open source #semantic-deduplication project on GitHub is NVIDIA-NeMo/Curator with 1,866 stars. Scalable data pre processing and curation toolkit for LLMs

2

Which programming languages are most used in #semantic-deduplication repositories?

Among the top ranked #semantic-deduplication projects on GitHub, the most common programming languages are Python.

3

How is the #semantic-deduplication repository ranking calculated?

We track 2 active open source repositories tagged with #semantic-deduplication (500+ stars), totaling 2,844 stars with an average of 1,422 stars per repository. Rankings update daily from the GitHub API.