#dataset Repositories
Discover 173 active open source GitHub repositories tagged with #dataset, accumulating 893,369 total stars (averaging 5,163 stars per project). Leading this topic is public-apis/public-apis with 500,425 stars.
173 repositories total
Label Studio is a multi-type data labeling and annotation tool with standardized output format
1,324-exercise fitness dataset โ animation GIFs, 180ร180 thumbnails, muscle-group & equipment data, and step-by-step instructions in 6 languages. The exercise data layer behind the LogPress app.
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.
Techniques for deep learning with satellite & aerial imagery
Awesome Pretrained Chinese NLP Models, High-Quality Chinese Pretrained Models & Large Models & Multimodal Models & Large Language Models Collection
่ฏๅ ยท Word Atlas โ Illustrated IELTS vocabulary with 7,298 words, UK/US audio, and FSRS review. Open-source app + CC BY 4.0 dataset.
esProc SPL is a JVM-based programming language designed for structured data computation, serving as both a data analysis tool and an embedded computing engine.
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
Chinese name corpus. Name generator. Chinese names, surnames, given names, titles, Japanese names, translated names, English names. Can be used for Chinese word segmentation and named entity recognition.
SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.
Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! โญ๏ธ
๐ The currently largest database and collection of papers on industrial defect detection. Constantly summarizing open source datasets and critical papers in the field of surface defect research which are of great importance.
Paper list and datasets for industrial image anomaly/defect detection (updating). Industrial anomaly/defect detection paper and dataset retrieval library (continuously updating).
SIMD, SWAR & GPU kernels for strings: search, hashing, sorting, edit distances, UTF-8 segmentation & ciphers for C, C++, CUDA, Python, Rust, Go, Swift, JS, C# & Java ๐ฆ
A curated list of awesome JSON datasets that don't require authentication.
Extract data from a wide range of Internet sources into a pandas DataFrame.
Community-maintained dataset of 700+ websites for finding accounts by username โ powers OSINT and digital footprint tools.
An open-source data logging library for machine learning models and data pipelines. ๐ Provides visibility into data quality & model performance over time. ๐ก๏ธ Supports privacy-preserving data collection, ensuring safety & robustness. ๐
๐ 7,400,000+ Unsplash images made available for research and machine learning
Collection of Open Resources for Chinese Medical NLP: Terminologies/Corpus/Word Vectors/Pre-trained Models/Knowledge Graphs/Named Entity Recognition/QA/Information Extraction/Models/Papers/etc
[ECCV 2018] CCPD: a diverse and well-annotated dataset for license plate detection and recognition
180 free CSS3, Figma, Sketch & PSD gradients โ plus a JSON dataset for design tools, generators, and AI agents.
ISO 3166-1 country lists merged with their UN Geoscheme regional codes in ready-to-use JSON, XML, CSV data sets
A comprehensive and up-to-date compilation of datasets, tools, methods, review papers, and competitions for remote sensing change detection.
Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box describes the objectโs position, orientation, and dimensions. The dataset contains about 15K annotated video clips and 4M annotated images in the following cat
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
cluster data collected from production clusters in Alibaba for cluster management research
๐ A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).
Collaborate & label any type of data, images, text, or documents, in an easy web interface or desktop app.
A global, public domain map dataset available at three scales and featuring tightly integrated vector and raster data.
fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.
A curated list of Graph/Transformer-based fraud, anomaly, and outlier detection papers & resources
Comprehensive SQL and GIS datasets for Vietnamese administrative units, including provinces, districts, wards, postal codes, and geospatial boundaries.
Frequently Asked Questions
What is the most popular #dataset repository on GitHub?
The top ranked open source #dataset project on GitHub is public-apis/public-apis with 500,425 stars. A collective list of free APIs
Which programming languages are most used in #dataset repositories?
Among the top ranked #dataset projects on GitHub, the most common programming languages are Python, JavaScript, Jupyter Notebook, TypeScript.
How is the #dataset repository ranking calculated?
We track 173 active open source repositories tagged with #dataset (500+ stars), totaling 893,369 stars with an average of 5,163 stars per repository. Rankings update daily from the GitHub API.