Git Stars Git Stars

#data-preprocessing Repositories

Discover 34 active open source GitHub repositories tagged with #data-preprocessing, accumulating 83,062 total stars (averaging 2,443 stars per project). Leading this topic is openai/tiktoken with 19,693 stars.

34
Total Repositories
83,062
Total Stars
2,443
Avg Stars/Repo
1
openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

openai
โญ 19,693 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2022-12-01
2
dwyl/english-words

:memo: A text file containing 479k English words for all your dictionary/word-based projects e.g: auto-completion / autosuggestion

dwyl
โญ 12,122 Python ๐Ÿ‘ค dwyl Organization ๐Ÿ• Updated 2025-01-06 ๐Ÿ“… Created 2014-07-13
3
sjwhitworth/golearn

Machine Learning for Go

sjwhitworth
โญ 9,455 Go ๐Ÿ‘ค sjwhitworth User ๐Ÿ• Updated 2024-01-15 ๐Ÿ“… Created 2013-12-26
4
codemayq/chinese-chatbot-corpus

Chinese Public Chat Corpus

codemayq
โญ 4,171 Python ๐Ÿ‘ค codemayq User ๐Ÿ• Updated 2024-04-23 ๐Ÿ“… Created 2018-11-04
5
TommyZihao/Train_Custom_Dataset

Annotate your own datasets, train, evaluate, test, and deploy your own artificial intelligence algorithms

TommyZihao
โญ 4,131 Jupyter Notebook ๐Ÿ‘ค TommyZihao User ๐Ÿ• Updated 2026-01-07 ๐Ÿ“… Created 2022-07-23
6
rspeer/python-ftfy

Fixes mojibake and other glitches in Unicode text, after the fact.

rspeer
โญ 4,004 Python ๐Ÿ‘ค rspeer User ๐Ÿ• Updated 2024-10-30 ๐Ÿ“… Created 2012-08-24
7
The-Japan-DataScientist-Society/100knocks-preprocess

Data Science 100 Knockouts (Structured Data Processing)

The-Japan-DataScientist-Society
โญ 2,536 HTML ๐Ÿ‘ค The-Japan-DataScientist-Society Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2020-05-28
8
scikit-learn-contrib/category_encoders

A library of sklearn compatible categorical variable encoders

scikit-learn-contrib
โญ 2,510 Python ๐Ÿ‘ค scikit-learn-contrib Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2015-11-29
9
WillKoehrsen/feature-selector

Feature selector is a tool for dimensionality reduction of machine learning datasets

WillKoehrsen
โญ 2,237 Jupyter Notebook ๐Ÿ‘ค WillKoehrsen User ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2018-06-20
10
skrub-data/skrub

Machine learning with dataframes

skrub-data
โญ 1,670 Python ๐Ÿ‘ค skrub-data Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-03-12
11
lizhe2004/Awesome-LLM-RAG-Application

the resources about the application based on LLM with RAG pattern

lizhe2004
โญ 1,662 ๐Ÿ‘ค lizhe2004 User ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2023-12-27
12
hashcat/hashcat-utils

Small utilities that are useful in advanced password cracking

hashcat
โญ 1,643 C ๐Ÿ‘ค hashcat Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2015-11-20
13
scikit-learn-contrib/boruta_py

Python implementations of the Boruta all-relevant feature selection method.

scikit-learn-contrib
โญ 1,635 Python ๐Ÿ‘ค scikit-learn-contrib Organization ๐Ÿ• Updated 2025-11-13 ๐Ÿ“… Created 2016-01-30
14
jadijadi/machine_learning_with_python_jadi

The notebooks we use on ML course

jadijadi
โญ 1,215 Jupyter Notebook ๐Ÿ‘ค jadijadi User ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2021-09-20
15
campusx-official/ML-Roadmap-for-2022

A curated list of Machine learning videos, links, projects and datasets to help you conquer the ML landscape in 6 months

campusx-official
โญ 1,119 ๐Ÿ‘ค campusx-official User ๐Ÿ• Updated 2024-08-20 ๐Ÿ“… Created 2022-01-10
16
tensorflow/transform

Input pipeline framework

tensorflow
โญ 992 Python ๐Ÿ‘ค tensorflow Organization ๐Ÿ• Updated 2026-08-14 ๐Ÿ“… Created 2017-02-10
17
data-prep-kit/data-prep-kit

Open source project for data preparation for GenAI applications

data-prep-kit
โญ 967 HTML ๐Ÿ‘ค data-prep-kit Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2024-04-08
19
IIIS-Li-Group/OpenFE

OpenFE: automated feature generation with expert-level performance

IIIS-Li-Group
โญ 842 Python ๐Ÿ‘ค IIIS-Li-Group Organization ๐Ÿ• Updated 2024-05-27 ๐Ÿ“… Created 2022-11-21
20
potree/PotreeConverter

Create multi res point cloud to use with potree

potree
โญ 823 JavaScript ๐Ÿ‘ค potree User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2014-02-08
โญ 763 MATLAB ๐Ÿ‘ค ThomasYeoLab Organization ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2016-07-13
22
LAION-AI/audio-dataset

Audio Dataset for training CLAP and other models

LAION-AI
โญ 750 Python ๐Ÿ‘ค LAION-AI Organization ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2022-03-07
24
cesium-ml/cesium

Machine Learning Time-Series Platform

cesium-ml
โญ 682 Python ๐Ÿ‘ค cesium-ml Organization ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2014-10-29
25
NathanEpstein/Dora

Tools for exploratory data analysis in Python

NathanEpstein
โญ 647 Python ๐Ÿ‘ค NathanEpstein User ๐Ÿ• Updated 2025-08-05 ๐Ÿ“… Created 2016-02-16
26
Western-OC2-Lab/AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

Implementation/Tutorial of using Automated Machine Learning (AutoML) methods for static/batch and online/continual learning

Western-OC2-Lab
โญ 629 Jupyter Notebook ๐Ÿ‘ค Western-OC2-Lab Organization ๐Ÿ• Updated 2024-05-14 ๐Ÿ“… Created 2022-09-09
27
tidymodels/recipes

Pipeable steps for feature engineering and data preprocessing to prepare for modeling

tidymodels
โญ 625 R ๐Ÿ‘ค tidymodels Organization ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2016-12-16
29
Lightning-AI/litData

Speed up model training by fixing data loading.

Lightning-AI
โญ 617 Python ๐Ÿ‘ค Lightning-AI Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2024-02-15
30
torcheeg/torcheeg

TorchEEG is a library built on PyTorch for EEG signal analysis.

torcheeg
โญ 585 Python ๐Ÿ‘ค torcheeg Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2022-06-06
31
machinelearnjs/machinelearnjs

Machine Learning library for the web and Node.

machinelearnjs
โญ 541 TypeScript ๐Ÿ‘ค machinelearnjs Organization ๐Ÿ• Updated 2026-02-07 ๐Ÿ“… Created 2018-04-29
32
mlfoundations/open_lm

A repository for research on medium sized language models.

mlfoundations
โญ 536 Python ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2025-06-06 ๐Ÿ“… Created 2023-08-23
33
akanz1/klib

Easy to use Python library of customized functions for cleaning and analyzing data.

akanz1
โญ 523 Python ๐Ÿ‘ค akanz1 User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2020-03-25
34
Desbordante/desbordante-core

Desbordante is a high-performance data profiler capable of discovering many different patterns in data using various algorithms. It also allows you to run data-cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

Desbordante
โญ 522 C++ ๐Ÿ‘ค Desbordante Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2020-04-09

Frequently Asked Questions

1

What is the most popular #data-preprocessing repository on GitHub?

The top ranked open source #data-preprocessing project on GitHub is openai/tiktoken with 19,693 stars. tiktoken is a fast BPE tokeniser for use with OpenAI's models.

2

Which programming languages are most used in #data-preprocessing repositories?

Among the top ranked #data-preprocessing projects on GitHub, the most common programming languages are Python, Jupyter Notebook, HTML, Go.

3

How is the #data-preprocessing repository ranking calculated?

We track 34 active open source repositories tagged with #data-preprocessing (500+ stars), totaling 83,062 stars with an average of 2,443 stars per repository. Rankings update daily from the GitHub API.