Git Stars Git Stars

#big-data Repositories

133
Total Repositories
683,600
Total Stars
5,139
Avg Stars/Repo
51
kafbat/kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

kafbat
โญ 2,852 TypeScript ๐Ÿ‘ค kafbat Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-22
52
man-group/ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.

man-group
โญ 2,655 C++ ๐Ÿ‘ค man-group Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-11-11
53
quarylabs/quary

Open-source BI for engineers

quarylabs
โญ 2,390 Rust ๐Ÿ‘ค quarylabs Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-02-20
54
ytsaurus/ytsaurus

YTsaurus is a scalable and fault-tolerant open-source big data platform.

ytsaurus
โญ 2,325 C++ ๐Ÿ‘ค ytsaurus Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-12-05
55
apache/ambari

Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.

apache
โญ 2,311 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2011-09-23
56
apache/fluss

Apache Flink is a streaming storage built for real-time analytics.

apache
โญ 2,250 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-31
57
PavelGrigoryevDS/awesome-data-analysis

๐Ÿš€ 500+ curated resources for Data Analysis & Data Science: Python, SQL, Statistics, ML, AI, Visualization, Cheatsheets, Roadmaps, Interview Prep. For beginners and experts.

PavelGrigoryevDS
โญ 2,224 ๐Ÿ‘ค PavelGrigoryevDS User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2025-07-30
58
apache/datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

apache
โญ 2,179 Rust ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-05-19
59
apache/drill

Apache Drill is a distributed MPP query layer for self describing data

apache
โญ 2,026 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2012-09-05
60
apache/bookkeeper

Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads

apache
โญ 2,019 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2011-04-06
61
fluid-cloudnative/fluid

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

fluid-cloudnative
โญ 2,000 Go ๐Ÿ‘ค fluid-cloudnative Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-07-11
62
microsoft/GlobalMLBuildingFootprints

Worldwide building footprints derived from satellite imagery

microsoft
โญ 1,993 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2022-04-22
63
elastic/elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

elastic
โญ 1,966 Java ๐Ÿ‘ค elastic Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2013-03-11
64
apache/kudu

Mirror of Apache Kudu

apache
โญ 1,919 C++ ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2016-01-29
65
TurboWay/big_screen

Big screen data visualization

TurboWay
โญ 1,884 HTML ๐Ÿ‘ค TurboWay User ๐Ÿ• Updated 2026-01-22 ๐Ÿ“… Created 2020-09-28
66
dask/dask-tutorial

Dask tutorial

dask
โญ 1,862 Jupyter Notebook ๐Ÿ‘ค dask Organization ๐Ÿ• Updated 2025-11-04 ๐Ÿ“… Created 2015-07-16
67
apache/auron

Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.

apache
โญ 1,849 Rust ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2021-06-28
68
kiwenlau/hadoop-cluster-docker

Run Hadoop Cluster within Docker Containers

kiwenlau
โญ 1,827 Shell ๐Ÿ‘ค kiwenlau User ๐Ÿ• Updated 2024-07-01 ๐Ÿ“… Created 2015-05-21
69
Netflix/genie

Distributed Big Data Orchestration Service

Netflix
โญ 1,766 Java ๐Ÿ‘ค Netflix Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2013-06-20
70
matanolabs/matano

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

matanolabs
โญ 1,675 Rust ๐Ÿ‘ค matanolabs Organization ๐Ÿ• Updated 2025-01-08 ๐Ÿ“… Created 2022-07-03
71
jadianes/spark-py-notebooks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

jadianes
โญ 1,667 Jupyter Notebook ๐Ÿ‘ค jadianes User ๐Ÿ• Updated 2024-03-16 ๐Ÿ“… Created 2015-05-06
72
tonbo-io/tonbo

Tonbo is an embedded database for serverless and edge runtimes.

tonbo-io
โญ 1,639 Rust ๐Ÿ‘ค tonbo-io Organization ๐Ÿ• Updated 2026-07-18 ๐Ÿ“… Created 2024-07-15
73
kantord/just-dashboard

:bar_chart: :clipboard: Dashboards using YAML or JSON files

kantord
โญ 1,587 TypeScript ๐Ÿ‘ค kantord User ๐Ÿ• Updated 2026-02-21 ๐Ÿ“… Created 2018-01-18
74
dremio/dremio-oss

Dremio - the missing link in modern data

dremio
โญ 1,495 Java ๐Ÿ‘ค dremio Organization ๐Ÿ• Updated 2025-09-26 ๐Ÿ“… Created 2017-07-17
75
apache/carbondata

High performance data store solution

apache
โญ 1,452 Scala ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-10-02 ๐Ÿ“… Created 2016-06-28
76
apache/cloudberry

One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.

apache
โญ 1,448 C ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-24
77
Tencent/TBase

TBase is an enterprise-level distributed HTAP database. Through a single database cluster to provide users with highly consistent distributed database services and high-performance data warehouse services, a set of integrated enterprise-level solutions is formed.

Tencent
โญ 1,436 C ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2025-07-07 ๐Ÿ“… Created 2019-11-07
78
xitongsys/parquet-go

pure golang library for reading/writing parquet file

xitongsys
โญ 1,432 Go ๐Ÿ‘ค xitongsys User ๐Ÿ• Updated 2026-05-08 ๐Ÿ“… Created 2017-09-02
79
mtth/avsc

Avro for JavaScript :zap:

mtth
โญ 1,389 JavaScript ๐Ÿ‘ค mtth User ๐Ÿ• Updated 2026-02-22 ๐Ÿ“… Created 2015-09-12
80
uxlfoundation/scikit-learn-intelex

Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

uxlfoundation
โญ 1,357 Python ๐Ÿ‘ค uxlfoundation Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-08-07
81
apache/ozone

Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.

apache
โญ 1,335 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-10-02
82
mahmoudparsian/pyspark-tutorial

PySpark-Tutorial provides basic algorithms using PySpark

mahmoudparsian
โญ 1,276 Jupyter Notebook ๐Ÿ‘ค mahmoudparsian User ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2015-03-12
83
mukunku/ParquetViewer

Simple Windows desktop application for viewing & querying Apache Parquet files

mukunku
โญ 1,258 C# ๐Ÿ‘ค mukunku User ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2018-05-31
84
Azure/AzurePublicDataset

Microsoft Azure Traces

Azure
โญ 1,231 Jupyter Notebook ๐Ÿ‘ค Azure Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2017-08-18
85
graphframes/graphframes

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

graphframes
โญ 1,213 Scala ๐Ÿ‘ค graphframes Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2016-01-20
86
apache/amoro

Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

apache
โญ 1,207 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-07-14
87
apache/accumulo

Apache Accumulo

apache
โญ 1,184 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2011-10-06
88
ClickHouse/ClickBench

ClickBench: a Benchmark For Analytical Databases

ClickHouse
โญ 1,171 Shell ๐Ÿ‘ค ClickHouse Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-07-11
89
youngwookim/awesome-hadoop

A curated list of amazingly awesome Hadoop and Hadoop ecosystem resources

youngwookim
โญ 1,113 ๐Ÿ‘ค youngwookim User ๐Ÿ• Updated 2024-05-07 ๐Ÿ“… Created 2014-07-08
โญ 1,076 Shell ๐Ÿ‘ค big-data-europe Organization ๐Ÿ• Updated 2024-06-02 ๐Ÿ“… Created 2016-05-20
91
metabrainz/listenbrainz-server

Server for the ListenBrainz project, including the front-end (javascript/react) code that it serves and all of the data processing components that LB uses.

metabrainz
โญ 1,074 Python ๐Ÿ‘ค metabrainz Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-09-05
92
bigdatagenomics/adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

bigdatagenomics
โญ 1,060 Scala ๐Ÿ‘ค bigdatagenomics Organization ๐Ÿ• Updated 2026-03-17 ๐Ÿ“… Created 2013-11-19
93
opendatadiscovery/awesome-data-catalogs

๐Ÿ“™ Awesome Data Catalogs and Observability Platforms.

opendatadiscovery
โญ 1,059 ๐Ÿ‘ค opendatadiscovery Organization ๐Ÿ• Updated 2025-08-14 ๐Ÿ“… Created 2021-07-14
94
apache/flink-kubernetes-operator

Apache Flink Kubernetes Operator

apache
โญ 1,043 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-02-10
95
myscale/MyScaleDB

A @ClickHouse fork that supports high-performance vector search and full-text search.

myscale
โญ 1,032 C++ ๐Ÿ‘ค myscale Organization ๐Ÿ• Updated 2025-02-05 ๐Ÿ“… Created 2024-03-14
96
NVIDIA/cudf-spark

NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs

NVIDIA
โญ 1,021 Scala ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-05-14
97
Tencent/TencentKona-8

Tencent Kona is a no-cost, production-ready distribution of the Open Java Development Kit (OpenJDK), Long-term support(LTS) with quarterly updates. Tencent Kona serves as the default JDK internally at Tencent Cloud for cloud computing and other Java applications.

Tencent
โญ 1,003 Java ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2019-11-01
98
firmai/data-science-career

Career Resources for Data Science, Machine Learning, Big Data and Business Analytics Career Repository

firmai
โญ 993 ๐Ÿ‘ค firmai User ๐Ÿ• Updated 2024-08-16 ๐Ÿ“… Created 2019-08-23
99
h2oai/sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

h2oai
โญ 982 Scala ๐Ÿ‘ค h2oai Organization ๐Ÿ• Updated 2025-11-05 ๐Ÿ“… Created 2014-10-13
100
delta-io/delta-sharing

An open protocol for secure data sharing

delta-io
โญ 965 Scala ๐Ÿ‘ค delta-io Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-04-08