Git Stars Git Stars

#spark Repositories

126
Total Repositories
513,269
Total Stars
4,073
Avg Stars/Repo
101
datavane/datavines

Know your data better๏ผDatavines is Next-gen Data Observability Platform, support metadata manage and data quality.

datavane
โญ 769 Java ๐Ÿ‘ค datavane Organization ๐Ÿ• Updated 2026-07-27 ๐Ÿ“… Created 2022-04-02
102
mrpowers-io/spark-daria

Essential Spark extensions and helper methods โœจ๐Ÿ˜ฒ

mrpowers-io
โญ 766 Scala ๐Ÿ‘ค mrpowers-io Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2017-02-16
103
HuQi2018/BiSheServer

This system is my graduation design project, titled "Design and Implementation of a Movie Recommendation System Based on User Profiles". It primarily uses Django as the base framework, adopting the MTV pattern, with MongoDB, MySQL, and Redis as databases. The movie data scraped from the Douban platform serves as the primary data source. User tags are mainly developed based on basic user information and behavioral information such as usage operation records. It is a recommendation system that utilizes Hadoop and Spark big data components for analysis and processing. The management system uses Django's built-in management system, enhanced with SimpleUI.

HuQi2018
โญ 743 Python ๐Ÿ‘ค HuQi2018 User ๐Ÿ• Updated 2026-06-02 ๐Ÿ“… Created 2021-03-28
104
mongodb/mongo-spark

The MongoDB Spark Connector

mongodb
โญ 729 Java ๐Ÿ‘ค mongodb Organization ๐Ÿ• Updated 2026-08-13 ๐Ÿ“… Created 2015-05-20
105
WeBankFinTech/WeDataSphere

WeDataSphere is a financial grade, one-stop big data platform suite.

WeBankFinTech
โญ 676 ๐Ÿ‘ค WeBankFinTech Organization ๐Ÿ• Updated 2024-03-14 ๐Ÿ“… Created 2019-07-23
106
capitalone/datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

capitalone
โญ 669 Python ๐Ÿ‘ค capitalone Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2018-03-23
107
AbsaOSS/spline

Data Lineage Tracking And Visualization Solution

AbsaOSS
โญ 669 Scala ๐Ÿ‘ค AbsaOSS Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2017-05-30
108
jupyter-server/enterprise_gateway

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

jupyter-server
โญ 669 Python ๐Ÿ‘ค jupyter-server Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2017-04-21
109
microsoft/fabric-samples

Samples and data for Microsoft Fabric Learn content

microsoft
โญ 650 Jupyter Notebook ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2023-04-23
110
josephmachado/beginner_de_project

Beginner data engineering project - batch edition

josephmachado
โญ 620 HTML ๐Ÿ‘ค josephmachado User ๐Ÿ• Updated 2026-04-13 ๐Ÿ“… Created 2020-05-23
111
igniterealtime/Spark

Cross-platform real-time collaboration client optimized for business and organizations.

igniterealtime
โญ 607 Java ๐Ÿ‘ค igniterealtime Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2013-11-23
112
YotpoLtd/metorikku

A simplified, lightweight ETL framework based on Apache Spark

YotpoLtd
โญ 589 Scala ๐Ÿ‘ค YotpoLtd Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2017-10-10
113
pdsuwwz/chatgpt-vue3-light-mvp

A secondary development-ready Chat Bot single-turn dialogue Web MVP prototype template, built with mainstream technologies including Vue 3, Vite 8, TypeScript, Naive UI, Pinia (v3), and UnoCSS. ๐Ÿงค Features simple integration of LLM APIs, single-turn AI Q&A mode with independent responses (no context required), SSE typewriter-effect streaming output, and integrated markdown-it with Mermaid/KaTex/LaTex formula highlighting. Supports iFlytek Spark, Zhipu AI, SiliconFlow, and DeepSeek V4/V3/R1 deep reasoning model previews, compatible with <think> tags, and includes distilled skills. ๐Ÿ’ผ Easy to customize and rapidly build Chat-based LLM products (example screenshots included).

pdsuwwz
โญ 586 Vue ๐Ÿ‘ค pdsuwwz User ๐Ÿ• Updated 2026-07-31 ๐Ÿ“… Created 2024-07-25
114
qubole/sparklens

Qubole Sparklens tool for performance tuning Apache Spark

qubole
โญ 586 Scala ๐Ÿ‘ค qubole Organization ๐Ÿ• Updated 2024-06-26 ๐Ÿ“… Created 2018-03-16
115
minio/sidekick

High Performance HTTP Sidecar Load Balancer

minio
โญ 585 Go ๐Ÿ‘ค minio Organization ๐Ÿ• Updated 2025-07-14 ๐Ÿ“… Created 2020-03-05
116
mvillarrealb/docker-spark-cluster

A simple spark standalone cluster for your testing environment purposes

mvillarrealb
โญ 570 Dockerfile ๐Ÿ‘ค mvillarrealb User ๐Ÿ• Updated 2024-03-06 ๐Ÿ“… Created 2018-09-23
117
housepower/ClickHouse-Native-JDBC

ClickHouse Native Protocol JDBC implementation

housepower
โญ 543 Java ๐Ÿ‘ค housepower Organization ๐Ÿ• Updated 2025-06-22 ๐Ÿ“… Created 2018-05-14
118
zhaoyachao/zdh_web

Big Data Collection, Extraction Platform, zdh_web is the visual management platform for zdh series services, including modules such as data collection, scheduling, permissions, approval workflow, private domain marketing, etc.

zhaoyachao
โญ 536 HTML ๐Ÿ‘ค zhaoyachao User ๐Ÿ• Updated 2026-06-07 ๐Ÿ“… Created 2020-02-03
119
high-performance-spark
โญ 536 Scala ๐Ÿ‘ค high-performance-spark Organization ๐Ÿ• Updated 2026-05-03 ๐Ÿ“… Created 2015-10-06
120
polyaxon/traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

polyaxon
โญ 533 Python ๐Ÿ‘ค polyaxon Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2016-03-25
121
ittqqzz/ECommerceRecommendSystem

E-commerce Big Data Real-time Product Recommendation System, Vue + TypeScript + ElementUI + Spring + Spark

ittqqzz
โญ 528 Java ๐Ÿ‘ค ittqqzz User ๐Ÿ• Updated 2026-02-13 ๐Ÿ“… Created 2019-10-28
122
GACWR/OpenUBA

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with love by Data Scientists & Security Analysts from the Cyber Security Industry. [BETA]

GACWR
โญ 528 Python ๐Ÿ‘ค GACWR Organization ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2019-09-24
123
nightscape/spark-excel

A Spark plugin for reading and writing Excel files

nightscape
โญ 525 Scala ๐Ÿ‘ค nightscape User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2016-09-03
124
ing-bank/popmon

Monitor the stability of a Pandas or Spark dataframe โš™๏ธŽ

ing-bank
โญ 512 Python ๐Ÿ‘ค ing-bank Organization ๐Ÿ• Updated 2026-01-09 ๐Ÿ“… Created 2020-04-23
125
cluster-apps-on-docker/spark-standalone-cluster-on-docker

Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker. :zap:

cluster-apps-on-docker
โญ 510 Jupyter Notebook ๐Ÿ‘ค cluster-apps-on-docker Organization ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2020-07-03
126
databrickslabs/dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) can be used to generate large simulated/synthetic datasets for testing, POCs, and other uses in Databricks environments, including Delta Live Tables pipelines.

databrickslabs
โญ 506 Python ๐Ÿ‘ค databrickslabs Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2019-07-23