#spark Repositories
126 repositories total
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
The Big Data knowledge repository involves data warehouse modeling, real-time computing, Big Data, data middle platform, system design, Java, algorithms, etc.
ApacheCN Open Source Organization: Announcements, Introduction, Members, Activities, Communication Methods
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak
The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.
Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display
AI-based entity resolution, identity resolution, master data management, and deduplication at scale for humans and agents
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
Server for the ListenBrainz project, including the front-end (javascript/react) code that it serves and all of the data processing components that LB uses.
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
A connector for Spark that allows reading and writing to/from Redis cluster
Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models
A curated list of awesome resources related to the Ada and SPARK programming language
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.
JDK8 based AI Chatbot! WeChat Official Account Midjourney Graphics, Key Redemption, Web Support ChatGPT, Midjourney Graphics, SD Graphics, Key Redemption, YiPay, Official Account Traffic Acquisition, Email Registration๐ฅ