#parquet Repositories
Discover 45 active open source GitHub repositories tagged with #parquet, accumulating 105,539 total stars (averaging 2,345 stars per project). Leading this topic is questdb/questdb with 17,543 stars.
45 repositories total
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.
Archive a lifetime of email and chat. Offline search, analytics, and AI query over your full message history. Powered by SQLite and DuckDB
OLake Go: open-source replication from databases, Kafka, and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
Apache Kafkaยฎ compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
One SQL interface for 60+ tools (e.g., GitHub, Notion, Airtable). Plug into any LLM through MCP.
cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through deeply versioned, context-rich data packages.
Simple Windows desktop application for viewing & querying Apache Parquet files
Open-source local data lake for Chinaโs stock market (A-shares): Shanghai and Shenzhen stock quotes, A-share stock data, and financial data for quantitative research, trading, and backtesting. Includes financial statements, futures data, fund flows, announcements, indices, sectors, and macroeconomic data. 86 datasets updated daily, with corporate-action-adjusted prices and historical constituents built in, row-level lineage, PIT, and native MCP support. No registration or token required; self-hosted. Open-source China stock market data lake for quantitative research, backtesting, and AI agents.
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Open, SQL-native time-series database for telemetry you need to keep. Ingests 38M+ records/sec, queries 25M+ rows/sec. Compatible with InfluxDB Line Protocol and Telegraf. Open Parquet on your storage. Single binary. Native S3/Azure support. Air-gap ready. AGPL-3.0.
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
Graph Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries โ atop Pandas, NetworkX, RAPIDS, RDFlib, pySHACL, PyVis, morph-kgc, pslpython, pyarrow, etc.
The fully open-source DuckDB workbench that runs in your browser. SQL editor, notebooks, charts, AI assistant. No install, no signup, no backend โ your data never leaves the tab.
Browser-based data analytics & BI with DuckDB-WASM. Privacy-first: your data stays local; no server required.
Monte Carlo simulation of the NBA season, leveraging dbt, duckdb and evidence.dev
select * from logs; Tailpipe is an open source SIEM for instant log insights, powered by DuckDB. Analyze millions of events in seconds, right from your terminal.
A fast viewer for CSV/Parquet files and databases such as DuckDB, SQLite, PostgreSQL, MySQL, Clickhouse, etc., base on Tauri
Data Preview ๐ธ extension for importing ๐ค viewing ๐ slicing ๐ช dicing ๐ฒ charting ๐ & exporting ๐ฅ large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
reth-indexer reads directly from the reth db and indexes the data into traditional and alternative databases / datastores (postgres, GCP bigquery, etc) all decoded with a simple config file and no extra setup alongside exposing a API ready to query the data.
Frequently Asked Questions
What is the most popular #parquet repository on GitHub?
The top ranked open source #parquet project on GitHub is questdb/questdb with 17,543 stars. QuestDB is a high performance, open-source, time-series database
Which programming languages are most used in #parquet repositories?
Among the top ranked #parquet projects on GitHub, the most common programming languages are Rust, Go, Python, C++.
How is the #parquet repository ranking calculated?
We track 45 active open source repositories tagged with #parquet (500+ stars), totaling 105,539 stars with an average of 2,345 stars per repository. Rankings update daily from the GitHub API.