#data-pipeline Repositories
67 repositories total
Crawl news from Toutiao, NetEase, Tencent, etc., and build a simple search engine
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
The biggest collection of R books (and maybe later some other resources too)
Tutorial on Hledger setup with multi-year files, multi-source imports and a range of auto-generated reports
A curated list of open source tools used in analytics platforms and data engineering ecosystem
Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes
Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.
Wiki containing pieces of information and knowledge about BEAM Virtual machine (which runs Erlang/OTP and other BEAM-based languages).
National IP database, providing data based on CIDR and NETMASK format, supporting IPv4 and IPv6.