#data-extraction Repositories
Discover 131 active open source GitHub repositories tagged with #data-extraction, accumulating 729,329 total stars (averaging 5,567 stars per project). Leading this topic is firecrawl/firecrawl with 205,758 stars.
131 repositories total
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
๐ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shyโjoin here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Turn any website into a structured API. Extract, automate, search and monitor the web.
rga: ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz, etc.
Xiaohongshu (RED) crawler data collection, Xiaohongshu reverse engineering, private messaging, live streaming, and full-domain Xiaohongshu operation solutions
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
An open source deep research clone. AI Agent that reasons large amounts of web data extracted with Firecrawl
Declarative data automation language and Go runtime for structured extraction workflows.
Successor of Undetected-Chromedriver. Providing a blazing fast framework for web automation, webscraping, bots and any other creative ideas which are normally hindered by annoying anti bot systems like Captcha / CloudFlare / Imperva / hCaptcha
Code samples from the book Web Scraping with Python http://shop.oreilly.com/product/0636920034391.do
An agentic extractor for messaging platforms. Noria receives messages and URLs via chat, scrapes web data to evaluate content against custom scoring matrices (e.g., jobs, scholarships), and sends a structured summary with a calculated match score directly to the assigned messenger number.
Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
PdfParser, a standalone PHP library, provides various tools to extract data from a PDF file.
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
Get Weibo search result information, the search can be either Weibo keyword search or Weibo topic search
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
Extract structured data and insights from documents using LLMs and decision models
This tool extracts and displays data from the Recall feature in Windows 11, providing an easy way to access information about your PC's activity snapshots.
Intelligent parser for the "Chitai-Gorod" catalog. High-speed gathering and structuring of data based on any specified parameters: from ISBN to discount dynamics.
A Python module for extracting provinces, cities, and districts from Simplified Chinese strings and performing mapping, validation, and simple plotting
Converts a PDF file into a text file while preserving the original PDFโs layout. Useful, for example, for extracting content from a table in a PDF file. This is a subclass of the PDFTextStripper class from the Apache PDFBox library.
Frequently Asked Questions
What is the most popular #data-extraction repository on GitHub?
The top ranked open source #data-extraction project on GitHub is firecrawl/firecrawl with 205,758 stars. Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
Which programming languages are most used in #data-extraction repositories?
Among the top ranked #data-extraction projects on GitHub, the most common programming languages are Python, TypeScript, JavaScript, Rust.
How is the #data-extraction repository ranking calculated?
We track 131 active open source repositories tagged with #data-extraction (500+ stars), totaling 729,329 stars with an average of 5,567 stars per repository. Rankings update daily from the GitHub API.