#webscraping Repositories
Discover 50 active open source GitHub repositories tagged with #webscraping, accumulating 581,593 total stars (averaging 11,631 stars per project). Leading this topic is firecrawl/firecrawl with 205,758 stars.
50 repositories total
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
๐ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shyโjoin here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.
An autonomous agent that conducts deep research on any data using any LLM providers
Turn any website into a structured API. Extract, automate, search and monitor the web.
List of libraries, tools and APIs for web scraping and data processing.
Undetected version of the Playwright testing and automation library.
Analysis of Bot Protection systems with available countermeasures ๐ฟ. How to defeat anti-bot system ๐ป and get around browser fingerprinting scripts ๐ต๏ธโโ๏ธ when scraping the web?
Make your job hunt easy by automating your application process with this Auto Applier
invisible playwright: Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ShardX team (formerly ProxyShard). Engine-level fingerprint spoofing in Chromium 158 (WebGL / WebGPU / Client Hints / fonts / TLS), 220+ device profiles bundled, stable QUIC + WebRTC over SOCKS5.
The web scraping open project repository aims to share knowledge and experiences about web scraping with Python
This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
Undetected Python version of the Playwright testing and automation library.
A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker support!
LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
Puppeteer for Python that anti-bot systems canโt detect, so there are no CAPTCHAs: the same API, anti-detection stealth headless Firefox, an undetected fingerprint, bypassing bot detection, web scraping, and browser automation.
Source-level Chromium fingerprinting engine, rated as ordinary Chrome by detection sites. A source-level Chromium fingerprint kernel that passes bot-detection tests. Not JS injectionโC++ patches compiled into the binary.
Invisible Playwright MCP: Playwright MCP server undetected by anti-bots and CAPTCHAs: AI agent browses the web using anti-detect stealth Firefox, Python, undetected browser automation, scraping, and computer use.
A modular, terminal-based toolkit for OSINT, reconnaissance, and scraping - built in Python, runs on Linux and Windows.
A python bot to automatically apply all Linkedin,Glassdoor, etc Easy Apply jobs based on your preferences. Auto login, auto fill additional questions, apply automatically!
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.
Undetected NodeJS version of the Playwright testing and automation library.
Selenium that anti-bots canโt see, so no CAPTCHAs: same API, anti-detection stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
๐ค AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.
Frequently Asked Questions
What is the most popular #webscraping repository on GitHub?
The top ranked open source #webscraping project on GitHub is firecrawl/firecrawl with 205,758 stars. Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
Which programming languages are most used in #webscraping repositories?
Among the top ranked #webscraping projects on GitHub, the most common programming languages are Python, TypeScript, JavaScript, Ruby.
How is the #webscraping repository ranking calculated?
We track 50 active open source repositories tagged with #webscraping (500+ stars), totaling 581,593 stars with an average of 11,631 stars per repository. Rankings update daily from the GitHub API.