Git Stars Git Stars

#webscraping Repositories

Discover 50 active open source GitHub repositories tagged with #webscraping, accumulating 581,593 total stars (averaging 11,631 stars per project). Leading this topic is firecrawl/firecrawl with 205,758 stars.

50
Total Repositories
581,593
Total Stars
11,631
Avg Stars/Repo
1
firecrawl/firecrawl

Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.

firecrawl
โญ 205,758 TypeScript ๐Ÿ‘ค firecrawl Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-15
2
D4Vinci/Scrapling

๐Ÿ•ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shyโ€”join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

D4Vinci
โญ 104,760 Python ๐Ÿ‘ค D4Vinci User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2024-10-13
3
huginn/huginn

Create agents that monitor and act on your behalf. Your agents are standing by!

huginn
โญ 50,601 Ruby ๐Ÿ‘ค huginn Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2013-03-10
4
CloakHQ/CloakBrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

CloakHQ
โญ 33,007 Python ๐Ÿ‘ค CloakHQ Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-02-22
5
ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

ScrapeGraphAI
โญ 32,877 Python ๐Ÿ‘ค ScrapeGraphAI Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2024-01-27
6
assafelovic/gpt-researcher

An autonomous agent that conducts deep research on any data using any LLM providers

assafelovic
โญ 30,810 Python ๐Ÿ‘ค assafelovic User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2023-05-12
7
getmaxun/maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

getmaxun
โญ 18,538 TypeScript ๐Ÿ‘ค getmaxun Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-10-23
8
pystardust/ani-cli

A cli tool to browse and play anime

pystardust
โญ 14,142 Shell ๐Ÿ‘ค pystardust User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2021-06-09
9
daijro/camoufox

๐ŸฆŠ Anti-detect browser

daijro
โญ 13,533 C ๐Ÿ‘ค daijro User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-07-26
10
lorien/awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

lorien
โญ 8,242 JavaScript ๐Ÿ‘ค lorien User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-08-12
11
alirezamika/autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

alirezamika
โญ 8,102 Python ๐Ÿ‘ค alirezamika User ๐Ÿ• Updated 2026-07-29 ๐Ÿ“… Created 2020-08-31
12
Kaliiiiiiiiii-Vinyzu/patchright

Undetected version of the Playwright testing and automation library.

Kaliiiiiiiiii-Vinyzu
โญ 5,227 TypeScript ๐Ÿ‘ค Kaliiiiiiiiii-Vinyzu Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-11-07
13
niespodd/browser-fingerprinting

Analysis of Bot Protection systems with available countermeasures ๐Ÿšฟ. How to defeat anti-bot system ๐Ÿ‘ป and get around browser fingerprinting scripts ๐Ÿ•ต๏ธโ€โ™‚๏ธ when scraping the web?

niespodd
โญ 5,171 JavaScript ๐Ÿ‘ค niespodd User ๐Ÿ• Updated 2026-07-27 ๐Ÿ“… Created 2021-01-23
14
jaypyles/Scraperr

Self-hosted webscraper.

jaypyles
โญ 4,876 TypeScript ๐Ÿ‘ค jaypyles User ๐Ÿ• Updated 2025-10-12 ๐Ÿ“… Created 2024-07-06
15
itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

itsOwen
โญ 3,302 Python ๐Ÿ‘ค itsOwen User ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2024-08-17
16
GodsScion/Auto_job_applier_linkedIn

Make your job hunt easy by automating your application process with this Auto Applier

GodsScion
โญ 3,049 Python ๐Ÿ‘ค GodsScion User ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2023-06-17
17
oss-invisible/playwright

invisible playwright: Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

oss-invisible
โญ 2,612 Python ๐Ÿ‘ค oss-invisible Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-13
18
scrapoxy/scrapoxy

Scrapoxy has been discontinued.

scrapoxy
โญ 2,402 ๐Ÿ‘ค scrapoxy User ๐Ÿ• Updated 2026-02-07 ๐Ÿ“… Created 2015-08-28
19
anaskhan96/soup

Web Scraper in Go, similar to BeautifulSoup

anaskhan96
โญ 2,302 Go ๐Ÿ‘ค anaskhan96 User ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2017-02-23
20
reworkd/tarsier

Vision utilities for web interaction agents ๐Ÿ‘€

reworkd
โญ 1,746 Jupyter Notebook ๐Ÿ‘ค reworkd Organization ๐Ÿ• Updated 2024-11-25 ๐Ÿ“… Created 2023-11-09
21
ProxyShard/ShardBrowser

Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ShardX team (formerly ProxyShard). Engine-level fingerprint spoofing in Chromium 158 (WebGL / WebGPU / Client Hints / fonts / TLS), 220+ device profiles bundled, stable QUIC + WebRTC over SOCKS5.

ProxyShard
โญ 1,735 TypeScript ๐Ÿ‘ค ProxyShard User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-30
22
TheWebScrapingClub/webscraping-from-0-to-hero

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

TheWebScrapingClub
โญ 1,695 ๐Ÿ‘ค TheWebScrapingClub Organization ๐Ÿ• Updated 2024-05-27 ๐Ÿ“… Created 2022-05-26
23
zohaibbashir/Google-Maps-Scrapper

This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

zohaibbashir
โญ 1,651 Python ๐Ÿ‘ค zohaibbashir User ๐Ÿ• Updated 2026-05-18 ๐Ÿ“… Created 2023-10-17
24
Kaliiiiiiiiii-Vinyzu/patchright-python

Undetected Python version of the Playwright testing and automation library.

Kaliiiiiiiiii-Vinyzu
โญ 1,603 Python ๐Ÿ‘ค Kaliiiiiiiiii-Vinyzu Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2024-11-02
25
requests-cache/requests-cache

Persistent HTTP cache for python requests

requests-cache
โญ 1,511 Python ๐Ÿ‘ค requests-cache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2012-04-12
26
cdpdriver/zendriver

A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker support!

cdpdriver
โญ 1,483 Python ๐Ÿ‘ค cdpdriver Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-19
27
m8sec/CrossLinked

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

m8sec
โญ 1,455 Python ๐Ÿ‘ค m8sec User ๐Ÿ• Updated 2024-11-26 ๐Ÿ“… Created 2019-05-16
28
jamesturk/scrapeghost

๐Ÿ‘ป Experimental library for scraping websites using OpenAI's GPT API.

jamesturk
โญ 1,439 Python ๐Ÿ‘ค jamesturk User ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2023-03-18
29
feder-cr/invisible_puppeteer

Puppeteer for Python that anti-bot systems canโ€™t detect, so there are no CAPTCHAs: the same API, anti-detection stealth headless Firefox, an undetected fingerprint, bypassing bot detection, web scraping, and browser automation.

feder-cr
โญ 1,403 Python ๐Ÿ‘ค feder-cr User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2024-09-01
30
raznem/parsera

Lightweight library for scraping web-sites with LLMs

raznem
โญ 1,372 Python ๐Ÿ‘ค raznem User ๐Ÿ• Updated 2025-12-17 ๐Ÿ“… Created 2024-08-12
31
mov-cli/mov-cli

Watch everything from your terminal.

mov-cli
โญ 1,313 Python ๐Ÿ‘ค mov-cli Organization ๐Ÿ• Updated 2025-10-05 ๐Ÿ“… Created 2022-03-11
32
ovobrowsersupport/ovobrowser

Source-level Chromium fingerprinting engine, rated as ordinary Chrome by detection sites. A source-level Chromium fingerprint kernel that passes bot-detection tests. Not JS injectionโ€”C++ patches compiled into the binary.

ovobrowsersupport
โญ 1,277 ๐Ÿ‘ค ovobrowsersupport User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-08-23
33
scrapfly/scrapfly-scrapers

Scalable Python web scraping scripts for 80+ popular domains

scrapfly
โญ 1,133 Python ๐Ÿ‘ค scrapfly Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-22
34
openzim/zimit

Make a ZIM file from any Web site and surf offline!

openzim
โญ 872 Python ๐Ÿ‘ค openzim Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2016-06-21
35
oss-invisible/playwright_mcp

Invisible Playwright MCP: Playwright MCP server undetected by anti-bots and CAPTCHAs: AI agent browses the web using anti-detect stealth Firefox, Python, undetected browser automation, scraping, and computer use.

oss-invisible
โญ 869 Python ๐Ÿ‘ค oss-invisible Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-29
36
vil/H4X-Tools

A modular, terminal-based toolkit for OSINT, reconnaissance, and scraping - built in Python, runs on Linux and Windows.

vil
โญ 857 Python ๐Ÿ‘ค vil User ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2022-04-18
37
wodsuz/EasyApplyJobsBot

A python bot to automatically apply all Linkedin,Glassdoor, etc Easy Apply jobs based on your preferences. Auto login, auto fill additional questions, apply automatically!

wodsuz
โญ 838 Python ๐Ÿ‘ค wodsuz User ๐Ÿ• Updated 2026-05-18 ๐Ÿ“… Created 2021-08-09
38
benibela/xidel

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

benibela
โญ 836 Pascal ๐Ÿ‘ค benibela User ๐Ÿ• Updated 2025-02-22 ๐Ÿ“… Created 2015-06-11
39
tiliondev/fortress

Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.

tiliondev
โญ 817 Python ๐Ÿ‘ค tiliondev Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2026-07-02
40
Kaliiiiiiiiii-Vinyzu/patchright-nodejs

Undetected NodeJS version of the Playwright testing and automation library.

Kaliiiiiiiiii-Vinyzu
โญ 813 TypeScript ๐Ÿ‘ค Kaliiiiiiiiii-Vinyzu Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2024-11-02
41
Skallwar/suckit

Suck the InTernet

Skallwar
โญ 812 Rust ๐Ÿ‘ค Skallwar User ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2019-10-29
42
feder-cr/invisible_selenium

Selenium that anti-bots canโ€™t see, so no CAPTCHAs: same API, anti-detection stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

feder-cr
โญ 808 Python ๐Ÿ‘ค feder-cr User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2024-08-16
43
hitarth-gg/zenshin

๐Ÿ”– Web & Electron based Anime Streaming App for ๐Ÿˆs

hitarth-gg
โญ 784 JavaScript ๐Ÿ‘ค hitarth-gg User ๐Ÿ• Updated 2026-05-24 ๐Ÿ“… Created 2024-08-14
44
ZacharyHampton/HomeHarvest

Python package for scraping real estate property data

ZacharyHampton
โญ 764 Python ๐Ÿ‘ค ZacharyHampton User ๐Ÿ• Updated 2025-12-26 ๐Ÿ“… Created 2023-09-15
45
z0m31en7/Uscrapper

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.

z0m31en7
โญ 740 Python ๐Ÿ‘ค z0m31en7 User ๐Ÿ• Updated 2024-11-24 ๐Ÿ“… Created 2023-05-31
46
ScrapeGraphAI/scrapecraft

๐Ÿค– AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

ScrapeGraphAI
โญ 731 Python ๐Ÿ‘ค ScrapeGraphAI Organization ๐Ÿ• Updated 2025-12-26 ๐Ÿ“… Created 2025-07-01
47
scrapfly/Antibot-Detector

Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.

scrapfly
โญ 636 JavaScript ๐Ÿ‘ค scrapfly Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-09-03
48
adrianhajdin/pricewise

Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.

adrianhajdin
โญ 583 TypeScript ๐Ÿ‘ค adrianhajdin User ๐Ÿ• Updated 2024-07-06 ๐Ÿ“… Created 2023-09-29
49
jpjacobpadilla/Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

jpjacobpadilla
โญ 570 Python ๐Ÿ‘ค jpjacobpadilla User ๐Ÿ• Updated 2026-09-19 ๐Ÿ“… Created 2024-08-04
50
oxylabs/oxylabs-ai-studio-openclaw

Official Oxylabs AI-Studio Openclaw plugin

oxylabs
โญ 549 TypeScript ๐Ÿ‘ค oxylabs Organization ๐Ÿ• Updated 2026-09-16 ๐Ÿ“… Created 2026-02-26

Frequently Asked Questions

1

What is the most popular #webscraping repository on GitHub?

The top ranked open source #webscraping project on GitHub is firecrawl/firecrawl with 205,758 stars. Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.

2

Which programming languages are most used in #webscraping repositories?

Among the top ranked #webscraping projects on GitHub, the most common programming languages are Python, TypeScript, JavaScript, Ruby.

3

How is the #webscraping repository ranking calculated?

We track 50 active open source repositories tagged with #webscraping (500+ stars), totaling 581,593 stars with an average of 11,631 stars per repository. Rankings update daily from the GitHub API.