Git Stars Git Stars

#web-scraping Repositories

381
Total Repositories
2.1M
Total Stars
5,636
Avg Stars/Repo
351
samacs/simple_html_dom

Just a Simple HTML DOM library fork. (http://simplehtmldom.sourceforge.net/)

samacs
โญ 587 HTML ๐Ÿ‘ค samacs User ๐Ÿ• Updated 2024-05-15 ๐Ÿ“… Created 2012-09-23
352
pcrbot/HoshinoBot-plugins-index

HoshinoBot Plugin Index

pcrbot
โญ 581 Python ๐Ÿ‘ค pcrbot Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2020-11-13
โญ 579 Python ๐Ÿ‘ค LeLe86 User ๐Ÿ• Updated 2024-05-06 ๐Ÿ“… Created 2019-07-27
354
vakra-dev/reader

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

vakra-dev
โญ 577 TypeScript ๐Ÿ‘ค vakra-dev Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2026-01-07
355
JeremiahPetersen/RepoToText

Turn an entire GitHub Repo into a single organized .txt file to use with LLM's (ChatGPT, Claude, Gemini, etc)

JeremiahPetersen
โญ 576 Python ๐Ÿ‘ค JeremiahPetersen User ๐Ÿ• Updated 2024-05-29 ๐Ÿ“… Created 2023-07-09
356
realgam3/pymultitor

PyMultitor - Python Multi Threaded Tor Proxy

realgam3
โญ 575 Python ๐Ÿ‘ค realgam3 User ๐Ÿ• Updated 2025-08-30 ๐Ÿ“… Created 2013-09-28
357
firecrawl/firestarter

๐Ÿ”ฅ Instantly create AI chatbots for any website with RAG-powered search, streaming responses, and OpenAI-compatible API endpoints

firecrawl
โญ 571 TypeScript ๐Ÿ‘ค firecrawl Organization ๐Ÿ• Updated 2025-06-18 ๐Ÿ“… Created 2025-06-13
358
jpjacobpadilla/Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

jpjacobpadilla
โญ 570 Python ๐Ÿ‘ค jpjacobpadilla User ๐Ÿ• Updated 2026-09-19 ๐Ÿ“… Created 2024-08-04
359
alterem/knowledge-grab

knowledge-grab is a desktop application built on Tauri and Vue 3, designed to facilitate users in downloading various educational resources from the National Primary and Secondary School Smart Education Platform (basic.smartedu.cn).

alterem
โญ 566 Rust ๐Ÿ‘ค alterem User ๐Ÿ• Updated 2026-10-21 ๐Ÿ“… Created 2025-05-18
360
sentient-engineering/sentient

the framework/ sdk that lets you build browser controlling agents in 3 lines of code. join chat @ https://discord.gg/umgnyQU2K8

sentient-engineering
โญ 565 Python ๐Ÿ‘ค sentient-engineering Organization ๐Ÿ• Updated 2024-10-10 ๐Ÿ“… Created 2024-09-01
361
jaebradley/basketball_reference_web_scraper

NBA Stats API via Basketball Reference

jaebradley
โญ 563 HTML ๐Ÿ‘ค jaebradley User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-10-23
362
programminghistorian/jekyll

Jekyll-based static site for The Programming Historian

programminghistorian
โญ 559 HTML ๐Ÿ‘ค programminghistorian Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2013-09-09
363
databay-labs/free-proxy-list

Free Proxy List โœ…๐Ÿš€ HTTP, HTTPS, SOCKS4 & SOCKS5 | Updated every 5 minutes | Strict SSL, zero MITM, multi-country

databay-labs
โญ 557 ๐Ÿ‘ค databay-labs Organization ๐Ÿ• Updated 2026-06-20 ๐Ÿ“… Created 2025-04-25
364
Johell1NS/browser-search

A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited.

Johell1NS
โญ 549 JavaScript ๐Ÿ‘ค Johell1NS User ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2026-06-22
โญ 549 Python ๐Ÿ‘ค opendatalab Organization ๐Ÿ• Updated 2026-05-13 ๐Ÿ“… Created 2024-04-25
366
strohne/Facepager

Facepager was made for fetching public available data from YouTube, Twitter and other websites on the basis of APIs and webscraping.

strohne
โญ 549 Python ๐Ÿ‘ค strohne User ๐Ÿ• Updated 2026-05-17 ๐Ÿ“… Created 2012-09-26
367
la-deep-web/Phoneinfoga

script to search for data about phone numbers

la-deep-web
โญ 548 Python ๐Ÿ‘ค la-deep-web Organization ๐Ÿ• Updated 2024-04-24 ๐Ÿ“… Created 2019-02-24
368
TomoeMami/S1PlainTextBackup

S1 post backup in plain text format

TomoeMami
โญ 547 Python ๐Ÿ‘ค TomoeMami User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-02-02
369
AeternaLabsHQ/pullmd

Self-hosted URL- and file-to-Markdown service for humans and AI agents โ€” web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.

AeternaLabsHQ
โญ 528 JavaScript ๐Ÿ‘ค AeternaLabsHQ Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-27
370
qxinGitHub/searchEngineJump

Search engine redirect script, which allows for convenient switching between multiple engines

qxinGitHub
โญ 528 JavaScript ๐Ÿ‘ค qxinGitHub User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2017-02-28
371
Johnserf-Seed/TikTokWeb

TikTokTool Web Version

Johnserf-Seed
โญ 527 CSS ๐Ÿ‘ค Johnserf-Seed User ๐Ÿ• Updated 2024-01-26 ๐Ÿ“… Created 2021-07-18
372
luyu0279/BrainyAI

a free and open-source browser sidebar plugin that offers a cost-free alternative to products like Sider, Monica, and Merlin.

luyu0279
โญ 526 TypeScript ๐Ÿ‘ค luyu0279 User ๐Ÿ• Updated 2025-04-08 ๐Ÿ“… Created 2024-06-11
373
KitePig/FatRat-Collect

Pangshu Caiji: Excellent Open-Source WordPress Scraping Plugin

KitePig
โญ 523 PHP ๐Ÿ‘ค KitePig User ๐Ÿ• Updated 2026-06-03 ๐Ÿ“… Created 2018-12-04
374
n1tr00-10/tiktok-web-signature

Reverse engineering TikTok web signatures generates valid TikTok signatures for API requests.

n1tr00-10
โญ 521 Python ๐Ÿ‘ค n1tr00-10 User ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2026-10-09
375
liarjsdev/liarjs-skills

Agent Skills for browser fingerprint testing: run liarjs from Claude Code, Codex, Cursor or Copilot to score a browser against itself - 40 consistency checks over canvas, WebGL, WebGPU, audio, fonts and WebRTC, cross-checked against the TLS/HTTP layer. Playwright and Puppeteer harness QA, CI regression gates, headless detection triage.

liarjsdev
โญ 518 ๐Ÿ‘ค liarjsdev User ๐Ÿ• Updated 2026-08-06 ๐Ÿ“… Created 2026-08-04
376
subinps/Instagram-Bot

Telegram bot to download almost all from Instagram

subinps
โญ 513 Python ๐Ÿ‘ค subinps User ๐Ÿ• Updated 2024-04-30 ๐Ÿ“… Created 2021-05-31
377
oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

oxylabs
โญ 512 ๐Ÿ‘ค oxylabs Organization ๐Ÿ• Updated 2026-06-19 ๐Ÿ“… Created 2022-03-14
โญ 507 TypeScript ๐Ÿ‘ค zaidmukaddam User ๐Ÿ• Updated 2025-03-08 ๐Ÿ“… Created 2025-03-08
379
AlexMathew/scrapple

A framework for creating semi-automatic web content extractors

AlexMathew
โญ 506 Python ๐Ÿ‘ค AlexMathew User ๐Ÿ• Updated 2026-01-16 ๐Ÿ“… Created 2014-12-13
380
oxylabs/web-scraper-api

All-in-one web scraping API for real-time, large-scale data extraction โ€“ proxies, CAPTCHA management, JS rendering, and parsing in a single request returning HTML or structured JSON.

oxylabs
โญ 503 ๐Ÿ‘ค oxylabs Organization ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-06-05
381
sansan0/bilibili-comment-analyzer

๐ŸŽฏ Bilibili comment data visualization analysis software -- content creators can use it to guide their topic selection and understand their fan base.

sansan0
โญ 503 Python ๐Ÿ‘ค sansan0 User ๐Ÿ• Updated 2025-06-27 ๐Ÿ“… Created 2025-06-03
โญ 502 Python ๐Ÿ‘ค lewis-007 User ๐Ÿ• Updated 2024-03-11 ๐Ÿ“… Created 2024-03-11