Git Stars Git Stars

#scraper Repositories

128
Total Repositories
792,441
Total Stars
6,190
Avg Stars/Repo
51
rushter/selectolax

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

rushter
โญ 1,717 Python ๐Ÿ‘ค rushter User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2017-11-26
52
paulpierre/informer

A Telegram Mass Surveillance Bot in Python

paulpierre
โญ 1,679 Python ๐Ÿ‘ค paulpierre User ๐Ÿ• Updated 2025-10-20 ๐Ÿ“… Created 2019-12-09
53
consumet/api.consumet.org

A Modern Search Engine API for Anime, Movies/TVShows, Books, Light Novels, Manga, etc.

consumet
โญ 1,623 TypeScript ๐Ÿ‘ค consumet Organization ๐Ÿ• Updated 2026-03-13 ๐Ÿ“… Created 2022-05-22
54
GramAddict/bot

Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.

GramAddict
โญ 1,558 Python ๐Ÿ‘ค GramAddict Organization ๐Ÿ• Updated 2025-02-16 ๐Ÿ“… Created 2020-10-29
55
0x676e67/wreq-python

An ergonomic, privacy-aware Python HTTP Client

0x676e67
โญ 1,526 Python ๐Ÿ‘ค 0x676e67 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2025-02-10
56
Nriver/Episode-ReName

TV series/anime automation renaming tool, one-click batch renaming. Can be used in conjunction with QBittorrent to automatically rename after download, facilitating Emby's automatic scraping. Supports running in Windows, Linux, MacOS, Docker, and Synology package environments.

Nriver
โญ 1,488 Python ๐Ÿ‘ค Nriver User ๐Ÿ• Updated 2025-05-19 ๐Ÿ“… Created 2021-10-19
57
th3unkn0n/osi.ig

Information Gathering Instagram.

th3unkn0n
โญ 1,447 Python ๐Ÿ‘ค th3unkn0n User ๐Ÿ• Updated 2024-02-01 ๐Ÿ“… Created 2019-11-04
58
justfoolingaround/animdl

A highly efficient, fast, powerful and light-weight anime downloader and streamer for your favorite anime.

justfoolingaround
โญ 1,437 Python ๐Ÿ‘ค justfoolingaround User ๐Ÿ• Updated 2024-06-13 ๐Ÿ“… Created 2021-04-15
59
yjl9903/AnimeGarden

Anime Garden Mirror Site | Anime BT Resource Aggregation Site | Anime BT Resource Open API

yjl9903
โญ 1,414 TypeScript ๐Ÿ‘ค yjl9903 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-04-08
60
mariostoev/finviz

Unofficial API for finviz.com

mariostoev
โญ 1,373 Python ๐Ÿ‘ค mariostoev User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2017-11-15
61
lorey/mlscraper

๐Ÿค– Scrape data from HTML websites automatically by just providing examples

lorey
โญ 1,370 Python ๐Ÿ‘ค lorey User ๐Ÿ• Updated 2024-03-17 ๐Ÿ“… Created 2020-07-30
62
felipecsl/wombat

Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

felipecsl
โญ 1,360 Ruby ๐Ÿ‘ค felipecsl User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2011-11-14
63
cinemagoer/cinemagoer

Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people and characters

cinemagoer
โญ 1,327 Python ๐Ÿ‘ค cinemagoer Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2010-08-01
64
huaying/instagram-crawler

Get Instagram posts/profile/hashtag data without using Instagram API

huaying
โญ 1,299 Python ๐Ÿ‘ค huaying User ๐Ÿ• Updated 2024-05-03 ๐Ÿ“… Created 2017-09-15
65
datawhores/OF-Scraper

A completely revamped and redesigned fork with OnlyFans and Fansly support, reimagined from scratch based on the original onlyfans-scraper.

datawhores
โญ 1,219 Python ๐Ÿ‘ค datawhores User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-03-22
66
germondai/trawl

Self-hosted scraping engine โ€” bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.

germondai
โญ 1,209 TypeScript ๐Ÿ‘ค germondai User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-06-26
67
AndyTheFactory/newspaper4k

๐Ÿ“ฐ Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.

AndyTheFactory
โญ 1,170 Python ๐Ÿ‘ค AndyTheFactory User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2023-10-22
68
obitouka/InstagramPrivSniffer

First ever tool to view "Instagram private posts" anonymously

obitouka
โญ 1,163 Python ๐Ÿ‘ค obitouka User ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2025-07-09
69
scrapfly/scrapfly-scrapers

Scalable Python web scraping scripts for 80+ popular domains

scrapfly
โญ 1,133 Python ๐Ÿ‘ค scrapfly Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-22
70
elixir-crawly/crawly

Crawly, a high-level web crawling & scraping framework for Elixir.

elixir-crawly
โญ 1,129 Elixir ๐Ÿ‘ค elixir-crawly Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-03-09
71
0x676e67/wreq

An ergonomic, privacy-aware Rust HTTP Client

0x676e67
โญ 1,118 Rust ๐Ÿ‘ค 0x676e67 User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-19
72
vifreefly/kimuraframework

Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.

vifreefly
โญ 1,102 Ruby ๐Ÿ‘ค vifreefly User ๐Ÿ• Updated 2026-01-27 ๐Ÿ“… Created 2018-08-23
73
jikan-me/jikan

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

jikan-me
โญ 1,095 PHP ๐Ÿ‘ค jikan-me Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2017-01-11
74
klsdf/GreenResourcesManager

A comprehensive manager that manages resources within the computer and provides gamification

klsdf
โญ 1,087 JavaScript ๐Ÿ‘ค klsdf User ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2025-06-20
75
JosephLai241/URS

Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.

JosephLai241
โญ 1,048 Python ๐Ÿ‘ค JosephLai241 User ๐Ÿ• Updated 2026-07-11 ๐Ÿ“… Created 2019-03-20
76
ythx-101/x-tweet-fetcher

Fetch X/Twitter tweets, replies, timelines, search results, Lists, and X Articles without logging in or using API keys. Python CLI and library for AI agents: FxTwitter, Nitter, and browser backends with automatic fallback, unified JSON, and an optional SQLite archive. Fetch Twitter posts without logging in or using an API.

ythx-101
โญ 1,012 Python ๐Ÿ‘ค ythx-101 User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2026-02-14
77
fredwu/crawler

A high performance web crawler / scraper in Elixir.

fredwu
โญ 963 Elixir ๐Ÿ‘ค fredwu User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-08-08
78
Solr159/JavBoss

An out-of-the-box local JAV/video scraping, management, and playback application, supporting one-click installation via the command line and Docker deployment. Simply add a directory to build your own private JAV/video library and enjoy a top-notch browsing experience. A must-have for the lazy! | Your local JAV/video manager.

Solr159
โญ 955 Go ๐Ÿ‘ค Solr159 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-03-21
79
oxylabs/youtube-scraper

YouTube Scraper for effortless public YouTube data collection, including video and channel information.

oxylabs
โญ 937 Java ๐Ÿ‘ค oxylabs Organization ๐Ÿ• Updated 2025-09-23 ๐Ÿ“… Created 2023-10-11
80
JoMingyu/google-play-scraper

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

JoMingyu
โญ 930 Python ๐Ÿ‘ค JoMingyu User ๐Ÿ• Updated 2024-08-05 ๐Ÿ“… Created 2019-06-04
โญ 896 Shell ๐Ÿ‘ค justchokingaround User ๐Ÿ• Updated 2026-09-15 ๐Ÿ“… Created 2022-07-20
82
scrapinghub/scrapyrt

HTTP API for Scrapy spiders

scrapinghub
โญ 884 Python ๐Ÿ‘ค scrapinghub Organization ๐Ÿ• Updated 2026-10-13 ๐Ÿ“… Created 2015-01-06
83
opensanctions/opensanctions

An open database of international sanctions data, persons of interest and politically exposed persons

opensanctions
โญ 880 Python ๐Ÿ‘ค opensanctions Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-12-05
84
skrapeit/skrape.it

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

skrapeit
โญ 874 Kotlin ๐Ÿ‘ค skrapeit User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2019-01-14
85
openzim/zimit

Make a ZIM file from any Web site and surf offline!

openzim
โญ 872 Python ๐Ÿ‘ค openzim Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2016-06-21
86
HDoujinDownloader/HDoujinDownloader

A general-purpose doujinshi and image gallery downloader

HDoujinDownloader
โญ 861 Lua ๐Ÿ‘ค HDoujinDownloader User ๐Ÿ• Updated 2026-06-25 ๐Ÿ“… Created 2019-10-01
87
maoserr/epublifier

Converts some webnovels to epub format

maoserr
โญ 845 TypeScript ๐Ÿ‘ค maoserr User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2020-05-09
88
benibela/xidel

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

benibela
โญ 836 Pascal ๐Ÿ‘ค benibela User ๐Ÿ• Updated 2025-02-22 ๐Ÿ“… Created 2015-06-11
89
postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

postmodern
โญ 835 Ruby ๐Ÿ‘ค postmodern User ๐Ÿ• Updated 2026-01-12 ๐Ÿ“… Created 2009-03-08
90
kiryano/Scout

Free lead generation tool. Scrape Instagram, Twitch, TikTok, and LinkedIn profiles. Extract emails from bios, verify via SMTP, export to CSV.

kiryano
โญ 824 Python ๐Ÿ‘ค kiryano User ๐Ÿ• Updated 2026-09-05 ๐Ÿ“… Created 2026-02-06
91
fanyong920/jvppeteer

Java API For Chrome and Firefox

fanyong920
โญ 805 Java ๐Ÿ‘ค fanyong920 User ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2020-03-11
92
unnohwn/telegram-scraper

A powerful Python script that allows you to scrape messages and media from Telegram channels using the Telethon library. Features include real-time continuous scraping, media downloading, and data export capabilities.

unnohwn
โญ 797 Python ๐Ÿ‘ค unnohwn User ๐Ÿ• Updated 2026-04-11 ๐Ÿ“… Created 2024-11-04
93
Cybrarist/Discount-Bandit

A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user

Cybrarist
โญ 765 PHP ๐Ÿ‘ค Cybrarist User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2023-07-06
94
ZacharyHampton/HomeHarvest

Python package for scraping real estate property data

ZacharyHampton
โญ 764 Python ๐Ÿ‘ค ZacharyHampton User ๐Ÿ• Updated 2025-12-26 ๐Ÿ“… Created 2023-09-15
95
graniet/operative-framework

operative framework is a rust investigation OSINT framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.

graniet
โญ 742 Rust ๐Ÿ‘ค graniet User ๐Ÿ• Updated 2025-05-17 ๐Ÿ“… Created 2017-01-03
96
ruippeixotog/scala-scraper

A Scala library for scraping content from HTML pages

ruippeixotog
โญ 731 Scala ๐Ÿ‘ค ruippeixotog User ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2014-10-12
97
josephlimtech/linkedin-profile-scraper-api

๐Ÿ•ต๏ธโ€โ™‚๏ธ LinkedIn profile scraper returning structured profile data in JSON.

josephlimtech
โญ 725 TypeScript ๐Ÿ‘ค josephlimtech User ๐Ÿ• Updated 2024-04-05 ๐Ÿ“… Created 2018-12-21
98
fa0311/TwitterInternalAPIDocument

Twitter Internal API Document

fa0311
โญ 724 Python ๐Ÿ‘ค fa0311 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-09-04
99
cassidoo/scrapers

A list of scrapers from around the web.

cassidoo
โญ 723 ๐Ÿ‘ค cassidoo User ๐Ÿ• Updated 2025-02-07 ๐Ÿ“… Created 2016-04-18
100
AbirHasan2005/TelegramScraper

Scrape Telegram group members (hidden members also) and add them to yours.

AbirHasan2005
โญ 722 ๐Ÿ‘ค AbirHasan2005 User ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2020-08-10