#scraper Repositories
128 repositories total
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
A Modern Search Engine API for Anime, Movies/TVShows, Books, Light Novels, Manga, etc.
Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
TV series/anime automation renaming tool, one-click batch renaming. Can be used in conjunction with QBittorrent to automatically rename after download, facilitating Emby's automatic scraping. Supports running in Windows, Linux, MacOS, Docker, and Synology package environments.
A highly efficient, fast, powerful and light-weight anime downloader and streamer for your favorite anime.
Anime Garden Mirror Site | Anime BT Resource Aggregation Site | Anime BT Resource Open API
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people and characters
A completely revamped and redesigned fork with OnlyFans and Fansly support, reimagined from scratch based on the original onlyfans-scraper.
Self-hosted scraping engine โ bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and drop-in replacement for your *arr stack.
๐ฐ Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.
Unofficial MyAnimeList PHP+REST API which provides functions other than the official API
A comprehensive manager that manages resources within the computer and provides gamification
Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.
Fetch X/Twitter tweets, replies, timelines, search results, Lists, and X Articles without logging in or using API keys. Python CLI and library for AI agents: FxTwitter, Nitter, and browser backends with automatic fallback, unified JSON, and an optional SQLite archive. Fetch Twitter posts without logging in or using an API.
An out-of-the-box local JAV/video scraping, management, and playback application, supporting one-click installation via the command line and Docker deployment. Simply add a directory to build your own private JAV/video library and enjoy a top-notch browsing experience. A must-have for the lazy! | Your local JAV/video manager.
YouTube Scraper for effortless public YouTube data collection, including video and channel information.
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
An open database of international sanctions data, persons of interest and politically exposed persons
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Free lead generation tool. Scrape Instagram, Twitch, TikTok, and LinkedIn profiles. Extract emails from bios, verify via SMTP, export to CSV.
A powerful Python script that allows you to scrape messages and media from Telegram channels using the Telethon library. Features include real-time continuous scraping, media downloading, and data export capabilities.
A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user
operative framework is a rust investigation OSINT framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
๐ต๏ธโโ๏ธ LinkedIn profile scraper returning structured profile data in JSON.
Scrape Telegram group members (hidden members also) and add them to yours.