#web-scraping Repositories
382 repositories total
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
๐ค AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Moyu Island ๐ฃ Backend Based on Web Scraping โ Netty โ SpringBoot โRedisโ MySQL Open Source ๐ All-in-One Moyu Website
100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.
Analyzing Hacker News discussions from a decade ago in hindsight with LLMs
This program uses the Chrome DevTools Protocol to drive a Chrome session that downloads your photos stored in Google Photos.
EveryInfra MCP server & agent plugin: scraper API for TikTok, Instagram, Amazon, YouTube, Xiaohongshu & Douyin. 612 data APIs across 106 platforms, from $0.56/1K calls. For Claude Code, Cursor, Codex.
๐ฅ Visual AI research assistant that displays real-time thinking, provides split-view analysis, and automatic citations using Claude and Firecrawl
Execute complex automation scripts via remote cloud sessions, featuring integrated residential proxies, automated CAPTCHA solving, and native JavaScript rendering for the toughest dynamic websites.
KNKPAnime: An anime watching software that supports multi-episode sources and bullet comments.
sitecopy is a tool that facilitates personal website backup and network data collection
Automate scraping hotel data including pricing, availability, ratings, and booking providers with a Google Hotels API integration.
Crawl news from Toutiao, NetEase, Tencent, etc., and build a simple search engine
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
Complete-Life-Cycle-of-a-Data-Science-Project
A program that collects content from URLs in search engine results based on keywords. It can automatically gather real addresses and titles of related websites from multiple search engines, save them to files, and automatically remove duplicate URLs. Additionally, it allows custom ignoring of multiple domains.
AI Coding Benefits Guide: A curated directory of Claude Code, Codex, and Cursor relay services and community-run sites, covering free quotas, sign-up bonuses, check-in events, and review records, with a visual dashboard and Python data collection tools.
Let any AI agent control your own Chromeโwith all your login sessions intact. MCP + Chrome extension, compatible with Claude Code / Codex / Cursor / Gemini CLI.
Douyin lucky bag gacha machine, Douyin lucky bag grabbing tool, written by myself in VC++ in my spare time, with some other small functions, Douyin watermark-free video downloader, Douyin live stream recording downloader, Douyin batch unfollow tool
Barley, Cat's Eye, Fenwan Island, Ticket Planet, Concert re-supply ticket monitoring
Hacking facebook by termux.This tool is cooded by TecnicalDipesh. You can dump any facebok id and password.
A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.