#ai-scraping Repositories
Discover 11 active open source GitHub repositories tagged with #ai-scraping, accumulating 361,516 total stars (averaging 32,865 stars per project). Leading this topic is firecrawl/firecrawl with 205,758 stars.
11 repositories total
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
๐ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shyโjoin here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
AnyCrawl ๐: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
Crawl a website starting from a URL, find relevant pages, and extract data โ all guided by your natural language prompt.
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data โ all from Rust. CLI, REST API, and MCP server.
AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows.
๐ฅ This repository contains complete application examples, including websites and other projects, developed using Firecrawl.
Frequently Asked Questions
What is the most popular #ai-scraping repository on GitHub?
The top ranked open source #ai-scraping project on GitHub is firecrawl/firecrawl with 205,758 stars. Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
Which programming languages are most used in #ai-scraping repositories?
Among the top ranked #ai-scraping projects on GitHub, the most common programming languages are Python, TypeScript, Rust, Jupyter Notebook.
How is the #ai-scraping repository ranking calculated?
We track 11 active open source repositories tagged with #ai-scraping (500+ stars), totaling 361,516 stars with an average of 32,865 stars per repository. Rankings update daily from the GitHub API.