Git Stars Git Stars

#web-spider Repositories

Discover 5 active open source GitHub repositories tagged with #web-spider, accumulating 21,788 total stars (averaging 4,357 stars per project). Leading this topic is projectdiscovery/katana with 17,878 stars.

5
Total Repositories
21,788
Total Stars
4,357
Avg Stars/Repo
Programming Languages: Go PHP Ruby Python
1
projectdiscovery/katana

A next-generation crawling and spidering framework.

projectdiscovery
โญ 17,878 Go ๐Ÿ‘ค projectdiscovery Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-01-02
2
mvdbos/php-spider

A configurable and extensible PHP web spider

mvdbos
โญ 1,338 PHP ๐Ÿ‘ค mvdbos User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2013-02-25
3
spidersuite/SpiderSuite

SpiderSuite (web security crawler) releases, wiki and roadmap

spidersuite
โญ 990 ๐Ÿ‘ค spidersuite Organization ๐Ÿ• Updated 2026-08-13 ๐Ÿ“… Created 2023-04-05
4
postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

postmodern
โญ 835 Ruby ๐Ÿ‘ค postmodern User ๐Ÿ• Updated 2026-01-12 ๐Ÿ“… Created 2009-03-08
5
yeximm/Access_wechat_article

WeChat article crawler, used to collect, organize, and archive public WeChat official account article metadata. Welcome to learn and discuss together. A Windows research workbench for collecting, organizing, and archiving public WeChat article metadata.

yeximm
โญ 749 Python ๐Ÿ‘ค yeximm User ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2024-08-14

Frequently Asked Questions

1

What is the most popular #web-spider repository on GitHub?

The top ranked open source #web-spider project on GitHub is projectdiscovery/katana with 17,878 stars. A next-generation crawling and spidering framework.

2

Which programming languages are most used in #web-spider repositories?

Among the top ranked #web-spider projects on GitHub, the most common programming languages are Go, PHP, Ruby, Python.

3

How is the #web-spider repository ranking calculated?

We track 5 active open source repositories tagged with #web-spider (500+ stars), totaling 21,788 stars with an average of 4,357 stars per repository. Rankings update daily from the GitHub API.