Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Requests Html | 13,100 | a year ago | 6 | July 26, 2022 | 198 | mit | Python | |||
Pythonic HTML Parsing for Humans™ | ||||||||||
Crawler User Agents | 1,045 | 5 | 8 | 8 months ago | 118 | November 20, 2023 | 7 | mit | Python | |
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star: | ||||||||||
Scrapyrt | 793 | 5 | 10 months ago | 7 | September 20, 2023 | 31 | bsd-3-clause | Python | ||
HTTP API for Scrapy spiders | ||||||||||
Httplang | 508 | 7 years ago | 2 | mit | Python | |||||
A scripting langauge to do HTTP routines. | ||||||||||
Hrequests | 327 | a year ago | 14 | September 10, 2023 | 3 | apache-2.0 | Python | |||
🚀 Web scraping for humans | ||||||||||
Sasila | 264 | 5 years ago | 17 | November 02, 2017 | 1 | apache-2.0 | Python | |||
一个灵活、友好的爬虫框架 | ||||||||||
Proxy Scraper | 260 | 2 years ago | 12 | Python | ||||||
scrape proxies from more than 5 different sources and check which ones are still alive | ||||||||||
Scrapelib | 195 | 126 | 12 | 9 months ago | 44 | December 15, 2023 | 4 | bsd-2-clause | Python | |
⛏ a library for scraping unreliable pages | ||||||||||
Tokio | 144 | 1 | 2 | 3 years ago | 3 | May 14, 2018 | 3 | mit | JavaScript | |
Web scraping made simple. | ||||||||||
Proxxy | 99 | 10 months ago | mit | Python | ||||||
A super simple multithreaded proxy scraper; scraping & checking ~80k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies. |