Awesomewebscraping

List of libraries, tools and APIs for web scraping and data processing.
Alternatives To Awesomewebscraping
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Php Curl Class3,2086903622 months ago99September 11, 20232unlicensePHP
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Pspider1,675
2 years ago1bsd-2-clausePython
简单易用的Python爬虫框架,QQ交流群:597510560
Scrapoxy1,66922 months ago2February 20, 201711mitTypeScript
Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀.
Faster Than Requests1,06142 months ago18February 24, 2021mitNim
Faster requests on Python 3
Stealth923
7 months ago30gpl-3.0JavaScript
:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
Company Crawler466
a year ago3mitPython
天眼查爬虫&企查查爬虫,指定关键字爬取公司信息
Proxy_requests381223 years ago49July 04, 20202mitPython
a class that uses scraped proxies to make http GET/POST requests (Python requests)
Lagoujob250
5 years agoapache-2.0Python
Job data mining repo for lagou.com
Awesomewebscraping189
6 months agootherMakefile
List of libraries, tools and APIs for web scraping and data processing.
Ignareo Isml Auto Voter186
6 months ago20mitPython
Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=international saimoe; 2022 ISML is last ISML)
Alternatives To Awesomewebscraping
Select To Compare


Alternative Project Comparisons
Popular Web Crawler Projects
Popular Proxy Projects
Popular Data Processing Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Javascript
Php
Golang
Ruby
Proxy
Awesome List
Makefile
Web Crawler
Captcha