Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Scrapy Fake Useragent	654	50	5	7 months ago	12	August 15, 2020	5	mit	Python
Random User-Agent middleware based on fake-useragent
Awesome Scrapy	450			a year ago			2
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
Scrapy Random Useragent	170	21		5 years ago	2	June 11, 2016	9	mit	Python
Scrapy Middleware to set a random User-Agent for every Request.
Random_user_agent	79	1	30	10 months ago	9	December 26, 2018	3	mit	Python
A package to get list of user agents based on filters such as operating system, software name etc..
Baiduwenku	62			3 years ago			6		Python
百度文库！进来吧，这是就是你想要的百度文库爬虫，必能运行！word生成可编辑的word文档，ppt和pdf生成不可编辑的ppt（排版完美）.可以实现百度文库自动化爬取，支持ppt,pdf,doc。
Sinahousecrawler	42			7 years ago			1		Python
基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图片,实现了常用的爬虫功能需求.
Anti Useragent	34		8	2 years ago	13	September 20, 2022	6	mpl-2.0	Python
fake pc or app browser useragent, anti useragent, and other awesome tools
Scrapy Useragents	33			11 years ago					Python
A middleware to use random user agent in Scrapy crawler.
Anonymous Scrapping Scrapy Tor Privoxy Useragent	20			5 years ago					Python
Example of how to use scrapy without getting caught (ex: changing IP) (+ info to set it on windows 10)
Scrapy Useragents	20	4		5 years ago	1	September 21, 2017			Python
A downloader middleware to change user-agent of scrapy

Alternatives To Baiduwenku

Select To Compare

Scrapy Fake Useragent ⭐ 654

Random User-Agent middleware based on fake-useragent

dependent packages 5total releases 12most recent commit 7 months ago

Awesome Scrapy ⭐ 450

A curated list of awesome packages, articles, and other cool resources from the Scrapy community.

most recent commit a year ago

Scrapy Random Useragent ⭐ 170

Scrapy Middleware to set a random User-Agent for every Request.

total releases 2most recent commit 5 years ago

Random_user_agent ⭐ 79

A package to get list of user agents based on filters such as operating system, software name etc..

dependent packages 30total releases 9most recent commit 10 months ago

Baiduwenku ⭐ 62

百度文库！进来吧，这是就是你想要的百度文库爬虫，必能运行！word生成可编辑的word文档，ppt和

most recent commit 3 years ago

Sinahousecrawler ⭐ 42

基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图

most recent commit 7 years ago

Anti Useragent ⭐ 34

fake pc or app browser useragent, anti useragent, and other awesome tools

dependent packages 8total releases 13most recent commit 2 years ago

Scrapy Useragents ⭐ 33

A middleware to use random user agent in Scrapy crawler.

most recent commit 11 years ago

Anonymous Scrapping Scrapy Tor Privoxy Useragent ⭐ 20

Example of how to use scrapy without getting caught (ex: changing IP) (+ info to set it on windows 10)

most recent commit 5 years ago

Scrapy Useragents ⭐ 20

A downloader middleware to change user-agent of scrapy

total releases 1most recent commit 5 years ago

Suggest An Alternative To baiduwenku

Alternative Project Comparisons

Baiduwenku vs Scrapy Fake Useragent

Baiduwenku vs Awesome Scrapy

Baiduwenku vs Scrapy Random Useragent

Baiduwenku vs Random_user_agent

Baiduwenku vs Sinahousecrawler

Baiduwenku vs Anti Useragent

Baiduwenku vs Scrapy Useragents

Baiduwenku vs Anonymous Scrapping Scrapy Tor Privoxy Useragent

Baiduwenku vs Scrapy Useragents

Popular Scrapy Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Learn_python3_spider ⭐ 14,425

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifu 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

total releases 2latest release August 07, 2019most recent commit 4 months ago

Cs Book ⭐ 11,024

计算机类常用电子书整理，并且附带下载链接，包括Java，Python，Linux，Go，C，C++，

most recent commit 9 months ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 3 months ago

Portia ⭐ 8,982

Visual scraping for Scrapy

dependent packages 2total releases 26latest release May 25, 2015most recent commit 8 months ago

Popular User Agent Projects

Curl ⭐ 34,143

A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, TFTP, WS and WSS. libcurl offers a myriad of powerful features

dependent packages 78total releases 38latest release October 11, 2023most recent commit 2 days ago

Ua Parser Js ⭐ 8,430

UAParser.js - Free & open-source JavaScript library to detect user's Browser, Engine, OS, CPU, and Device type/model. Runs either in browser (client-side) or node.js (server-side).

dependent packages 1,920total releases 73latest release October 27, 2023most recent commit 3 months ago

Bowser ⭐ 5,407

a browser detector

most recent commit 3 months ago

Agent ⭐ 4,362

👮 A PHP desktop/mobile user agent parser with support for Laravel, based on Mobiledetect

dependent packages 268total releases 29latest release June 13, 2020most recent commit 6 months ago

Fake Useragent ⭐ 3,356

Up-to-date simple useragent faker with real world database

dependent packages 373total releases 32latest release November 24, 2023most recent commit 3 months ago

Popular Data Processing Categories