Scrapy Autounit

Automatic unit test generation for Scrapy.
Alternatives To Scrapy Autounit
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Spidermon486
5 months ago18September 01, 202352bsd-3-clausePython
Scrapy Extension for monitoring spiders execution.
Scrapyredisbloomfilter144
3 years ago5January 03, 20216Python
Scrapy Redis Bloom Filter
Scrapy Autounit42
3 years ago32July 09, 202110bsd-3-clausePython
Automatic unit test generation for Scrapy.
Captcha Middleware38
3 years agogpl-3.0Python
A middleware layer for Scrapy that detects CAPTCHA tests and solves them
Scurl15
6 years ago1August 01, 201811apache-2.0Python
Performance-focused replacement for Python urllib
Scrapy Testmaster12
3 years ago1otherPython
The most advanced debugging and testing tool for Scrapy
Flask Scrapy Test7
7 years ago1Python
for kristjan
Scrapy Mock6
a year ago1January 06, 20201mitPython
Record Scrapy responses and use them as testing fixtures.
Scrapy6
6 years agoPython
项目实例:一个学习scrapy的简单实例。帮助你快速的上手scrapy框架。 只需修改2个python文件。items.py 和spiders文件夹中的shushan.py。 需要修改的项,在2个python文件中均进行了备注。 大家可根据备注修改相关内容,再通过命令行运行爬虫程序。 命令行cd至spider目录,运行scrapy crawl shushan -o shushan.csv,生成csv文件,保存爬虫数据。 备注:保存的爬虫数据csv格式,需用WPS版excel打开,或是用txt直接打开。点击右上 star 按钮,喜欢的点个赞吧!(网站也是本人弄的,请放心使用)
Jinritoutiaonews5
4 years agoPython
scrapy+pyppeteer,爬取今日头条中新闻及热门评论信息。
Alternatives To Scrapy Autounit
Select To Compare


Alternative Project Comparisons
Popular Scrapy Projects
Popular Testing Projects
Popular Data Processing Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Testing
Spider
Scrapy
Fixtures