Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Scrapy S3pipeline | 66 | 1 | 2 years ago | 8 | January 31, 2021 | 1 | mit | Python | ||
Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket. | ||||||||||
S3scan | 14 | 7 years ago | Python | |||||||
Script to spider a website and find publicly open S3 buckets | ||||||||||
Scrapy History Middleware | 9 | 7 years ago | 1 | mit | Python | |||||
Scrapy middleware for building historical S3 cache for crawled web resources. |