Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Scrapy Splash | 3,028 | 134 | 10 | a year ago | 11 | February 03, 2023 | 74 | bsd-3-clause | Python | |
Scrapy+Splash for JavaScript integration | ||||||||||
Kimuraframework | 874 | 4 | 2 | 2 years ago | 10 | January 30, 2019 | 34 | mit | Ruby | |
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites | ||||||||||
602 | 3 months ago | 81 | other | Python | ||||||
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy | ||||||||||
Fakebrowser | 290 | 2 | 2 years ago | 54 | January 14, 2022 | 10 | lgpl-3.0 | JavaScript | ||
🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person. | ||||||||||
Newsscrapy | 70 | 4 years ago | 1 | lgpl-3.0 | Python | |||||
基于scrapy的新闻爬虫 | ||||||||||
Scrapy Scrapingbee | 26 | 2 years ago | 5 | December 26, 2021 | 1 | Python | ||||
JavaScript support and proxy rotation for Scrapy with ScrapingBee. | ||||||||||
Scrapyteer | 9 | 10 months ago | 8 | June 07, 2023 | mit | TypeScript | ||||
Web crawling & scraping framework for Node.js on top of headless Chrome browser | ||||||||||
Multi Selenium In Scrapy | 8 | 6 years ago | Python | |||||||
通过headless chrome实现selenium+scrapy的伪并发,提高动态网站爬取效率。 | ||||||||||
Scrapy Headless | 6 | 4 years ago | 1 | February 11, 2020 | 1 | bsd-3-clause | Python | |||
Hkexnews_scrapy | 5 | 5 years ago | gpl-3.0 | Python | ||||||
使用 Scrapy 拿滬港通及深港通持股紀錄 |