Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Robintrack | 679 | 3 months ago | 22 | mit | JavaScript | |||||
Scrapes the Robinhood API to retrieve + store popularity and price data. | ||||||||||
Distributed Multi User Scrapy System With A Web Ui | 71 | 6 years ago | 5 | Python | ||||||
Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner | ||||||||||
Scrapy Distributed | 40 | a year ago | 8 | February 20, 2021 | 10 | Python | ||||
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy. | ||||||||||
Scraping Microservice Java Python Rabbitmq | 40 | 7 years ago | 1 | apache-2.0 | Java | |||||
A sample web scraping service demonstrating how to build a message driven application using RabbitMQ | ||||||||||
Scraping_tweets_celery_rabbitmq_docker_cluster | 36 | 4 years ago | 1 | Python | ||||||
Scraping tweets quickly using celery, RabbitMQ and Docker cluster | ||||||||||
Barkingowl | 18 | 4 years ago | 54 | May 22, 2015 | 10 | gpl-3.0 | Python | |||
scalable web scraper framework for finding documents on websites. | ||||||||||
Amazon_product_scrap | 18 | 3 months ago | bsd-2-clause | Python | ||||||
Amazon product Scraping using Django and Selenium | ||||||||||
Legco Watch | 15 | 8 years ago | 12 | mit | Python | |||||
Parliamentary monitoring for Hong Kong | ||||||||||
Scraper | 14 | 11 years ago | Python | |||||||
A web scraper in Python using Django and Celery | ||||||||||
Aragog | 9 | 2 | 2 years ago | 9 | December 15, 2021 | mit | TypeScript | |||
Distributed web scraping framework |