Awesome Open Source

Programming Languages

Search results for rabbitmq scrapy

9 search results found

Scrapy Rabbitmq ⭐ 76

A RabbitMQ Scheduler for Scrapy

Distributed Multi User Scrapy System With A Web Ui ⭐ 71

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Scrapy Distributed ⭐ 40

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Scrapy Boilerplate ⭐ 32

Scrapy project boilerplate done right

Crawlerx ⭐ 16

CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.

Scrapy Rabbitmq Publisher ⭐ 12

Scrapy Item Pipeline to send items to RabbitMQ. From https://medium.com/python4you/rabbitmq-scrapy-item

Scrapy Mq Redis ⭐ 10

A RabbitMQ/Redis tool for Scrapy

Gerapyrabbitmq ⭐ 8

Distribution Support for Scrapy & Gerapy using RabbitMQ

Scrapy Insights ⭐ 8

A scraper which scrapes the facebook insights API

Related Searches

Python Scrapy (2,369)

Java Rabbitmq (1,328)

Python Rabbitmq (1,000)

Spider Scrapy (982)

Docker Rabbitmq (961)

Redis Rabbitmq (892)

Rabbitmq Amqp (830)

Javascript Rabbitmq (780)

Crawler Scrapy (578)

Scraper Scrapy (575)

1-9 of 9 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.