Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Scraper Scrapy Open Source Projects

Open source projects categorized as Python Scraper Scrapy
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Portia ⭐ 8,982
Visual scraping for Scrapy
dependent packages 2total releases 26most recent commit 8 months agopypi slybot} Downloads
Scrapy Cluster ⭐ 1,137
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
dependent packages 2total releases 15most recent commit 6 months agopypi scutils} Downloads
Django Dynamic Scraper ⭐ 1,069
Creating Scrapy scrapers via the Django admin interface
total releases 65most recent commit 2 years ago
Querido Diario ⭐ 944
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
most recent commit 3 months ago
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7most recent commit 6 months ago
Easy Scraping Tutorial ⭐ 618
Simple but useful Python web scraping tutorial code.
most recent commit 3 years ago
Linkedin ⭐ 602
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
most recent commit 3 months ago
Alltheplaces ⭐ 502
A set of spiders and scrapers to extract location information from places that post their location on the internet.
most recent commit 3 months ago
Spidermon ⭐ 486
Scrapy Extension for monitoring spiders execution.
total releases 18most recent commit 5 months ago
Scrapple ⭐ 452
A framework for creating semi-automatic web content extractors
total releases 10most recent commit 5 years ago
Awesome Scrapy ⭐ 450
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
most recent commit a year ago
Fbcrawl ⭐ 415
A Facebook crawler
most recent commit 4 years ago
Advanced Web Scraping Tutorial ⭐ 370
The Zipru scraper developed in the Advanced Web Scraping Tutorial.
most recent commit 7 years ago
City Scrapers ⭐ 315
Scrape, standardize and share public meetings from local government websites
most recent commit 3 months ago
Web Scraping ⭐ 281
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
most recent commit 3 months ago
Post Tuto Deployment ⭐ 269
Build and deploy a machine learning app from scratch 🚀
most recent commit 4 years ago
Wayback Machine Scraper ⭐ 219
A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
total releases 8most recent commit 3 years ago
Scrapyz ⭐ 188
"Scrape Easy" - an extension of the Scrapy framework.
total releases 6most recent commit 8 years ago
Airbnb Scraper ⭐ 153
Airbnb Scraper: Advanced Airbnb Search using Scrapy
most recent commit 2 years ago
Estela ⭐ 142
estela, an elastic web scraping cluster 🕸
most recent commit 3 months ago
Email Extractor ⭐ 134
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
most recent commit a year ago
Youtube Watch History Scraper ⭐ 126
Scrapy YouTube watch history spider. Because YouTube didn't have a history search.
most recent commit 2 years ago
The 6 Most Depended On Python Scraper Scrapy Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Scrapy Wayback Machine ⭐ 70
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
dependent packages 4total releases 3latest release February 15, 2021most recent commit 3 years agopypi scrapy-wayback-machine} Downloads
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
Portia ⭐ 8,982
Visual scraping for Scrapy
dependent packages 2total releases 26latest release May 25, 2015most recent commit 8 months agopypi slybot} Downloads
Scrapy Cluster ⭐ 1,137
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
dependent packages 2total releases 15latest release December 23, 2020most recent commit 6 months agopypi scutils} Downloads
Scrapy Zyte Api ⭐ 30
Zyte API integration for Scrapy
dependent packages 1total releases 23latest release October 19, 2023most recent commit 3 months agopypi scrapy-zyte-api} Downloads
The 10 Latest Releases In Python Scraper Scrapy Open Source Projects
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
Scrapy Zyte Api ⭐ 30
Zyte API integration for Scrapy
dependent packages 1total releases 23latest release October 19, 2023most recent commit 3 months agopypi scrapy-zyte-api} Downloads
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7latest release September 20, 2023most recent commit 6 months ago
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Spidermon ⭐ 486
Scrapy Extension for monitoring spiders execution.
total releases 18latest release September 01, 2023most recent commit 5 months ago
Scrapingant Client Python ⭐ 26
ScrapingAnt API client for Python.
total releases 16latest release August 09, 2023most recent commit 9 months ago
Scalpel ⭐ 38
A fast and powerful web scraping library
total releases 4latest release June 02, 2022most recent commit 3 months ago
Scrapy Scrapingbee ⭐ 26
JavaScript support and proxy rotation for Scrapy with ScrapingBee.
total releases 5latest release December 26, 2021most recent commit 2 years ago
Django Dynamic Scraper ⭐ 1,069
Creating Scrapy scrapers via the Django admin interface
total releases 65latest release June 25, 2021most recent commit 2 years ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.