Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Web Crawler Scrapy Open Source Projects

Open source projects categorized as Python Web Crawler Scrapy
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Webscraping From 0 To Hero ⭐ 1,305
The web scraping open project repository aims to share knowledge and experiences about web scraping with Python
most recent commit 9 months ago
Django Dynamic Scraper ⭐ 1,069
Creating Scrapy scrapers via the Django admin interface
total releases 65most recent commit 2 years ago
Faster Than Requests ⭐ 1,061
Faster requests on Python 3
dependent packages 4total releases 18most recent commit 3 months agopypi faster-than-requests} Downloads
Scrapy Fake Useragent ⭐ 654
Random User-Agent middleware based on fake-useragent
dependent packages 5total releases 12most recent commit 7 months agopypi scrapy-fake-useragent} Downloads
Scrapple ⭐ 452
A framework for creating semi-automatic web content extractors
total releases 10most recent commit 5 years ago
City Scrapers ⭐ 315
Scrape, standardize and share public meetings from local government websites
most recent commit 3 months ago
Web Scraping ⭐ 281
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
most recent commit 3 months ago
Netflix Clone ⭐ 245
Netflix like full-stack application with SPA client and backend implemented in service oriented architecture
most recent commit a year ago
Wayback Machine Scraper ⭐ 219
A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
total releases 8most recent commit 3 years ago
Juno_crawler ⭐ 147
Scrapy crawler to collect data on the back catalog of songs listed for sale.
most recent commit 5 years ago
Estela ⭐ 142
estela, an elastic web scraping cluster 🕸
most recent commit 3 months ago
Scrapy Training ⭐ 141
Scrapy Training companion code
most recent commit 5 years ago
Raspagem De Dados Para Iniciantes ⭐ 115
Raspagem de dados para iniciante usando Scrapy e outras libs básicas
most recent commit a year ago
Seleniumcrawler ⭐ 105
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
most recent commit 5 years ago
Wswp ⭐ 95
Code for the second edition Web Scraping with Python book by Packt Publications
most recent commit 4 years ago
Scrapy Gui ⭐ 93
A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
total releases 9most recent commit a year ago
Terpene Profile Parser For Cannabis Strains ⭐ 93
Parser and database to index the terpene profile of different strains of Cannabis from online databases
most recent commit a year ago
Scrapyd Cluster On Heroku ⭐ 90
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉
most recent commit 4 years ago
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23most recent commit 3 months agopypi web-poet} Downloads
Openscraper ⭐ 80
An open source webapp for scraping: towards a public service for webscraping
most recent commit 2 years ago
Goodreadsscraper ⭐ 76
Scrape data from Goodreads using Scrapy and Selenium 📚
most recent commit a year ago
Scraping Ebay ⭐ 73
Scraping Ebay's products using Scrapy Web Crawling Framework
most recent commit 2 years ago
The 5 Most Depended On Python Web Crawler Scrapy Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Scrapy Fake Useragent ⭐ 654
Random User-Agent middleware based on fake-useragent
dependent packages 5total releases 12latest release August 15, 2020most recent commit 7 months agopypi scrapy-fake-useragent} Downloads
Faster Than Requests ⭐ 1,061
Faster requests on Python 3
dependent packages 4total releases 18latest release February 24, 2021most recent commit 3 months agopypi faster-than-requests} Downloads
Scrapy Wayback Machine ⭐ 70
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
dependent packages 4total releases 3latest release February 15, 2021most recent commit 3 years agopypi scrapy-wayback-machine} Downloads
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
The 10 Latest Releases In Python Web Crawler Scrapy Open Source Projects
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Scrapingant Client Python ⭐ 26
ScrapingAnt API client for Python.
total releases 16latest release August 09, 2023most recent commit 8 months ago
Scalpel ⭐ 38
A fast and powerful web scraping library
total releases 4latest release June 02, 2022most recent commit 3 months ago
Django Dynamic Scraper ⭐ 1,069
Creating Scrapy scrapers via the Django admin interface
total releases 65latest release June 25, 2021most recent commit 2 years ago
City Scrapers Core ⭐ 6
Core functionality for City Scrapers projects
total releases 37latest release March 25, 2021most recent commit 2 years ago
Faster Than Requests ⭐ 1,061
Faster requests on Python 3
dependent packages 4total releases 18latest release February 24, 2021most recent commit 3 months agopypi faster-than-requests} Downloads
Scrapy Wayback Machine ⭐ 70
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
dependent packages 4total releases 3latest release February 15, 2021most recent commit 3 years agopypi scrapy-wayback-machine} Downloads
Hypotonic ⭐ 8
Fast asynchronous declarative web scraper with minimalist API in pure Python.
total releases 15latest release September 27, 2020most recent commit 4 years ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.