Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Website Scraper Open Source Projects

Open source projects categorized as Python Website Scraper
Event Collect ⭐ 1,110
event website listing to Open Event format scraper and converter
most recent commit 4 years ago
Pywebcopy ⭐ 455
Locally saves webpages to your hard disk with images, css, js & links as is.
dependent packages 2total releases 21most recent commit 4 months agopypi pywebcopy} Downloads
Newsdiffs ⭐ 418
Automatic scraper that tracks changes in news articles over time.
most recent commit 5 years ago
City Scrapers ⭐ 315
Scrape, standardize and share public meetings from local government websites
most recent commit 3 months ago
Docsearch Scraper ⭐ 289
DocSearch - Scraper
most recent commit 4 months ago
Youtube Projects ⭐ 272
This repository contains all the code I use in my YouTube tutorials.
most recent commit 3 years ago
Finance Dl ⭐ 263
Tools for automatically downloading/scraping personal financial data.
total releases 12most recent commit 4 months ago
Dark Fantasy Hack Tool ⭐ 248
DDOS Tool: To take down small websites with HTTP FLOOD. Port scanner: To know the open ports of a site. FTP Password Cracker: To hack file system of websites.. Banner Grabber: To get the service or software running on a port. (After knowing the software running google for its vulnerabilities.) Web Spider: For gathering web application hacking information. Email scraper: To get all emails related to a webpage IMDB Rating: Easy way to access the movie database. Both .exe(compressed as zip) and .py
most recent commit 2 years ago
Sotoki ⭐ 212
StackExchange websites to ZIM scraper
total releases 30most recent commit 9 months ago
Transistor ⭐ 209
Transistor, a Python web scraping framework for intelligent use cases.
total releases 7most recent commit 4 months ago
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44most recent commit 4 months agopypi scrapelib} Downloads
Python Web Scraping Cookbook ⭐ 107
Python Web Scraping Cookbook, published by Packt
most recent commit a year ago
Openscraper ⭐ 80
An open source webapp for scraping: towards a public service for webscraping
most recent commit 2 years ago
Python Web Scraping Second Edition ⭐ 76
Python Web Scraping Second Edition, published by Packt
most recent commit 3 years ago
Transfermarkt Scraper ⭐ 69
🕸️ Collects data from Transfermarkt website
most recent commit 4 months ago
Company Email Scraper ⭐ 68
A scraper fetching all company emails from Seedtable and Clutch websites.
most recent commit 2 years ago
Argus ⭐ 67
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-0
most recent commit 2 years ago
Web Scraping ⭐ 67
Web Scraping with Beautiful Soup and Selenium
most recent commit 3 years ago
Scraping Tripadvisor With Python 2020 ⭐ 58
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
most recent commit 2 years ago
Proxy_web_crawler ⭐ 39
Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
most recent commit 6 months ago
Python Legistar Scraper ⭐ 37
Scrapes municipal data from Legistar websites
dependent packages 1total releases 1most recent commit 4 months agopypi scraper-legistar} Downloads
Bus_catchers ⭐ 35
Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
most recent commit 11 years ago
Supercharged Web Scraping With Asyncio ⭐ 31
Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).
most recent commit 3 years ago
The 4 Most Depended On Python Website Scraper Open Source Projects
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44latest release December 15, 2023most recent commit 4 months agopypi scrapelib} Downloads
Scrapeasy ⭐ 21
Scraping in python made easy - receive the content you like in just one line of code
dependent packages 6total releases 3latest release March 14, 2018most recent commit 4 years agopypi scrapeasy} Downloads
Pywebcopy ⭐ 455
Locally saves webpages to your hard disk with images, css, js & links as is.
dependent packages 2total releases 21latest release April 27, 2022most recent commit 4 months agopypi pywebcopy} Downloads
Python Legistar Scraper ⭐ 37
Scrapes municipal data from Legistar websites
dependent packages 1total releases 1latest release March 23, 2022most recent commit 4 months agopypi scraper-legistar} Downloads
The 10 Latest Releases In Python Website Scraper Open Source Projects
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44latest release December 15, 2023most recent commit 4 months agopypi scrapelib} Downloads
Sotoki ⭐ 212
StackExchange websites to ZIM scraper
total releases 30latest release October 31, 2022most recent commit 9 months ago
Pywebcopy ⭐ 455
Locally saves webpages to your hard disk with images, css, js & links as is.
dependent packages 2total releases 21latest release April 27, 2022most recent commit 4 months agopypi pywebcopy} Downloads
Python Legistar Scraper ⭐ 37
Scrapes municipal data from Legistar websites
dependent packages 1total releases 1latest release March 23, 2022most recent commit 4 months agopypi scraper-legistar} Downloads
Finance Dl ⭐ 263
Tools for automatically downloading/scraping personal financial data.
total releases 12latest release March 13, 2021most recent commit 4 months ago
Transistor ⭐ 209
Transistor, a Python web scraping framework for intelligent use cases.
total releases 7latest release August 03, 2020most recent commit 4 months ago
Comic Scraper ⭐ 16
[Python] Scraps comics and manga from various websites and creates cbz files from them
total releases 5latest release April 02, 2018most recent commit 2 years ago
Scrapeasy ⭐ 21
Scraping in python made easy - receive the content you like in just one line of code
dependent packages 6total releases 3latest release March 14, 2018most recent commit 4 years agopypi scrapeasy} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.