Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Website Scraper Open Source Projects

Open source projects categorized as Website Scraper
Node Website Scraper ⭐ 1,456
Download website to local directory (including all css, images, js, etc.)
dependent packages 63total releases 61most recent commit 4 months agonpm website-scraper} Downloads
How To Prevent Scraping ⭐ 1,417
The ultimate guide on preventing Website Scraping
most recent commit 5 months ago
Event Collect ⭐ 1,110
event website listing to Open Event format scraper and converter
most recent commit 4 years ago
Stealth ⭐ 923
🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
most recent commit 8 months ago
Website Downloader ⭐ 895
💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
most recent commit 9 months ago
Scrapers ⭐ 511
A list of scrapers from around the web.
most recent commit a year ago
Pywebcopy ⭐ 455
Locally saves webpages to your hard disk with images, css, js & links as is.
dependent packages 2total releases 21most recent commit 4 months agopypi pywebcopy} Downloads
Newsdiffs ⭐ 418
Automatic scraper that tracks changes in news articles over time.
most recent commit 5 years ago
City Scrapers ⭐ 315
Scrape, standardize and share public meetings from local government websites
most recent commit 3 months ago
Juriscraper ⭐ 314
An API to scrape American court websites for metadata.
total releases 481most recent commit 3 months ago
Docsearch Scraper ⭐ 289
DocSearch - Scraper
most recent commit 4 months ago
Youtube Projects ⭐ 272
This repository contains all the code I use in my YouTube tutorials.
most recent commit 3 years ago
Website Scraper Puppeteer ⭐ 270
Plugin for website-scraper which returns html for dynamic websites using puppeteer
dependent packages 3total releases 8most recent commit 4 months agonpm website-scraper-puppeteer} Downloads
Finance Dl ⭐ 263
Tools for automatically downloading/scraping personal financial data.
total releases 12most recent commit 4 months ago
Dark Fantasy Hack Tool ⭐ 248
DDOS Tool: To take down small websites with HTTP FLOOD. Port scanner: To know the open ports of a site. FTP Password Cracker: To hack file system of websites.. Banner Grabber: To get the service or software running on a port. (After knowing the software running google for its vulnerabilities.) Web Spider: For gathering web application hacking information. Email scraper: To get all emails related to a webpage IMDB Rating: Easy way to access the movie database. Both .exe(compressed as zip) and .py
most recent commit 2 years ago
Rcrawler ⭐ 240
An R web crawler and scraper
total releases 9most recent commit 4 years ago
Sotoki ⭐ 212
StackExchange websites to ZIM scraper
total releases 30most recent commit 9 months ago
Transistor ⭐ 209
Transistor, a Python web scraping framework for intelligent use cases.
total releases 7most recent commit 4 months ago
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44most recent commit 4 months agopypi scrapelib} Downloads
Cheers ⭐ 194
Scrape a website efficiently, block by block, page by page. Based on cheerio and curl.
dependent packages 3total releases 7most recent commit 7 years agonpm cheers} Downloads
Scraply ⭐ 114
Scraply a simple dom scraper to fetch information from any html based website
total releases 1most recent commit 2 years ago
Python Web Scraping Cookbook ⭐ 107
Python Web Scraping Cookbook, published by Packt
most recent commit a year ago
Scraperboard ⭐ 94
Golang library to easily scrape websites based on simple XML declarations
most recent commit 9 years ago
The 10 Most Depended On Website Scraper Open Source Projects
Node Website Scraper ⭐ 1,456
Download website to local directory (including all css, images, js, etc.)
dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months agonpm website-scraper} Downloads
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44latest release December 15, 2023most recent commit 4 months agopypi scrapelib} Downloads
Table Scraper ⭐ 21
Simple utility for scraping data from html tables on a given website into a list of javascript objects
dependent packages 9total releases 4latest release July 20, 2020most recent commit 4 years agonpm table-scraper} Downloads
Scrapeasy ⭐ 21
Scraping in python made easy - receive the content you like in just one line of code
dependent packages 6total releases 3latest release March 14, 2018most recent commit 4 years agopypi scrapeasy} Downloads
Goscraper ⭐ 58
Golang pkg to quickly return a preview of a webpage (title/description/images)
dependent packages 6total releases 1latest release August 27, 2019most recent commit 4 years ago
Node Website Scraper Phantom ⭐ 53
Plugin for website-scraper which returns html for dynamic websites using PhantomJS.
dependent packages 4total releases 2latest release December 07, 2018most recent commit 2 years agonpm website-scraper-phantom} Downloads
Indonesian News Scraper ⭐ 27
Indonesian Online News Scraper
dependent packages 3total releases 25latest release May 15, 2017most recent commit 7 years agonpm indonesian-news-scraper} Downloads
Website Scraper Puppeteer ⭐ 270
Plugin for website-scraper which returns html for dynamic websites using puppeteer
dependent packages 3total releases 8latest release July 25, 2023most recent commit 4 months agonpm website-scraper-puppeteer} Downloads
Cheers ⭐ 194
Scrape a website efficiently, block by block, page by page. Based on cheerio and curl.
dependent packages 3total releases 7latest release October 27, 2015most recent commit 7 years agonpm cheers} Downloads
Amazon Scraper ⭐ 27
A price scraper for Amazon website powered by Node.JS x-ray Promises and passion.
dependent packages 3total releases 4latest release October 13, 2016most recent commit 7 years agonpm amazon-scraper} Downloads
The 10 Latest Releases In Website Scraper Open Source Projects
Scrapelib ⭐ 195
⛏ a library for scraping unreliable pages
dependent packages 12total releases 44latest release December 15, 2023most recent commit 4 months agopypi scrapelib} Downloads
Juriscraper ⭐ 314
An API to scrape American court websites for metadata.
total releases 481latest release December 11, 2023most recent commit 3 months ago
Scraperboard ⭐ 94
Golang library to easily scrape websites based on simple XML declarations
latest release November 26, 2023most recent commit 9 years ago
Socialblade Com Api ⭐ 9
Unofficial APIs for socialblade.com website.
dependent packages 1total releases 15latest release September 26, 2023most recent commit 4 months agonpm socialblade-com-api} Downloads
Website Scraper Puppeteer ⭐ 270
Plugin for website-scraper which returns html for dynamic websites using puppeteer
dependent packages 3total releases 8latest release July 25, 2023most recent commit 4 months agonpm website-scraper-puppeteer} Downloads
Node Scrapyard ⭐ 10
Scrapyard makes scraping websites easy.
dependent packages 1total releases 23latest release July 18, 2023most recent commit 9 months agonpm scrapyard} Downloads
Sotoki ⭐ 212
StackExchange websites to ZIM scraper
total releases 30latest release October 31, 2022most recent commit 9 months ago
Node Website Scraper ⭐ 1,456
Download website to local directory (including all css, images, js, etc.)
dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months agonpm website-scraper} Downloads
Scraply ⭐ 114
Scraply a simple dom scraper to fetch information from any html based website
total releases 1latest release July 07, 2022most recent commit 2 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.