Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Hacktoberfest Scraper Open Source Projects

Open source projects categorized as Hacktoberfest Scraper
Categories > Community > Hacktoberfest
Categories > Data Processing > Scraper
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Devdocs ⭐ 33,315
API Documentation Browser
most recent commit 3 months ago
Cheerio ⭐ 27,702
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
dependent packages 20,519total releases 70most recent commit 15 days agonpm cheerio} Downloads
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56most recent commit 4 months ago
Scrape It ⭐ 3,978
🔮 A Node.js scraper for humans.
dependent packages 82total releases 45most recent commit a month agonpm scrape-it} Downloads
Panther ⭐ 2,849
A browser testing and web crawling library for PHP and Symfony
dependent packages 50total releases 23most recent commit 3 months agopackagist symfony/panther} Downloads
Facebook Scraper ⭐ 1,936
Scrape Facebook public pages without an API key
dependent packages 7total releases 76most recent commit 6 months agopypi facebook-scraper} Downloads
Scraper ⭐ 1,639
HTML parsing and querying with CSS selectors
dependent packages 371total releases 27most recent commit 4 months agocargo scraper} Downloads
Node Website Scraper ⭐ 1,456
Download website to local directory (including all css, images, js, etc.)
dependent packages 63total releases 61most recent commit 4 months agonpm website-scraper} Downloads
Cariddi ⭐ 1,228
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
total releases 15most recent commit 3 months ago
Parsel ⭐ 1,010
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
dependent packages 152total releases 22most recent commit 7 months agopypi parsel} Downloads
Tiktok Live Connector ⭐ 963
Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
dependent packages 1total releases 21most recent commit 3 months agonpm tiktok-live-connector} Downloads
Querido Diario ⭐ 944
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
most recent commit 3 months ago
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7most recent commit 6 months ago
Skrape.it ⭐ 714
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
dependent packages 3total releases 14most recent commit 4 months ago
Scala Scraper ⭐ 710
A Scala library for scraping content from HTML pages
dependent packages 2total releases 12most recent commit 3 months ago
Google Play Scraper ⭐ 645
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
dependent packages 2total releases 41most recent commit 4 months agopypi google-play-scraper} Downloads
Dataengineeringproject ⭐ 644
Example end to end data engineering project.
most recent commit a year ago
Linvo Scraper ⭐ 553
Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io
dependent packages 2total releases 6most recent commit 8 months agonpm linvo-scraper} Downloads
Communityscrapers ⭐ 545
This is a public repository containing scrapers created by the Stash Community.
most recent commit 3 months ago
Websurfx ⭐ 504
🚀 An open source alternative to searx which provides a modern-looking ✨, lightning-fast ⚡, privacy respecting 🥸, secure 🔒 meta search engine
most recent commit 3 months ago
Alltheplaces ⭐ 502
A set of spiders and scrapers to extract location information from places that post their location on the internet.
most recent commit 3 months ago
Spidermon ⭐ 486
Scrapy Extension for monitoring spiders execution.
total releases 18most recent commit 5 months ago
The 10 Most Depended On Hacktoberfest Scraper Open Source Projects
Cheerio ⭐ 27,702
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
dependent packages 20,519total releases 70latest release June 26, 2022most recent commit 15 days agonpm cheerio} Downloads
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Scraper ⭐ 1,639
HTML parsing and querying with CSS selectors
dependent packages 371total releases 27latest release October 29, 2023most recent commit 4 months agocargo scraper} Downloads
Parsel ⭐ 1,010
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
dependent packages 152total releases 22latest release April 18, 2023most recent commit 7 months agopypi parsel} Downloads
Scrape It ⭐ 3,978
🔮 A Node.js scraper for humans.
dependent packages 82total releases 45latest release October 20, 2023most recent commit a month agonpm scrape-it} Downloads
Node Website Scraper ⭐ 1,456
Download website to local directory (including all css, images, js, etc.)
dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months agonpm website-scraper} Downloads
Panther ⭐ 2,849
A browser testing and web crawling library for PHP and Symfony
dependent packages 50total releases 23latest release December 03, 2023most recent commit 3 months agopackagist symfony/panther} Downloads
Facebook Scraper ⭐ 1,936
Scrape Facebook public pages without an API key
dependent packages 7total releases 76latest release November 10, 2020most recent commit 6 months agopypi facebook-scraper} Downloads
Bandcamp Scraper ⭐ 166
A scraper for https://bandcamp.com
dependent packages 6total releases 24latest release September 10, 2022most recent commit 2 years agonpm bandcamp-scraper} Downloads
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
The 10 Latest Releases In Hacktoberfest Scraper Open Source Projects
Panther ⭐ 2,849
A browser testing and web crawling library for PHP and Symfony
dependent packages 50total releases 23latest release December 03, 2023most recent commit 3 months agopackagist symfony/panther} Downloads
Crawler ⭐ 285
Library for Rapid (Web) Crawler and Scraper Development
total releases 25latest release December 01, 2023most recent commit 3 months ago
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
Scraper ⭐ 1,639
HTML parsing and querying with CSS selectors
dependent packages 371total releases 27latest release October 29, 2023most recent commit 4 months agocargo scraper} Downloads
Scrape It ⭐ 3,978
🔮 A Node.js scraper for humans.
dependent packages 82total releases 45latest release October 20, 2023most recent commit a month agonpm scrape-it} Downloads
Cryptocmd ⭐ 472
Cryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.
dependent packages 5total releases 27latest release October 13, 2023most recent commit 6 months agopypi cryptocmd} Downloads
Scrape ⭐ 125
CLI utility to scrape emails from websites
dependent packages 1total releases 29latest release October 09, 2023most recent commit 4 months ago
Jawa ⭐ 9
Visual scraper interface, exports to puppeteer script which you can run anywhere.
dependent packages 2total releases 7latest release October 07, 2023most recent commit 5 months agonpm jawa} Downloads
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7latest release September 20, 2023most recent commit 6 months ago
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Popular Community Categories
Social
Chinese
Conference
Japanese
Feedback
Meetup
Cats
Open Data
China
Stanford
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.