Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Hacktoberfest Scraper Crawler Open Source Projects

Open source projects categorized as Hacktoberfest Scraper Crawler
Categories > Data Processing > Crawler
Categories > Community > Hacktoberfest
Categories > Data Processing > Scraper
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56most recent commit 4 months ago
Cariddi ⭐ 1,228
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
total releases 15most recent commit 3 months ago
Querido Diario ⭐ 944
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
most recent commit 3 months ago
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7most recent commit 6 months ago
Skrape.it ⭐ 714
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
dependent packages 3total releases 14most recent commit 4 months ago
Google Play Scraper ⭐ 645
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
dependent packages 2total releases 41most recent commit 4 months agopypi google-play-scraper} Downloads
Spidermon ⭐ 486
Scrapy Extension for monitoring spiders execution.
total releases 18most recent commit 5 months ago
Moodle Dl ⭐ 355
Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)
total releases 80most recent commit 6 months ago
Crawler ⭐ 285
Library for Rapid (Web) Crawler and Scraper Development
total releases 25most recent commit 3 months ago
Aliexpress Product Scraper ⭐ 152
Get Aliexpress product details as a json response including feedbacks, variants, shipping info, description, images, etc.,
most recent commit 4 months ago
Estela ⭐ 142
estela, an elastic web scraping cluster 🕸
most recent commit 3 months ago
Aliexscrape ⭐ 84
Get Aliexpress product details in JSON
dependent packages 2total releases 12most recent commit a year agonpm aliexscrape} Downloads
Ca Property Tax ⭐ 78
CA property tax visualization
most recent commit 2 years ago
Webscrapper ⭐ 77
Simple and powerfull all in one Telegram Bot to scrap webpages using Requests, html5lib and Beautifulsoup
most recent commit 4 months ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3most recent commit 6 months ago
Ronin Web ⭐ 40
ronin-web is a collection of useful web helper methods and commands.
dependent packages 3total releases 16most recent commit 4 months agorubygems ronin-web} Downloads
Darkspider ⭐ 20
Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler
most recent commit a year ago
Master To Pythonista ⭐ 12
A list of awesome beginners-friendly projects.
most recent commit 2 years ago
Worker ⭐ 12
Containerized Ferret worker
total releases 26most recent commit a year ago
Fifa Stats Crawler ⭐ 9
A web-crawler to scrape FIFA 20 and 21 players' latest information from Sofifa Website
most recent commit 3 years ago
Crawlify ⭐ 7
Simple Concurrent Crawler
most recent commit 2 years ago
Scrape Them All ⭐ 7
🚀 An easy-to-handle Node.js scraper that allow you to scrape them all in a record time.
total releases 4most recent commit 3 years ago
The 6 Most Depended On Hacktoberfest Scraper Crawler Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Ronin Web ⭐ 40
ronin-web is a collection of useful web helper methods and commands.
dependent packages 3total releases 16latest release April 04, 2023most recent commit 4 months agorubygems ronin-web} Downloads
Aliexscrape ⭐ 84
Get Aliexpress product details in JSON
dependent packages 2total releases 12latest release February 25, 2019most recent commit a year agonpm aliexscrape} Downloads
Google Play Scraper ⭐ 645
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
dependent packages 2total releases 41latest release January 31, 2023most recent commit 4 months agopypi google-play-scraper} Downloads
The 10 Latest Releases In Hacktoberfest Scraper Crawler Open Source Projects
Crawler ⭐ 285
Library for Rapid (Web) Crawler and Scraper Development
total releases 25latest release December 01, 2023most recent commit 3 months ago
Scrapyrt ⭐ 793
HTTP API for Scrapy spiders
total releases 7latest release September 20, 2023most recent commit 6 months ago
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Spidermon ⭐ 486
Scrapy Extension for monitoring spiders execution.
total releases 18latest release September 01, 2023most recent commit 5 months ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3latest release July 09, 2023most recent commit 6 months ago
Ronin Web ⭐ 40
ronin-web is a collection of useful web helper methods and commands.
dependent packages 3total releases 16latest release April 04, 2023most recent commit 4 months agorubygems ronin-web} Downloads
Worker ⭐ 12
Containerized Ferret worker
total releases 26latest release March 29, 2023most recent commit a year ago
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Google Play Scraper ⭐ 645
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
dependent packages 2total releases 41latest release January 31, 2023most recent commit 4 months agopypi google-play-scraper} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.