Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scraper Scraping Websites Open Source Projects

Open source projects categorized as Scraper Scraping Websites
Categories > Data Processing > Scraper
Categories > Scraping Websites
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56most recent commit 4 months ago
Crawly ⭐ 790
Crawly, a high-level web crawling & scraping framework for Elixir.
total releases 18most recent commit 4 months ago
Edu Mail Generator ⭐ 707
Generate Free Edu Mail(s) within minutes
most recent commit a year ago
Phpscraper ⭐ 486
A universal web-util for PHP.
total releases 34most recent commit 5 months ago
Linkedin Profile Scraper Api ⭐ 404
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.
most recent commit 10 months ago
Dataflowkit ⭐ 394
Extract structured data from web sites. Web sites scraping.
most recent commit 4 years ago
Tinking ⭐ 337
🧶 Extract data from any website without code, just clicks.
most recent commit 3 years ago
Crawler ⭐ 285
Library for Rapid (Web) Crawler and Scraper Development
total releases 25most recent commit 3 months ago
Web Scraping ⭐ 281
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
most recent commit 3 months ago
Python Automation Scripts ⭐ 264
Simple yet powerful automation stuffs.
most recent commit 3 years ago
Requests Html ⭐ 207
Pythonic HTML Parsing for Humans™
dependent packages 219total releases 36most recent commit 2 years agopypi requests-html} Downloads
Email Extractor ⭐ 134
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
most recent commit a year ago
Spyscrap ⭐ 124
CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.
most recent commit 5 months ago
Nintendeals ⭐ 124
Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).
total releases 18most recent commit 4 months ago
Cloudflaresolverre ⭐ 117
Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.
dependent packages 4total releases 7most recent commit 3 years agonuget CloudflareSolverRe} Downloads
Leetcode Questions Scraper ⭐ 117
Scrape Algorithm Questions from leetcode and generate html and epub file
most recent commit 4 months ago
Scraply ⭐ 114
Scraply a simple dom scraper to fetch information from any html based website
total releases 1most recent commit 2 years ago
Html2rss ⭐ 106
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
total releases 20most recent commit 4 months ago
Seleniumcrawler ⭐ 105
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
most recent commit 5 years ago
The Youtube Scraper ⭐ 101
Download YouTube video description and video comments without using the YouTube API.
most recent commit 5 months ago
Anitop ⭐ 67
Anitop is an unofficial simple API from https://anitrendz.net/ site
most recent commit a year ago
Amazon_scraper ⭐ 64
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
dependent packages 2total releases 13most recent commit 3 months agonpm @scrapingant/amazon-proxy-scraper} Downloads
Webreaper ⭐ 59
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
total releases 17most recent commit 5 months ago
The 10 Most Depended On Scraper Scraping Websites Open Source Projects
Requests Html ⭐ 207
Pythonic HTML Parsing for Humans™
dependent packages 219total releases 36latest release February 17, 2019most recent commit 2 years agopypi requests-html} Downloads
Metafetch ⭐ 21
NodeJS package that fetches a given URL's title, description, images, links etc.
dependent packages 7total releases 52latest release September 20, 2022most recent commit 2 years agonpm metafetch} Downloads
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Cloudflaresolverre ⭐ 117
Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.
dependent packages 4total releases 7latest release November 28, 2019most recent commit 3 years agonuget CloudflareSolverRe} Downloads
Proxycrawl Node ⭐ 20
ProxyCrawl Node library for scraping and crawling
dependent packages 3total releases 20latest release March 25, 2022most recent commit 10 months agonpm proxycrawl} Downloads
Fbnix ⭐ 11
✂ Agent library for scraping Facebook groups and pages in Node.js
dependent packages 2total releases 5latest release June 14, 2020most recent commit 2 years agonpm fbnix} Downloads
Fulldom Server ⭐ 31
Proxy-like server that will show you the DOM of a page after JS runs
dependent packages 2total releases 3latest release October 17, 2016most recent commit 3 years agonpm fulldom} Downloads
Indonesia News Scraper ⭐ 18
A news scraper for nodejs that help to scrap news from Indonesian news portal.
dependent packages 2total releases 9latest release August 31, 2020most recent commit 3 years agonpm indo-news-scraper} Downloads
Amazon_scraper ⭐ 64
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
dependent packages 2total releases 13latest release June 10, 2022most recent commit 3 months agonpm @scrapingant/amazon-proxy-scraper} Downloads
Spb Unofficial Wrapper ⭐ 14
Unofficial NodeJS wrapper for the ScrapingBee API
dependent packages 1total releases 2latest release July 09, 2020most recent commit 4 years agonpm spb-unofficial-wrapper} Downloads
The 10 Latest Releases In Scraper Scraping Websites Open Source Projects
Crawler ⭐ 285
Library for Rapid (Web) Crawler and Scraper Development
total releases 25latest release December 01, 2023most recent commit 3 months ago
Crawly ⭐ 790
Crawly, a high-level web crawling & scraping framework for Elixir.
total releases 18latest release August 21, 2023most recent commit 4 months ago
Phpscraper ⭐ 486
A universal web-util for PHP.
total releases 34latest release June 18, 2023most recent commit 5 months ago
Scrapyteer ⭐ 9
Web crawling & scraping framework for Node.js on top of headless Chrome browser
total releases 8latest release June 07, 2023most recent commit 9 months ago
Worker ⭐ 12
Containerized Ferret worker
total releases 26latest release March 29, 2023most recent commit a year ago
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.