The Top 23 Javascript Scraper Open Source Projects

Open source projects categorized as Javascript Scraper

Categories > Programming Languages > Javascript

Categories > Data Processing > Scraper

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747most recent commit a day ago

Headless Chrome Crawler ⭐ 5,051

Distributed crawler powered by Headless Chrome

dependent packages 12total releases 21most recent commit 3 years ago

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187most recent commit 4 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27most recent commit 9 months ago

Scraperjs ⭐ 3,575

A complete and versatile web scraper.

dependent packages 39total releases 15most recent commit 7 years ago

Browser Fingerprinting ⭐ 3,353

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

most recent commit a year ago

Thal ⭐ 2,268

Getting started with Puppeteer and Chrome Headless for Web Scraping

most recent commit 3 years ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86most recent commit 5 months ago

Geziyor ⭐ 1,892

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

dependent packages 11total releases 6most recent commit a year ago

Node.io ⭐ 1,845

dependent packages 10total releases 109most recent commit 8 years ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61most recent commit 4 months ago

Article Extractor ⭐ 1,297

To extract main article from given URL with Node.js

dependent packages 10total releases 156most recent commit 3 months ago

Loklak_scraper_js ⭐ 1,094

Scrapers for loklak in javascript

most recent commit 5 years ago

Artoo ⭐ 1,024

artoo.js - the client-side scraping companion.

dependent packages 7total releases 10most recent commit 3 years ago

Pjscrape ⭐ 1,003

A web-scraping framework written in Javascript, using PhantomJS and jQuery

most recent commit 9 years ago

Web Scraper Chrome Extension ⭐ 980

Web data extraction tool implemented as chrome extension

most recent commit 5 years ago

Tiktok Live Connector ⭐ 963

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

dependent packages 1total releases 21most recent commit 3 months ago

Stealth ⭐ 923

🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy

most recent commit 7 months ago

Dochub ⭐ 796

speedy docs

most recent commit 12 years ago

Noodle ⭐ 740

A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.

dependent packages 3total releases 9most recent commit 6 years ago

Robintrack ⭐ 679

Scrapes the Robinhood API to retrieve + store popularity and price data.

most recent commit 3 months ago

Kuwala ⭐ 610

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data science models and products with a focus on geospatial data. Currently, the following data connectors are available worldwide: a) High-resolution demograp

most recent commit 2 years ago

Surgeon ⭐ 593

Declarative DOM extraction expression evaluator. 👨‍⚕️

dependent packages 5total releases 64most recent commit 4 years ago

The 10 Most Depended On Javascript Scraper Open Source Projects

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187latest release July 14, 2023most recent commit 4 months ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27latest release March 01, 2019most recent commit 9 months ago

Crawlee ⭐ 12,059

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Google This ⭐ 277

A simple yet powerful module to retrieve organic search results and much more from Google.

dependent packages 40total releases 38latest release September 18, 2023most recent commit 3 months ago

Scraperjs ⭐ 3,575

A complete and versatile web scraper.

dependent packages 39total releases 15latest release December 14, 2015most recent commit 7 years ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86latest release August 09, 2023most recent commit 5 months ago

Webmiddle ⭐ 13

Node.js framework for modular web scraping and data extraction

dependent packages 27total releases 9latest release November 06, 2018most recent commit 4 years ago

Html Metadata ⭐ 115

MetaData html scraper and parser for Node.js (supports Promises and callback style)

dependent packages 26total releases 20latest release November 20, 2019most recent commit 4 years ago

Humanparser ⭐ 84

Parse a human name string into salutation, first name, middle name, last name, suffix.

dependent packages 19total releases 39latest release May 20, 2023most recent commit a year ago

The 10 Latest Releases In Javascript Scraper Open Source Projects

Crawlee ⭐ 12,059

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Google News Scraper ⭐ 144

Lightweight scraper for Google News

dependent packages 2total releases 12latest release December 06, 2023most recent commit 4 months ago

Ccdown ⭐ 8

Scraper and downloader for codecourse.com

dependent packages 2total releases 67latest release December 05, 2023most recent commit 4 months ago

Amazon Scraper ⭐ 140

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

total releases 1latest release November 13, 2023most recent commit 5 months ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42latest release November 09, 2023most recent commit 5 months ago

Vsdown ⭐ 10

vueschool-downloader

dependent packages 1total releases 40latest release November 05, 2023most recent commit 5 months ago

Zenrows Node Sdk ⭐ 6

SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.

dependent packages 1total releases 15latest release October 21, 2023most recent commit 6 months ago

Node Csfd Api ⭐ 17

ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz :)

dependent packages 2total releases 91latest release October 04, 2023most recent commit 4 months ago

Socialblade Com Api ⭐ 9

Unofficial APIs for socialblade.com website.

dependent packages 1total releases 15latest release September 26, 2023most recent commit 4 months ago

Google This ⭐ 277

A simple yet powerful module to retrieve organic search results and much more from Google.

dependent packages 40total releases 38latest release September 18, 2023most recent commit 3 months ago

Popular Programming Languages Categories