The Top 23 Javascript Nodejs Scraper Open Source Projects

Open source projects categorized as Javascript Nodejs Scraper

Categories > Programming Languages > Javascript

Categories > Runtime Environments > Nodejs

Categories > Data Processing > Scraper

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747most recent commit a day ago

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187most recent commit 5 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27most recent commit 9 months ago

Thal ⭐ 2,268

Getting started with Puppeteer and Chrome Headless for Web Scraping

most recent commit 3 years ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86most recent commit 5 months ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61most recent commit 4 months ago

Article Extractor ⭐ 1,297

To extract main article from given URL with Node.js

dependent packages 10total releases 156most recent commit 3 months ago

Tiktok Live Connector ⭐ 963

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

dependent packages 1total releases 21most recent commit 3 months ago

Nodejs Stuff ⭐ 484

Node.js libs I want to keep in mind.

most recent commit 4 years ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42most recent commit 5 months ago

Micro Open Graph ⭐ 362

A tiny Node.js microservice to scrape open graph data with joy.

most recent commit 5 years ago

Node Imdb Api ⭐ 324

A non-scraping, functional node.js interface to imdb (mirror of gitlab.com/worr/node-imdb-api)

dependent packages 17total releases 30most recent commit a year ago

Proxy Scraper ⭐ 314

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

most recent commit 3 months ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8most recent commit 4 months ago

npm website-scraper-puppeteer} Downloads

Instagram Proxy Api ⭐ 239

CORS compliant API to access Instagram's public data

most recent commit 6 years ago

Quickscrape ⭐ 219

A scraping command line tool for the modern web

dependent packages 2total releases 32most recent commit 8 years ago

Images Scraper ⭐ 218

Simple and fast scraper for Google

dependent packages 9total releases 34most recent commit 3 months ago

Tradingview Scraper ⭐ 171

A gateway to TradingView's data for your Node.js application!

dependent packages 1total releases 7most recent commit a year ago

Telegram Channel Scraper ⭐ 137

Scrape messages from Telegram in a NodeJS cli program

most recent commit 2 years ago

Theirtube ⭐ 127

TheirTube scraper allows you to retrieve your own Youtube recommendation results on your local environment

most recent commit 2 years ago

Node Metainspector ⭐ 124

Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem

dependent packages 9total releases 8most recent commit 5 years ago

Html Metadata ⭐ 115

MetaData html scraper and parser for Node.js (supports Promises and callback style)

dependent packages 26total releases 20most recent commit 4 years ago

Node Scrapy ⭐ 114

Simple, lightweight and expressive web scraping with Node.js

dependent packages 11total releases 11most recent commit 4 years ago

The 10 Most Depended On Javascript Nodejs Scraper Open Source Projects

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187latest release July 14, 2023most recent commit 5 months ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27latest release March 01, 2019most recent commit 9 months ago

Crawlee ⭐ 12,106

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86latest release August 09, 2023most recent commit 5 months ago

Webmiddle ⭐ 13

Node.js framework for modular web scraping and data extraction

dependent packages 27total releases 9latest release November 06, 2018most recent commit 4 years ago

Html Metadata ⭐ 115

MetaData html scraper and parser for Node.js (supports Promises and callback style)

dependent packages 26total releases 20latest release November 20, 2019most recent commit 4 years ago

Node Imdb Api ⭐ 324

A non-scraping, functional node.js interface to imdb (mirror of gitlab.com/worr/node-imdb-api)

dependent packages 17total releases 30latest release November 08, 2020most recent commit a year ago

Youtube Playlist ⭐ 31

:snowflake: Extract links, ids, and names from a youtube playlist

dependent packages 14total releases 5latest release July 19, 2020most recent commit 4 years ago

Node Scrapy ⭐ 114

Simple, lightweight and expressive web scraping with Node.js

dependent packages 11total releases 11latest release August 24, 2020most recent commit 4 years ago

The 10 Latest Releases In Javascript Nodejs Scraper Open Source Projects

Crawlee ⭐ 12,106

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Ccdown ⭐ 8

Scraper and downloader for codecourse.com

dependent packages 2total releases 67latest release December 05, 2023most recent commit 5 months ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42latest release November 09, 2023most recent commit 5 months ago

Zenrows Node Sdk ⭐ 6

SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.

dependent packages 1total releases 15latest release October 21, 2023most recent commit 6 months ago

Node Csfd Api ⭐ 17

ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz :)

dependent packages 2total releases 91latest release October 04, 2023most recent commit 4 months ago

Tiktok Live Connector ⭐ 963

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

dependent packages 1total releases 21latest release August 19, 2023most recent commit 3 months ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86latest release August 09, 2023most recent commit 5 months ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8latest release July 25, 2023most recent commit 4 months ago

Impressionist ⭐ 10

Impressionist is a JavaScript library that allows you to scrape data in less time.

dependent packages 2total releases 8latest release July 19, 2023most recent commit 9 months ago

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187latest release July 14, 2023most recent commit 5 months ago

Popular Programming Languages Categories