The Top 23 Nodejs Scraper Open Source Projects

Open source projects categorized as Nodejs Scraper

Categories > Runtime Environments > Nodejs

Categories > Data Processing > Scraper

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747most recent commit 3 days ago

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187most recent commit 5 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27most recent commit 9 months ago

Thal ⭐ 2,268

Getting started with Puppeteer and Chrome Headless for Web Scraping

most recent commit 3 years ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86most recent commit 5 months ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61most recent commit 4 months ago

Article Extractor ⭐ 1,297

To extract main article from given URL with Node.js

dependent packages 10total releases 156most recent commit 3 months ago

Tiktok Live Connector ⭐ 963

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

dependent packages 1total releases 21most recent commit 3 months ago

Gogoanime Api ⭐ 575

Anime Streaming, Discovery API made with Cheerio and Express. Uses data from Gogoanime

most recent commit 5 months ago

Nodejs Stuff ⭐ 484

Node.js libs I want to keep in mind.

most recent commit 4 years ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42most recent commit 6 months ago

Unfurl ⭐ 424

Metadata scraper with support for oEmbed, Twitter Cards and Open Graph Protocol for Node.js ⚡

dependent packages 15total releases 43most recent commit 5 months ago

Linkedin Profile Scraper Api ⭐ 404

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

most recent commit 10 months ago

Micro Open Graph ⭐ 362

A tiny Node.js microservice to scrape open graph data with joy.

most recent commit 5 years ago

Node Imdb Api ⭐ 324

A non-scraping, functional node.js interface to imdb (mirror of gitlab.com/worr/node-imdb-api)

dependent packages 17total releases 30most recent commit a year ago

Proxy Scraper ⭐ 314

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

most recent commit 3 months ago

Harvestman ⭐ 278

Quick and dirty web crawling.

most recent commit 8 years ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8most recent commit 4 months ago

npm website-scraper-puppeteer} Downloads

Torrent Search Api ⭐ 258

Yet another node torrent scraper (supports iptorrents, torrentleech, torrent9, torrentz2, 1337x, thepiratebay, Yggtorrent, TorrentProject, Eztv, Yts, LimeTorrents)

dependent packages 27total releases 52most recent commit 3 years ago

Mwoffliner ⭐ 245

Mediawiki scraper: all your wiki articles in one highly compressed ZIM file

dependent packages 2total releases 400most recent commit 4 months ago

Instagram Proxy Api ⭐ 239

CORS compliant API to access Instagram's public data

most recent commit 6 years ago

Goose Parser ⭐ 222

Universal scraping tool, which allows you to extract data using multiple environments

dependent packages 6total releases 87most recent commit 5 years ago

Quickscrape ⭐ 219

A scraping command line tool for the modern web

dependent packages 2total releases 32most recent commit 8 years ago

The 10 Most Depended On Nodejs Scraper Open Source Projects

Node Ytdl Core ⭐ 4,087

YouTube video downloader in javascript.

dependent packages 773total releases 187latest release July 14, 2023most recent commit 5 months ago

Node Website Scraper ⭐ 1,456

Download website to local directory (including all css, images, js, etc.)

dependent packages 63total releases 61latest release October 09, 2022most recent commit 4 months ago

Node Osmosis ⭐ 4,083

Web scraper for NodeJS

dependent packages 58total releases 27latest release March 01, 2019most recent commit 9 months ago

Crawlee ⭐ 12,106

dependent packages 42total releases 747latest release December 10, 2023most recent commit 3 days ago

Google Play Scraper ⭐ 2,108

Node.js scraper to get data from Google Play

dependent packages 29total releases 86latest release August 09, 2023most recent commit 5 months ago

Torrent Search Api ⭐ 258

Yet another node torrent scraper (supports iptorrents, torrentleech, torrent9, torrentz2, 1337x, thepiratebay, Yggtorrent, TorrentProject, Eztv, Yts, LimeTorrents)

dependent packages 27total releases 52latest release May 29, 2021most recent commit 3 years ago

Webmiddle ⭐ 13

Node.js framework for modular web scraping and data extraction

dependent packages 27total releases 9latest release November 06, 2018most recent commit 4 years ago

Thepiratebay ⭐ 202

:skull: The Pirate Bay node.js client

dependent packages 27total releases 53latest release November 10, 2020most recent commit 2 years ago

Html Metadata ⭐ 115

MetaData html scraper and parser for Node.js (supports Promises and callback style)

dependent packages 26total releases 20latest release November 20, 2019most recent commit 4 years ago

Sourcescraper ⭐ 52

Simple library which helps you to retrieve the source of various video streaming sites.

dependent packages 25total releases 9latest release May 16, 2019most recent commit 5 years ago

The 10 Latest Releases In Nodejs Scraper Open Source Projects

Crawlee ⭐ 12,106

dependent packages 42total releases 747latest release December 10, 2023most recent commit 3 days ago

Ccdown ⭐ 8

Scraper and downloader for codecourse.com

dependent packages 2total releases 67latest release December 05, 2023most recent commit 5 months ago

Twitter Scraper ⭐ 63

A port of n0madic/twitter-scraper to Node.js.

dependent packages 2total releases 22latest release November 25, 2023most recent commit 4 months ago

npm @the-convocation/twitter-scraper} Downloads

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42latest release November 09, 2023most recent commit 6 months ago

Zenrows Node Sdk ⭐ 6

SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.

dependent packages 1total releases 15latest release October 21, 2023most recent commit 6 months ago

Node Csfd Api ⭐ 17

ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz :)

dependent packages 2total releases 91latest release October 04, 2023most recent commit 4 months ago

Noscrape ⭐ 32

obfuscate text via node to make scraping your content really difficult

dependent packages 2total releases 20latest release September 28, 2023most recent commit 4 months ago

Google Sr ⭐ 10

Easy to use, updated tools for scraping google search results. 🚀

dependent packages 3total releases 11latest release September 11, 2023most recent commit 4 months ago

Yahoo Stock Api ⭐ 26

💰 NPM package to get stock and historical price from finance.yahoo.com

dependent packages 1total releases 27latest release September 07, 2023most recent commit 8 months ago

Tiktok Live Connector ⭐ 963

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

dependent packages 1total releases 21latest release August 19, 2023most recent commit 3 months ago

Popular Runtime Environments Categories