The Top 23 Scraper Puppeteer Open Source Projects

Open source projects categorized as Scraper Puppeteer

Categories > Web Browsers > Puppeteer

Categories > Data Processing > Scraper

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747most recent commit a day ago

Headless Chrome Crawler ⭐ 5,051

Distributed crawler powered by Headless Chrome

dependent packages 12total releases 21most recent commit 3 years ago

Browser Fingerprinting ⭐ 3,353

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

most recent commit a year ago

Thal ⭐ 2,268

Getting started with Puppeteer and Chrome Headless for Web Scraping

most recent commit 3 years ago

Awesome Puppeteer ⭐ 2,245

A curated list of awesome puppeteer resources.

most recent commit 4 months ago

Fingerprint Suite ⭐ 587

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

dependent packages 13total releases 87most recent commit 3 months ago

Secret Agent ⭐ 575

The web scraper that's nearly impossible to block - now called @ulixee/hero

dependent packages 32total releases 33most recent commit a year ago

npm @secret-agent/core-interfaces} Downloads

Linvo Scraper ⭐ 553

Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io

dependent packages 2total releases 6most recent commit 8 months ago

Jvppeteer ⭐ 549

Headless Chrome For Java （Java 爬虫）

total releases 15most recent commit 10 months ago

Phpscraper ⭐ 486

A universal web-util for PHP.

total releases 34most recent commit 5 months ago

Se Scraper ⭐ 477

Javascript scraping module based on puppeteer for many different search engines...

dependent packages 1total releases 68most recent commit 2 years ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42most recent commit 5 months ago

Dark Knowledge ⭐ 425

😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.

most recent commit 3 months ago

Linkedin Profile Scraper Api ⭐ 404

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

most recent commit 10 months ago

Tinking ⭐ 337

🧶 Extract data from any website without code, just clicks.

most recent commit 3 years ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8most recent commit 4 months ago

npm website-scraper-puppeteer} Downloads

Images Scraper ⭐ 218

Simple and fast scraper for Google

dependent packages 9total releases 34most recent commit 3 months ago

Zimit ⭐ 209

Make a ZIM file from any Web site and surf offline!

most recent commit 3 months ago

Educative.io Downloader ⭐ 201

📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

most recent commit 4 months ago

Cloudflare Scraper ⭐ 191

A package to bypass Cloudflare's protection

dependent packages 8total releases 16most recent commit a year ago

Opensea Scraper ⭐ 166

Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info

dependent packages 3total releases 29most recent commit a year ago

Site Audit Seo ⭐ 151

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

dependent packages 1total releases 30most recent commit 3 months ago

Linkedin Jobs Scraper ⭐ 131

dependent packages 2total releases 76most recent commit 3 months ago

The 10 Most Depended On Scraper Puppeteer Open Source Projects

Crawlee ⭐ 12,059

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Secret Agent ⭐ 575

The web scraper that's nearly impossible to block - now called @ulixee/hero

dependent packages 32total releases 33latest release May 02, 2021most recent commit a year ago

Fingerprint Suite ⭐ 587

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

dependent packages 13total releases 87latest release December 01, 2023most recent commit 3 months ago

Headless Chrome Crawler ⭐ 5,051

Distributed crawler powered by Headless Chrome

dependent packages 12total releases 21latest release June 11, 2018most recent commit 3 years ago

Images Scraper ⭐ 218

Simple and fast scraper for Google

dependent packages 9total releases 34latest release November 13, 2022most recent commit 3 months ago

Cloudflare Scraper ⭐ 191

A package to bypass Cloudflare's protection

dependent packages 8total releases 16latest release January 08, 2023most recent commit a year ago

Browser Pool ⭐ 77

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

dependent packages 7total releases 82latest release June 20, 2022most recent commit a year ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8latest release July 25, 2023most recent commit 4 months ago

Opensea Scraper ⭐ 166

Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info

dependent packages 3total releases 29latest release November 16, 2022most recent commit a year ago

Populartimes.js ⭐ 8

dependent packages 2total releases 17latest release February 10, 2023most recent commit a year ago

The 10 Latest Releases In Scraper Puppeteer Open Source Projects

Crawlee ⭐ 12,059

dependent packages 42total releases 747latest release December 10, 2023most recent commit a day ago

Linkedin Jobs Scraper ⭐ 131

dependent packages 2total releases 76latest release December 07, 2023most recent commit 3 months ago

Fingerprint Suite ⭐ 587

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

dependent packages 13total releases 87latest release December 01, 2023most recent commit 3 months ago

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42latest release November 09, 2023most recent commit 5 months ago

Jawa ⭐ 9

Visual scraper interface, exports to puppeteer script which you can run anywhere.

dependent packages 2total releases 7latest release October 07, 2023most recent commit 5 months ago

Website Scraper Puppeteer ⭐ 270

Plugin for website-scraper which returns html for dynamic websites using puppeteer

dependent packages 3total releases 8latest release July 25, 2023most recent commit 4 months ago

Local Api Client Csharp ⭐ 39

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

total releases 11latest release July 21, 2023most recent commit 9 months ago

Local Api Client Python ⭐ 53

Official Python library for interacting with Kameleo Client

total releases 9latest release July 21, 2023most recent commit 9 months ago

Local Api Client Typescript ⭐ 54

Official JavaScript/TypeScript library for interacting with Kameleo Client

dependent packages 2total releases 11latest release July 20, 2023most recent commit 9 months ago

npm @kameleo/local-api-client} Downloads

Kaist Today Notice ⭐ 7

KAIST 오늘의 공지사항

dependent packages 2total releases 31latest release July 07, 2023most recent commit 3 months ago

Popular Web Browsers Categories