Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for scraper puppeteer
puppeteer
x
scraper
x
66 search results found
Crawlee
⭐
12,106
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Headless Chrome Crawler
⭐
5,051
Distributed crawler powered by Headless Chrome
Browser Fingerprinting
⭐
3,353
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
Thal
⭐
2,268
Getting started with Puppeteer and Chrome Headless for Web Scraping
Awesome Puppeteer
⭐
2,245
A curated list of awesome puppeteer resources.
Fingerprint Suite
⭐
587
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
Secret Agent
⭐
575
The web scraper that's nearly impossible to block - now called @ulixee/hero
Linvo Scraper
⭐
553
Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io
Jvppeteer
⭐
549
Headless Chrome For Java (Java 爬虫)
Phpscraper
⭐
486
A universal web-util for PHP.
Se Scraper
⭐
477
Javascript scraping module based on puppeteer for many different search engines...
Webster
⭐
465
a reliable high-level web crawling & scraping framework for Node.js.
Dark Knowledge
⭐
425
😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
Linkedin Profile Scraper Api
⭐
404
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
Tinking
⭐
337
🧶 Extract data from any website without code, just clicks.
Website Scraper Puppeteer
⭐
270
Plugin for website-scraper which returns html for dynamic websites using puppeteer
Images Scraper
⭐
218
Simple and fast scraper for Google
Zimit
⭐
209
Make a ZIM file from any Web site and surf offline!
Educative.io Downloader
⭐
201
📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.
Cloudflare Scraper
⭐
191
A package to bypass Cloudflare's protection
Opensea Scraper
⭐
166
Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info
Site Audit Seo
⭐
151
Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.
Linkedin Jobs Scraper
⭐
131
Theirtube
⭐
127
TheirTube scraper allows you to retrieve your own Youtube recommendation results on your local environment
Double Agent
⭐
120
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Actor Scraper
⭐
93
House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
Bots Zoo
⭐
90
Openfaas Puppeteer Template
⭐
89
OpenFaaS template for headless Chrome and Puppeteer
Linkout Scraper
⭐
88
Automate LinkedIn connection requests, follow messages, profile visits, post likes, and profile endorsements (Refactored Linvo)
Browser Pool
⭐
77
A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Whatsapp Net
⭐
74
Generate a network graph of connections from your WhatsApp groups data
Local Api Examples
⭐
64
Useful and easy to understand examples written in Node.js and .NET Core about web scraping and automated browsing with Kameleo Client
Scraping Service
⭐
61
REST API for scraping dynamic websites using Node.js, headless Chrome and Cheerio.
Barclayscrape
⭐
57
A small app to programmatically mainpulate Barclays online banking
Local Api Client Typescript
⭐
54
Official JavaScript/TypeScript library for interacting with Kameleo Client
Local Api Client Python
⭐
53
Official Python library for interacting with Kameleo Client
Fbjs
⭐
53
Tooling that automates your Facebook interactions.
Kampus Scraper
⭐
50
Scraper & GraphQL API untuk data Perguruan Tinggi di Indonesia berdasarkan dari website Kementrian RISTEKDIKTI.
Maps To Lead
⭐
48
Esse projeto tem como objetivo obter leads em formato JSON e enviar para um webhook
Freenom Auto Renew Domains
⭐
45
A scraper built with puppeteer that auto renew free domains on Freenom and send discord message using bot
Public Instagram
⭐
44
Tool to fetch Instagram's public content.
Puppeteer Botcheck
⭐
44
🕵♂ Bot detection tests for Puppeteer. Hide and seek!
Browser As A Service
⭐
43
A web browser 🌎 hosted as a service, to render your JavaScript web pages as HTML
Funko Pop Data
⭐
42
Open-source database of all Funko Pop data.
Puppeteer Scraper
⭐
40
A Better Scraper, with Puppeteer
Whatsapp Tracking
⭐
39
Scraping the status of WhatsApp contacts
Local Api Client Csharp
⭐
39
This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.
Linkebot
⭐
36
🔎 um bot de Web Scraping para mostrar vagas do LinkedIn
Crawler
⭐
32
Chromium / Puppeteer site crawler
Foundation
⭐
31
🧱 A uniform template to use as a foundation for Puppeteer bot construction.
Naos
⭐
30
📉 Uptime and error monitoring CLI
Htmlspitter
⭐
28
NodeJS server to spit out HTML from loaded JS using Puppeteer
Bunnystwitterscraper
⭐
25
Archive individual tweets and attached media using the Twitter API, youtube-dl, and some python
Wind Scrape
⭐
25
Node package for scraping wind forecast from a few websites
Webparsy
⭐
25
Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
Bet365 Live Soccer Scraper
⭐
25
Bet365 Live Soccer Score Scraper
Timetable Grabber Sit
⭐
23
Timetable Grabber - SIT is a tool that allows you to grab and export your trimester's timetable to the .ics format where you can import it to your favourite calendar.
Leumi Leumicard Bank Data Scraper
⭐
22
Open bank data for Leumi bank and Leumi card credit card
Linkedin Reverese Lookup
⭐
21
🔎Search LinkedIn profile by email address📧
Browser Automation Api
⭐
20
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Puppeteer Table Parser
⭐
20
Scrape and parse HTML tables with the Puppeteer table parser.
Facebook Scrape Group
⭐
20
🕸️ Scrape facebook group post permalinks
Reddit Bot Scraper
⭐
19
Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories
Openai Scraper
⭐
18
This is a template repository for building a web scraper with OpenAI support. The repository provides a basic project structure with TypeScript and Puppeteer pre-configured, as well as OpenAI's GPT-3 API integration. With this template, you can easily build a scraper that uses machine learning to analyze and extract insights from the scraped data.
Crawler
⭐
17
Web Crawler created with Node.js and Puppeteer
Puppet Scraper
⭐
17
Scraping using Puppeteer the sane way 🤹🏻♂️
Headless Task Server
⭐
17
A headless browser task manager based on Hero (Chrome)
Netflix Movies Scraper
⭐
17
This is a Node.js and Puppeteer project that scrapes movies from Netflix, gets movie information from the OMDB API, and exports all data to a CSV file.
Js Renderer
⭐
16
A online puppeteer service on Vercel to render pages with javascript (js). Mainly useful for web scraping (not using splash).
Soccer Scrape
⭐
16
📃 Scrape football data from Bet365
Puppeteer Daily Menu Scraper
⭐
14
Scraping daily menus of restaurants from downtown Budapest with Puppeteer.
Horseman Article Parser
⭐
13
A web page article parser which returns an object containing the article's formatted text and other attributes including sentiment, keyphrases, people, places, organisations, spelling suggestions, in-article links, meta data & lighthouse audit results.
Skyscanner Flights Scraping
⭐
12
A scraping tool (for personal use, not commercial) to get some information about flights
Dodgem
⭐
12
🎪 Rocket League Garage trade bumping automation CLI bot
Whatdidibuy
⭐
12
Scrape your order history from Digi-Key, Mouser, and more
Arachnid Seo Js
⭐
11
Web crawler for extracting internal site links info for SEO auditing & optimization purposes
Fbnix
⭐
11
✂ Agent library for scraping Facebook groups and pages in Node.js
Scraper
⭐
10
Demo for scrapers
Amazon Scrapper 1m Nodejs
⭐
9
An amazon scrapper to scrape 1 million products {title, price, images} using nodeJS & puppeteer
Jawa
⭐
9
Visual scraper interface, exports to puppeteer script which you can run anywhere.
Populartimes.js
⭐
8
Find the popular times of a location by scraping Google Maps with Puppeteer.
Blinkist Scraper
⭐
8
Scrape blinkist!
Puppeteer Boiler
⭐
8
🛢 A batteries included boilerplate for puppeteer-extra. Automate all the things!
Automated Job Web Scraping
⭐
8
🌓 [Demo & Guide] Script to do automated specific job searches and look for job postings straight from select company career websites.
Instascraper
⭐
7
📊 A web scraping CLI tool for Instagram profiles.
Nba Topshot Scraper
⭐
7
Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. Data is scraped once per day.
Kaist Today Notice
⭐
7
KAIST 오늘의 공지사항
Egghead Scraping
⭐
7
📥 Puppeteer Egghead video downloader
Knowyourzone
⭐
7
Malaysia COVID-19 Zone Colour Visualizer. JSON data API available.
Web Scraping Puppeteer
⭐
7
scrapping data from Amazon and eBay with the item name
Node Proxy Pool
⭐
7
IP Proxy collect library for Node.js
Puppeteer Infinite Scroll
⭐
7
aabstraction to help scrape data from sites with infinite scroll
Stealthy Scraper
⭐
7
Extra stealthy web scraper in Typescript
Scr Cli
⭐
7
Social media web scraper CLI for post file downloads.
Insta_scrape_insta
⭐
6
>Extract Instagram User Information, Post Information Without Login in the form of a .json file or a javaScript Object.
Puppeteer Scraper
⭐
6
Implement crawlers using a sane api on top of codeceptjs and puppeteer
Car Price Scraper
⭐
6
🚗 A Car Price Scraper-Optimizer Using Puppeteer
Excalibur
⭐
6
Serverless, Chromium-powered HKUST SIS Scraper
Iptv_ro
⭐
6
A simple web API for acquiring media streams from a couple of service providers
Puppeteer Web Scraping Automated
⭐
6
Using NodeJS and Puppeteer to automate Web scraping and get notified about changes
Related Searches
Python Scraper (3,513)
Javascript Scraper (2,047)
Javascript Puppeteer (1,642)
Scraper Scrape (1,534)
Scraper Web Crawler (1,528)
Scraper Crawler (904)
Html Scraper (757)
1-66 of 66 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.