Awesome Open Source

Programming Languages

Search results for web crawler puppeteer

6 search results found

Crawlee ⭐ 12,643

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Browser Fingerprinting ⭐ 3,353

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Getting started with Puppeteer and Chrome Headless for Web Scraping

Phpscraper ⭐ 486

A universal web-util for PHP.

Browsertrix Crawler ⭐ 470

Run a high-fidelity browser-based crawler in a single Docker container

Make a ZIM file from any Web site and surf offline!

Aws Pdf Textract Pipeline ⭐ 148

🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

Gpt4v Scraper ⭐ 126

AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.

Actor Scraper ⭐ 93

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

Browser Pool ⭐ 77

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

Kampus Scraper ⭐ 50

Scraper & GraphQL API untuk data Perguruan Tinggi di Indonesia berdasarkan dari website Kementrian RISTEKDIKTI.

Maps To Lead ⭐ 48

Esse projeto tem como objetivo obter leads em formato JSON e enviar para um webhook

Puppeteer Service ⭐ 27

🎠 Run headless Chrome (aka Puppeteer) as a service.

Codepen Puppeteer ⭐ 21

Use Puppeteer to download pens from Codepen.io as single html pages

Puppeteer Railway Buildpack ⭐ 21

Installs dependencies needed in order to run puppeteer on Railway.

Browser Automation Api ⭐ 20

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

Trackpurchase ⭐ 19

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

Openai Scraper ⭐ 18

This is a template repository for building a web scraper with OpenAI support. The repository provides a basic project structure with TypeScript and Puppeteer pre-configured, as well as OpenAI's GPT-3 API integration. With this template, you can easily build a scraper that uses machine learning to analyze and extract insights from the scraped data.

Web Crawler created with Node.js and Puppeteer

Aniscrape ⭐ 17

Web scraping tool to download videos from TürkAnimeTV and AnimeciX

Puppeteer Daily Menu Scraper ⭐ 14

Scraping daily menus of restaurants from downtown Budapest with Puppeteer.

Web crawler based on Puppeteer

Twitterbot ⭐ 10

🐤 TwitterBot made using Node.js and Puppeteer that tweets random images from WikiHow

Botmation ⭐ 8

A simple TypeScript framework for declaratively composing bots with Puppeteer

Pronote Analytics ⭐ 7

API Pronote 🎉 très facile à utiliser, vous permettant d'extraire des données de votre compte Pronote.

Instascraper ⭐ 7

📊 A web scraping CLI tool for Instagram profiles.

Awesome Php Scrapers And Crawlers ⭐ 6

An awesome list covering PHP scrapers, spiders and crawlers

Puppeteer Web Scraping Automated ⭐ 6

Using NodeJS and Puppeteer to automate Web scraping and get notified about changes

Web App UI testing framework for the lazy.

Web Scraping Application ⭐ 5

Web scraping project for ACC Fall 2023

Automated_250_udemy_courses ⭐ 5

Enrolling to all 250 Free Udemy Course using Puppeteer and Chrome Headless for Web Scraping

Glasto Helper ⭐ 5

Automated Glastonbury ticket page refresh app

Related Searches

Javascript Puppeteer (1,699)

Scraper Web Crawler (1,388)

1-6 of 6 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.