Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for scraper headless browsers
headless-browsers
x
scraper
x
1 search results found
Crawlee
⭐
12,240
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Headless Chrome Crawler
⭐
5,051
Distributed crawler powered by Headless Chrome
Rod
⭐
4,505
A Devtools driver for web automation and scraping
Thal
⭐
2,268
Getting started with Puppeteer and Chrome Headless for Web Scraping
Awesome Puppeteer
⭐
2,245
A curated list of awesome puppeteer resources.
Kimuraframework
⭐
874
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites
Linkedin
⭐
602
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Secret Agent
⭐
575
The web scraper that's nearly impossible to block - now called @ulixee/hero
Jvppeteer
⭐
549
Headless Chrome For Java (Java 爬虫)
Nickjs
⭐
488
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
Nodejs Stuff
⭐
484
Node.js libs I want to keep in mind.
Dataflowkit
⭐
394
Extract structured data from web sites. Web sites scraping.
Arachnid
⭐
246
Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites
Images Scraper
⭐
218
Simple and fast scraper for Google
Transistor
⭐
209
Transistor, a Python web scraping framework for intelligent use cases.
Selenium_extensions
⭐
141
Tools that will make writing tests, bots and scrapers using Selenium much easier
Headlesschrome
⭐
112
A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.
Python Selenium Action
⭐
93
Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!
Openfaas Puppeteer Template
⭐
89
OpenFaaS template for headless Chrome and Puppeteer
Jabba Webkit
⭐
86
Jabba's headless webkit browser for scraping AJAX-powered webpages.
Scrapper
⭐
83
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
Browser Pool
⭐
77
A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Rubium
⭐
66
Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby
Scraper
⭐
45
Node.js based scraper using headless chrome
Easy Reddit Downloader
⭐
43
Simple headless Reddit post downloader
Activesoup
⭐
36
A headless pure-python browser for the web
Node Red Contrib Nbrowser
⭐
32
Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.
Gisaid Scrapper
⭐
31
Scrapping tool for GISAID data regarding SARS-CoV-2
Nodejs Web Scraper Cookbook
⭐
30
📝 Resources for web scraping with node.js
Thresher
⭐
26
Headless scraperJSON scraping for Node.js
Tradingview Scraper
⭐
26
TradingView Scraper using Selenium Web Driver and Chrome headless for Cryptocurrency Signals
Scrapy Scrapingbee
⭐
26
JavaScript support and proxy rotation for Scrapy with ScrapingBee.
Webparsy
⭐
25
Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
Mimo Crawler
⭐
24
A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Python Web Scraping Examples
⭐
22
Fb Event Scraper
⭐
20
Kimurai
⭐
19
Kimurai is a modern web scraping framework written in Ruby which works out of box with headless chromium/firefox, phantomjs, or simple HTTP requests and allows to scrape and interact with javascript rendered websites
Chesf
⭐
19
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Headless Task Server
⭐
17
A headless browser task manager based on Hero (Chrome)
Pythonista Chromeless
⭐
16
Serverless selenium which dynamically execute any given code.
Emailscraper
⭐
15
Minimalistic library to scrape emails from websites with headless browser support.
Alibaba_scraper
⭐
10
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Scrapeybara
⭐
9
A web scraping tool based on Capybara. This project is deprecated.
Scrapyteer
⭐
9
Web crawling & scraping framework for Node.js on top of headless Chrome browser
Automated Job Web Scraping
⭐
8
🌓 [Demo & Guide] Script to do automated specific job searches and look for job postings straight from select company career websites.
Botasaurus Starter
⭐
7
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Puppeteer Scraper
⭐
6
Implement crawlers using a sane api on top of codeceptjs and puppeteer
Zoominfo_scraper
⭐
6
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Automated_250_udemy_courses
⭐
5
Enrolling to all 250 Free Udemy Course using Puppeteer and Chrome Headless for Web Scraping
Python Headless Chromedriver
⭐
5
Docker container with python & selenium for headless web scraping. Uses Chrome as driver
Instagram Scraper Api
⭐
5
Scrapes instagram profiles
Arachnida
⭐
5
App to scrap the web, for people without coding skills. Fully integrates WebCrawlers (Headless Chrome) and the interface to deal with it.
Related Searches
Python Scraper (3,513)
Javascript Scraper (2,047)
Scraper Scrape (1,534)
Scraper Web Crawler (1,528)
Javascript Headless Browsers (1,178)
Scraper Crawler (904)
Html Scraper (757)
1-1 of 1 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.