Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Crawlee | 11,957 | 42 | 6 days ago | 747 | December 10, 2023 | 96 | apache-2.0 | TypeScript | ||
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. | ||||||||||
Url To Pdf Api | 6,946 | 3 months ago | 57 | mit | HTML | |||||
Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content. | ||||||||||
Headless Chrome Crawler | 5,051 | 10 | 12 | 3 years ago | 21 | June 11, 2018 | 28 | mit | JavaScript | |
Distributed crawler powered by Headless Chrome | ||||||||||
Flaresolverr | 4,623 | 3 months ago | 49 | mit | Python | |||||
Proxy server to bypass Cloudflare protection | ||||||||||
Pyppeteer | 3,240 | 4 years ago | 154 | other | Python | |||||
Headless chrome/chromium automation library (unofficial port of puppeteer) | ||||||||||
Pyppeteer | 3,226 | 185 | 199 | 4 months ago | 31 | January 11, 2022 | 198 | other | Python | |
Headless chrome/chromium automation library (unofficial port of puppeteer) | ||||||||||
Thal | 2,268 | 3 years ago | mit | JavaScript | ||||||
Getting started with Puppeteer and Chrome Headless for Web Scraping | ||||||||||
Awesome Puppeteer | 2,245 | 4 months ago | 19 | |||||||
A curated list of awesome puppeteer resources. | ||||||||||
Phantomas | 2,239 | 78 | 18 | 3 months ago | 55 | September 18, 2023 | 60 | bsd-2-clause | JavaScript | |
Headless Chromium-based web performance metrics collector and monitoring tool | ||||||||||
Awesome Regression Testing | 2,015 | 5 months ago | 3 | cc-by-sa-4.0 | ||||||
🕶️ A curated list of resources around the topic: visual regression testing |