Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for javascript scraper
javascript
x
scraper
x
472 search results found
Easyspider
⭐
19,209
A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/爬虫软件,可以无代码图形化
Crawlee
⭐
11,736
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Headless Chrome Crawler
⭐
5,051
Distributed crawler powered by Headless Chrome
Node Ytdl Core
⭐
4,087
YouTube video downloader in javascript.
Node Osmosis
⭐
4,083
Web scraper for NodeJS
Scraperjs
⭐
3,575
A complete and versatile web scraper.
Browser Fingerprinting
⭐
3,353
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
Thal
⭐
2,268
Getting started with Puppeteer and Chrome Headless for Web Scraping
Google Play Scraper
⭐
2,108
Node.js scraper to get data from Google Play
Geziyor
⭐
1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
Node.io
⭐
1,845
Node Website Scraper
⭐
1,456
Download website to local directory (including all css, images, js, etc.)
Article Extractor
⭐
1,297
To extract main article from given URL with Node.js
Loklak_scraper_js
⭐
1,094
Scrapers for loklak in javascript
Artoo
⭐
1,024
artoo.js - the client-side scraping companion.
Pjscrape
⭐
1,003
A web-scraping framework written in Javascript, using PhantomJS and jQuery
Web Scraper Chrome Extension
⭐
980
Web data extraction tool implemented as chrome extension
Tiktok Live Connector
⭐
963
Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
Stealth
⭐
923
🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
Dochub
⭐
796
speedy docs
Noodle
⭐
740
A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.
Robintrack
⭐
679
Scrapes the Robinhood API to retrieve + store popularity and price data.
Kuwala
⭐
610
Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data science models and products with a focus on geospatial data. Currently, the following data connectors are available worldwide: a) High-resolution demograp
Surgeon
⭐
593
Declarative DOM extraction expression evaluator. 👨⚕️
Newcrawler
⭐
583
Free Web Scraping Tool with Java
Node Scraper
⭐
516
Easier web scraping using node.js and jQuery
Nickjs
⭐
488
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
Nodejs Stuff
⭐
484
Node.js libs I want to keep in mind.
Webster
⭐
465
a reliable high-level web crawling & scraping framework for Node.js.
Dark Knowledge
⭐
425
😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
Github Scraper
⭐
402
🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡
Quetre
⭐
382
A libre front-end for Quora
Micro Open Graph
⭐
362
A tiny Node.js microservice to scrape open graph data with joy.
Node Imdb Api
⭐
324
A non-scraping, functional node.js interface to imdb (mirror of gitlab.com/worr/node-imdb-api)
Unofficial Valorant Api
⭐
322
Unofficial VALORANT API using the VALORANT Ingame API
Proxy Scraper
⭐
314
⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Scrubyt
⭐
304
A simple to learn and use, yet powerful web scraping toolkit!
Google Play Api
⭐
295
Turns google-play-scraper into a RESTful API
Google This
⭐
277
A simple yet powerful module to retrieve organic search results and much more from Google.
Youtube Projects
⭐
272
This repository contains all the code I use in my YouTube tutorials.
Website Scraper Puppeteer
⭐
270
Plugin for website-scraper which returns html for dynamic websites using puppeteer
Scraper
⭐
254
Simple web scraping for Google Chrome.
Web.scraper.workers.dev
⭐
248
Scrape websites for text by CSS selector.
Instagram Proxy Api
⭐
239
CORS compliant API to access Instagram's public data
Docs2epub
⭐
232
Doc scraper and ebook generator / library. [unmaintained]
Vaporboy
⭐
230
Gameboy / Gameboy Color Emulator PWA built with Preact. ⚛️ Powered by wasmBoy. 🎮Themed with VaporWave. 🌴🐬
Webscraping_python_selenium
⭐
220
Web Scraping Javascript generated pages using Python and Selenium
Quickscrape
⭐
219
A scraping command line tool for the modern web
Images Scraper
⭐
218
Simple and fast scraper for Google
Jsonframe Cheerio
⭐
198
simple multi-level scraper json input/output for Cheerio
Cloudflare Scraper
⭐
191
A package to bypass Cloudflare's protection
Fredy
⭐
184
❤️ Fredy - [F]ind [R]eal [E]states [D]amn Eas[y] - Fredy will constantly search for new listings on sites like Immoscout or Immowelt and send new results to you, so that you can focus on more important things in life ;)
Here Covid 19 Tracker
⭐
173
Using HERE Technologies APIs, fork and build your own COVID-19 Tracker. For a live version, see the website.
Tradingview Scraper
⭐
171
A gateway to TradingView's data for your Node.js application!
Bandcamp Scraper
⭐
166
A scraper for https://bandcamp.com
Opensea Scraper
⭐
166
Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info
Helena
⭐
165
A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.
Novel
⭐
164
基于 Laravel 5.2 的小说网站
Scrape Twitter
⭐
155
🐦 Access Twitter data without an API key. [DEPRECATED]
Malscraper
⭐
154
Scrape everything you can from MyAnimeList.net
Aliexpress Product Scraper
⭐
152
Get Aliexpress product details as a json response including feedbacks, variants, shipping info, description, images, etc.,
Site Audit Seo
⭐
151
Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.
Web Scraper Chrome Extension
⭐
149
Web data extraction tool implemented as chrome extension
Gatsby Source Instagram
⭐
148
Create nodes from instagram posts hashtags and profiles
Tokio
⭐
144
Web scraping made simple.
Google News Scraper
⭐
144
Lightweight scraper for Google News
Amazon Scraper
⭐
140
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
Ridereceipts
⭐
140
🚕 Simple automation desktop app to download and organize your receipts from Uber/Lyft. Try out our new Ride Receipts PRO !
Telegram Channel Scraper
⭐
137
Scrape messages from Telegram in a NodeJS cli program
Slideshare Downloader
⭐
129
Download ⬇️ slides from 🎨 SlideShare in no time⚡️
Theirtube
⭐
127
TheirTube scraper allows you to retrieve your own Youtube recommendation results on your local environment
Node Metainspector
⭐
124
Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem
Twitter Dev Salaries Scraper
⭐
121
https://docs.google.com/spreadsheets/d/1-xIgk7Mw1S
Cloudflaresolverre
⭐
117
Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.
Html Metadata
⭐
115
MetaData html scraper and parser for Node.js (supports Promises and callback style)
Node Scrapy
⭐
114
Simple, lightweight and expressive web scraping with Node.js
Chorus
⭐
112
Clone Hero-friendly Organized Repository of User-provided Songs
Headlesschrome
⭐
112
A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.
Scraper
⭐
109
AlphaReigns DHT Scraper, includes peer updater and categorizer
Sandcrawler
⭐
107
sandcrawler.js - the server-side scraping companion.
Biblioreads
⭐
104
An Alternative Private Goodreads Front-End.
Node Web Crawler
⭐
104
A web scraper with a web user interface which shows scraping stats in realtime. Uses Node.JS, jQuery, socket.io and Express.
Wechartweb3
⭐
102
Build a poocoin clone, scrape all the prices from pancakeswap or any other similar dex, build an historical record and offer an api to your users.
Reactriot2017 Dotamania
⭐
101
🌐 Web scraping made easy with the visual 🗺 mind map editor to JSON
Actor Scraper
⭐
93
House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
Bots Zoo
⭐
90
Openfaas Puppeteer Template
⭐
89
OpenFaaS template for headless Chrome and Puppeteer
Recipe Scraper
⭐
89
A JS package for scraping recipes from the web.
Animeez
⭐
88
AnimeEZ - An Anime Streaming website without any ads for free (Demo - https://animeez.live) BTW ITS MADE IN HTML
Linkout Scraper
⭐
88
Automate LinkedIn connection requests, follow messages, profile visits, post likes, and profile endorsements (Refactored Linvo)
Hooman
⭐
87
http interceptor to hoomanize cloudflare requests
Tacocat
⭐
86
A platform displaying the latest software engineer job information to entry-level new graduates
Humanparser
⭐
84
Parse a human name string into salutation, first name, middle name, last name, suffix.
Aliexscrape
⭐
84
Get Aliexpress product details in JSON
Malcontrol
⭐
83
Malware Control Monitor
Scrapper
⭐
83
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
Instagram Scraping
⭐
82
NodeJS module for scraping instagram media by hashtag
Tatooine
⭐
78
A powerful scraper for JavaScript Developers.
Media Downloader
⭐
78
Download Instagram Reels, Stories, Post, Stalk Instagram Profile, Facebook Public Videos, YouTube Videos and YouTube to MP3 converter, SoundCloud MP3 and Dailymotion videos. Made from Node JS Express JS, React JS and Rapid API.
Youtube Comment Scraper Cli
⭐
77
Command line utility for scraping YouTube comments.
Related Searches
Javascript Reactjs (121,118)
Javascript Html (52,781)
Javascript Css (46,402)
Javascript Deployment (32,768)
Javascript Express (27,853)
Javascript Command Line (22,145)
Javascript Testing (21,652)
Javascript Redux (21,545)
Javascript Vue (19,769)
Javascript Jquery (18,285)
1-100 of 472 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.