Awesome Open Source

Programming Languages

Search results for typescript scraper

141 search results found

Crawlee ⭐ 12,158

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Tiktok Scraper ⭐ 3,554

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.

Api.consumet.org ⭐ 867

A Modern Search Engine API for Anime, Movies/TVShows, Books, Light Novels, Manga, etc.

Opengraphscraper ⭐ 593

Node.js scraper service for Open Graph Info and More!

Lyricfier ⭐ 591

a Spotify Lyrics alternative app | New updates at https://github.com/emilioastarita/lyricfier2 (a faster version in golang)

Fingerprint Suite ⭐ 587

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

Secret Agent ⭐ 575

The web scraper that's nearly impossible to block - now called @ulixee/hero

Linvo Scraper ⭐ 553

Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io

Nintendo Switch Eshop ⭐ 513

Crawler for Nintendo Switch eShop

Israeli Bank Scrapers ⭐ 504

Provide scrapers for all major Israeli banks and credit card companies

Metadata scraper with support for oEmbed, Twitter Cards and Open Graph Protocol for Node.js ⚡

Googlebard ⭐ 377

GoogleBard - A reverse engineered API for Google Bard chatbot for NodeJS

Instagram Scraper ⭐ 367

Instagram Scraper. Scrape useful data/posts from instagram users, hashtag and locations pages. Comments and people who liked specific posts and soon more. No login or API keys are required

The unofficial HLTV Node.js API

Tinking ⭐ 337

🧶 Extract data from any website without code, just clicks.

Node Imdb Api ⭐ 324

A non-scraping, functional node.js interface to imdb (mirror of gitlab.com/worr/node-imdb-api)

Api.enime.moe ⭐ 301

An API service for developers to quickly access the anime info and sources

Consumet.ts ⭐ 293

Nodejs library that provides high-level APIs for obtaining information on various entertainment media such as books, movies, comic books, anime, manga, and so on.

Pricewise ⭐ 284

Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.

Mwoffliner ⭐ 245

Mediawiki scraper: all your wiki articles in one highly compressed ZIM file

A simple browser/client-side web scraper.

Libremdb ⭐ 225

A free & open source IMDb front-end.

Thepiratebay ⭐ 202

💀 The Pirate Bay node.js client

Educative.io Downloader ⭐ 201

📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

Ayakashi ⭐ 177

⚡ Ayakashi.io - The next generation web scraping framework

Tradingview Scraper ⭐ 171

A gateway to TradingView's data for your Node.js application!

Graphql Scraper ⭐ 164

Extract structured data from the web using GraphQL.

estela, an elastic web scraping cluster 🕸

Linkedin Jobs Scraper ⭐ 131

Double Agent ⭐ 120

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

A scraper that switches between normal mode and gentleman mode, built on Eletron, React

Tweetdrop ⭐ 91

Generate dispersable airdrops from Twitter threads.

Aniwatch Api ⭐ 90

Node.js API for obtaining anime information from aniwatch.to (formerly zoro.to) written in TypeScript, made with Cheerio & Axios

Rs Bed Covid Indo Api ⭐ 89

API ketersediaan rumah sakit dan tempat tidur rumah sakit untuk pasien covid-19 ataupun non-covid yang berada di Indonesia

Kijiji Scraper ⭐ 89

A lightweight node.js module for retrieving and scraping ads from Kijiji

Retrieve information from BoxRec and return it in JSON format

Metadata Scraper ⭐ 86

🏷️ A JavaScript library for scraping/parsing metadata from a web page.

Jsonhunter ⭐ 85

在线爬虫，online web scraper

Facebook Group Members Scraper ⭐ 79

Facebook Group Members Extractor. Download Facebook group members in CSV.

Tatooine ⭐ 78

A powerful scraper for JavaScript Developers.

Browser Pool ⭐ 77

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

Anitop is an unofficial simple API from https://anitrendz.net/ site

Twitter Scraper ⭐ 63

A port of n0madic/twitter-scraper to Node.js.

Local Api Client Typescript ⭐ 54

Official JavaScript/TypeScript library for interacting with Kameleo Client

Scraping Helper Chrome Extension ⭐ 53

Scraping Helper will help you to find out the best html/css selector for certain elements

Tooling that automates your Facebook interactions.

Sourcescraper ⭐ 52

Simple library which helps you to retrieve the source of various video streaming sites.

Moneyman ⭐ 48

Automatically save transactions from all major Israeli banks and credit card companies, using GitHub actions (or a self hosted docker image)

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

Ogpparser ⭐ 47

Open Graph Protocol Parser for Node.js

Freenom Auto Renew Domains ⭐ 45

A scraper built with puppeteer that auto renew free domains on Freenom and send discord message using bot

Puppeteer Botcheck ⭐ 44

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

Frieren Scraper ⭐ 43

Scraping challenge for me.

Oversmash ⭐ 42

Overwatch API library for player details and career stats

Freesoccer ⭐ 35

⚽ Free API with results from national soccer competitions

Sabesp Mananciais Api ⭐ 33

[Experiment] A simple scraping application to visualize data about water in São Paulo.

Imdb Scraper ⭐ 32

🎬 An attempt at the most complete IMDb API

Extension ⭐ 32

web scraping extension

Sigaa Api ⭐ 32

Unofficial high performance API for SIGAA (Sistema Integrado de Gestão de Atividades Acadêmicas) using web scraping.

Noscrape ⭐ 32

obfuscate text via node to make scraping your content really difficult

Serpapi Javascript ⭐ 32

Scrape and parse search engine results using SerpApi.

Foundation ⭐ 31

🧱 A uniform template to use as a foundation for Puppeteer bot construction.

📉 Uptime and error monitoring CLI

Htmlspitter ⭐ 28

NodeJS server to spit out HTML from loaded JS using Puppeteer

Cookidoo Scraper ⭐ 28

This project implements a REST API of the Cookidoo® website. For example, you can retrieve recipe information for a specific recipe or information for all recipes on your weekly schedule. To get the information, the Cookidoo® website is scraped.

Twitter Openapi Typescript ⭐ 27

Implementation of Twitter internal API in TypeScript

Nest Crawler ⭐ 26

An easiest crawling and scraping module for NestJS

Webmagician Ui ⭐ 26

An admin UI project for a configurable web crawler platform

Yahoo Stock Api ⭐ 26

💰 NPM package to get stock and historical price from finance.yahoo.com

Jimov_api ⭐ 26

This project is an open-source API for retrieving multimedia content such as anime, movies and series, news, and manga in both Spanish and English.

Wind Scrape ⭐ 25

Node package for scraping wind forecast from a few websites

Passport Appointment Bot ⭐ 25

Bot to automatically find and book appointment for renewal/creation of a Swedish passport or national identity card.

Patreon Scraper ⭐ 24

WIP Patreon attachment download written in TypeScript

Gitrepos ⭐ 24

:octocat: A simple PWA app that returns Trending Repositories & Developers from GitHub, Gitlab & HackerNews.

Otakudesu Scraper ⭐ 23

unofficial otakudesu.cam rest api

Timetable Grabber Sit ⭐ 23

Timetable Grabber - SIT is a tool that allows you to grab and export your trimester's timetable to the .ics format where you can import it to your favourite calendar.

Docudigger ⭐ 22

Website scraper for getting invoices automagically as pdf (useful for taxes or DMS)

An easy to use imageboard scraper.

Nsfw Api ⭐ 20

an api to "generate" nsfw images randomly.

Fb Event Scraper ⭐ 20

Puppeteer Table Parser ⭐ 20

Scrape and parse HTML tables with the Puppeteer table parser.

Anime Tracker ⭐ 20

🕸️ All in one place to track your favorite animes

📝 Random quotes generator package. Available on npm and PyPi

Unofficial Node JS module for scraping F95Zone platform

Scrape It ⭐ 18

A web scraping API for humans

Flixhq Core ⭐ 18

Nodejs library that provides an Api for obtaining the movies information from FlixHQ website.

Node Github Trend ⭐ 18

node.js library for scraping GitHub trending repositories.

Openai Scraper ⭐ 18

This is a template repository for building a web scraper with OpenAI support. The repository provides a basic project structure with TypeScript and Puppeteer pre-configured, as well as OpenAI's GPT-3 API integration. With this template, you can easily build a scraper that uses machine learning to analyze and extract insights from the scraped data.

Node Csfd Api ⭐ 17

ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz :)

Icloud Shared Album ⭐ 17

ICloud Shared Album is a library for scraping data off public icloud shared albums.

Israeli Bank Scrapers Modern Schemas ⭐ 17

A new architecture for Poalim bank scraper to hopefully merge into Israeli-bank-scrapers when they are ready

Headless Task Server ⭐ 17

A headless browser task manager based on Hero (Chrome)

Ig Friendship Checker ⭐ 16

✨ Bot that can check your Following-Follower on Instagram

Package Bot ⭐ 16

A Discord Parcel Tracking Bot

Fandomscraper ⭐ 16

📓 [TS] A NodeJS package to scrap fandoms wikis characters page. Only scraps the characters info section and the list of all repertoried characters.

Mapping sites to AniList and back.

All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.

Papercut ⭐ 15

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Related Searches

Typescript Angular (35,567)

Typescript Reactjs (31,235)

Typescript Command Line (21,993)

Typescript Testing (21,336)

Typescript Vue (5,971)

Typescript Nextjs (5,496)

Typescript Html (5,128)

Typescript Redux (5,035)

Typescript Docker (4,994)

Typescript Nest (4,761)

1-100 of 141 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.