The Top 23 Javascript Crawler Open Source Projects

Open source projects categorized as Javascript Crawler

Categories > Data Processing > Crawler

Categories > Programming Languages > Javascript

It's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.

most recent commit 4 years ago

Utsusemi ⭐ 27

A tool to generate a static website by crawling the original site.

most recent commit 6 years ago

Crawler.js ⭐ 27

registry that crawls github users, used in http://component.github.io

most recent commit 9 years ago

Spider ⭐ 27

A web spider framework

dependent packages 2total releases 1most recent commit 5 months ago

Fourcat ⭐ 27

4chan catalog generator

most recent commit 10 years ago

Ta11y ⭐ 27

Modern web accessibility audits. 💪

dependent packages 3total releases 30most recent commit 3 years ago

Serverless Crawler Demo ⭐ 27

Serverless Architecture Crawler demo

most recent commit 4 years ago

Wechat Arts Crawl ⭐ 26

微信公众号文章爬虫脚本

most recent commit 8 years ago

Node Html Crawler ⭐ 26

Simple for use node html crawler (spider) of site web pages

dependent packages 2total releases 14most recent commit 3 years ago

Node_tumblr_spider ⭐ 26

A crawler written by Node.js to download tumblr videos.

most recent commit 5 years ago

Mazmorra ⭐ 26

🗡 Online Multiplayer Dungeon Crawler powered by Colyseus - https://gum.co/mazmorra

most recent commit 3 years ago

Spidex ⭐ 26

A web requester for node.js.

dependent packages 23total releases 21most recent commit 5 years ago

Ufc Api ⭐ 26

UFC.com Crawler and Parser in NodeJS

dependent packages 4total releases 5most recent commit 9 years ago

Crawlerx ⭐ 25

A crawler can use different strategy to different url pattern

dependent packages 2total releases 8most recent commit 7 years ago

Seoserver Site ⭐ 25

The example and documentation site for SeoServer

most recent commit 12 years ago

N46 Crawler ⭐ 25

Nogizaka46 Blog Crawler - 乃木坂46卒業成員部落格備份程式

most recent commit a year ago

Telefonilo.js ⭐ 25

Make "click to phone-call" links for your mobile users only (accepts encrypted phone numbers)

dependent packages 1total releases 2most recent commit 2 years ago

Crawlerjs ⭐ 25

AJAX-crawler that stores escaped fragment snapshots of #!/-sites that search engines can understand

most recent commit 11 years ago

Animeapi ⭐ 25

☁️ A RESTful API for Anime Data.

most recent commit 8 years ago

Get Site Urls ⭐ 25

🔗 Get all of the URL's from a website.

dependent packages 5total releases 17most recent commit a year ago

Retro Env Can Weather Chan ⭐ 24

Retro Environment Canada Weather Channel for your browser

most recent commit 3 months ago

Yggdrasil2 ⭐ 24

Sistema para acompanhar a evolução do aluno do BCC ao longo do curso

most recent commit 2 years ago

Medium User Crawler ⭐ 24

Medium user crawler

most recent commit 4 years ago

The 5 Latest Releases In Javascript Crawler Open Source Projects

Ajfabriqnode ⭐ 6

A Distributed Application Framework for NodeJs

dependent packages 3total releases 3latest release April 29, 2013most recent commit 10 years ago

Img Crawler ⭐ 10

A Nodejs module for downloading images from a website

dependent packages 3total releases 2latest release February 21, 2013most recent commit 8 years ago

Crawl ⭐ 110

Utility to crawl and diff websites for node.js

dependent packages 4total releases 4latest release January 24, 2013most recent commit 7 years ago

Hyperspider ⭐ 115

A declarative HATEOAS API crawler for node.js

dependent packages 3total releases 2latest release August 09, 2012most recent commit 12 years ago

Sitequery ⭐ 50

A node.js module for reactive webcrawling

dependent packages 1total releases 19latest release March 24, 2012most recent commit 12 years ago

Popular Data Processing Categories