Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Cobweb	221	15	5	4 years ago	94	January 09, 2021	17	mit	JavaScript
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
Zhihuvapi	65			6 years ago	7	September 13, 2018		mit	Python
优雅地玩知乎
Netcrawl	51			6 years ago	9	February 10, 2015	3		Ruby
LLDP/CDP crawler
Spider.npm	39		2	5 years ago	1	November 29, 2020		mit	JavaScript
网络爬虫类库,基本可以实现自定义规则大部分网站
Klepto	21			11 years ago	44	July 18, 2013	1	mit	Ruby
A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.
Crawlik	18			6 years ago			1		Common Lisp
Lisp web crawler and scrapper
Ncov Channel Crawler	9			4 years ago			1	bsd-3-clause	Python

Alternatives To Spider.npm

Select To Compare

Cobweb ⭐ 221

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.

dependent packages 5total releases 94most recent commit 4 years ago

Zhihuvapi ⭐ 65

优雅地玩知乎

total releases 7most recent commit 6 years ago

Netcrawl ⭐ 51

LLDP/CDP crawler

total releases 9most recent commit 6 years ago

Spider.npm ⭐ 39

网络爬虫类库,基本可以实现自定义规则大部分网站

dependent packages 2total releases 1most recent commit 5 years ago

Klepto ⭐ 21

A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.

total releases 44most recent commit 11 years ago

Crawlik ⭐ 18

Lisp web crawler and scrapper

most recent commit 6 years ago

Ncov Channel Crawler ⭐ 9

most recent commit 4 years ago

Suggest An Alternative To spider.npm

Alternative Project Comparisons

Spider.npm vs Cobweb

Spider.npm vs Zhihuvapi

Spider.npm vs Netcrawl

Spider.npm vs Klepto

Spider.npm vs Crawlik

Spider.npm vs Ncov Channel Crawler

Popular Hash Projects

Inquirer.js ⭐ 19,005

A collection of common interactive command line user interfaces.

dependent packages 53,114total releases 143latest release November 07, 2023most recent commit 3 months ago

Node Jsonwebtoken ⭐ 17,175

JsonWebToken implementation for node.js http://self-issued.info/docs/draft-ietf-oauth-json

dependent packages 19,058total releases 81latest release August 30, 2023most recent commit 4 months ago

John ⭐ 9,237

John the Ripper jumbo - advanced offline password cracker, which supports hundreds of hash and cipher types, and runs on many operating systems, CPUs, GPUs, and even some FPGAs

most recent commit 10 days ago

Xxhash ⭐ 8,455

Extremely fast non-cryptographic hash algorithm

dependent packages 5total releases 2latest release October 01, 2021most recent commit 4 days ago

Node.bcrypt.js ⭐ 7,118

bcrypt for NodeJs

dependent packages 3,942total releases 54latest release August 16, 2023most recent commit 6 months ago

Popular Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Lux ⭐ 24,752

👾 Fast and simple video download library and CLI tool written in Go

dependent packages 8total releases 40latest release November 06, 2023most recent commit 25 days ago

Colly ⭐ 21,902

Elegant Scraper and Crawler Framework for Golang

dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago

Easyspider ⭐ 20,149

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化

most recent commit 23 days ago

Proxy_pool ⭐ 19,442

Python ProxyPool for web spider

most recent commit 4 months ago

Popular Computer Science Categories