Awesome Open Source

Programming Languages

The Top 23 Javascript Spider Open Source Projects

Open source projects categorized as Javascript Spider

Categories > Programming Languages > Javascript

Categories > Data Processing > Spider

Learn_python3_spider ⭐ 14,425

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifu 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

total releases 2most recent commit 4 months ago

Node Crawler ⭐ 6,610

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

dependent packages 146total releases 31most recent commit 4 months ago

npm crawler} Downloads

Font Spider ⭐ 4,770

Smart webfont compression and format conversion tool

dependent packages 22total releases 51most recent commit a year ago

npm font-spider} Downloads

Browser Fingerprinting ⭐ 3,353

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

most recent commit a year ago

Wechatsync ⭐ 2,706

一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typec

most recent commit 4 months ago

🔞 JAVClub - 让你的大姐姐不再走丢

most recent commit 3 years ago

Geziyor ⭐ 1,892

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

dependent packages 11total releases 6most recent commit a year ago

Spider ⭐ 1,365

Unsurprising JavaScript - No longer active

dependent packages 8total releases 14most recent commit 7 years ago

npm spider-script} Downloads

Wechat_spider ⭐ 1,236

微信爬虫，获取文章内容、阅读量、点赞量、评论等，获取公众号所有历史文章链接。

most recent commit 10 months ago

Checkinpanel ⭐ 1,175

一个主要运行在 𝐞𝐥𝐞𝐜𝐕𝟐𝐏 或 𝐪𝐢𝐧𝐠𝐥𝐨𝐧𝐠 等定时面板，同时支持系统运行环境的签到项目（环境：𝑷𝒚𝒕𝒉𝒐𝒏 3.8+ / 𝑵𝒐𝒅𝒆.𝒋𝒔 10+ / 𝑩𝒂𝒔𝒉 4+ / 𝑶𝒑𝒆𝒏𝑱𝑫𝑲8 / 𝑷𝒆𝒓𝒍5）

most recent commit a year ago

Qzoneexport ⭐ 1,163

QQ空间导出助手，用于备份QQ空间的说说、日志、私密日记、相册、视频、留言板、QQ好友、收藏夹、分享

most recent commit a year ago

Reptile ⭐ 1,081

🏀 Python3 网络爬虫实战（部分含详细教程）猫眼腾讯视频豆瓣研招网微博笔趣阁小说百度热点 B站 CSDN 网易云阅读阿里文学百度股票今日头条微信公众号网易云音乐拉勾有道 unsplash 实习僧汽车之家英雄联盟盒子大众点评链家 LPL赛程台风梦幻西游、阴阳师藏宝阁天气牛客网百度文库睡前故事知乎 Wish

most recent commit 3 years ago

Antcolony ⭐ 1,042

Nodejs实现的一个磁力链接爬虫 http://findit.keenwon.com (原域名http://findit.so )

most recent commit 5 years ago

Jspider ⭐ 1,006

JSpider会每周更新至少一个网站的JS解密方式，欢迎 Star，交流微信：13298307816

most recent commit 2 years ago

Wechat_spider ⭐ 863

使用“代理”的方式来抓取微信公众账号文章，可以抓取阅读数、点赞数，基于 anyproxy。

most recent commit 4 years ago

Spider Crack Js ⭐ 845

破解各种网站的JS [知乎] [豆瓣][Incapsula-CDN][百度贴吧_BSK][七麦analysis]

most recent commit 3 years ago

Overlappingmarkerspiderfier ⭐ 811

Deals with overlapping markers in Google Maps JS API v3, Google Earth-style

most recent commit a year ago

Baiduyunspider ⭐ 769

百度云网盘搜索引擎，包含爬虫 & 网站

most recent commit 5 years ago

Programmable spidering of web sites with node.js and jQuery

dependent packages 3total releases 2most recent commit 5 years ago

npm spider} Downloads

X Crawl ⭐ 718

x-crawl is a flexible Node.js multifunctional crawler library. Flexible usage and numerous functions can help you quickly, safely, and stably crawl pages, interfaces, and files. ---------------- x-crawl 是一个灵活的 Node.js 多功能爬虫库。灵活的使用方式和众多的功能可以帮助您快速、安全、稳定地爬取页面、接口以及文件。

dependent packages 1total releases 59most recent commit 3 months ago

npm x-crawl} Downloads

Xxl Crawler ⭐ 650

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

dependent packages 1total releases 6most recent commit a year ago

Font Spider Plus ⭐ 599

font-spider-plus（字蛛+）是一个智能 WebFont 压缩工具，它能自动分析出本地页面和线上页面使用的 WebFont 并进行按需压缩。

dependent packages 3total releases 6most recent commit a year ago

npm font-spider-plus} Downloads

Newcrawler ⭐ 583

Free Web Scraping Tool with Java

most recent commit 5 months ago

The 10 Most Depended On Javascript Spider Open Source Projects

Node Crawler ⭐ 6,610

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

dependent packages 146total releases 31latest release December 30, 2022most recent commit 4 months ago

npm crawler} Downloads

Zhihu Api ⭐ 267

Unofficial API for zhihu.

dependent packages 103total releases 39latest release July 16, 2017most recent commit 7 years ago

npm zhihu-api} Downloads

JavaScript + BeautifulSoup = JSSoup

dependent packages 41total releases 15latest release October 03, 2021most recent commit 3 years ago

npm jssoup} Downloads

React framework for high performance SPAs

dependent packages 40total releases 18latest release May 07, 2023most recent commit 3 months ago

npm @anansi/browserslist-config} Downloads

Font Spider ⭐ 4,770

Smart webfont compression and format conversion tool

dependent packages 22total releases 51latest release July 19, 2019most recent commit a year ago

npm font-spider} Downloads

Geziyor ⭐ 1,892

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

dependent packages 11total releases 6latest release April 19, 2021most recent commit a year ago

Generate an object for testing if a request is sent, request is Mikeal's request.

dependent packages 11total releases 26latest release April 15, 2019most recent commit 5 years ago

npm seenreq} Downloads

Spider ⭐ 1,365

Unsurprising JavaScript - No longer active

dependent packages 8total releases 14latest release November 30, 2014most recent commit 7 years ago

npm spider-script} Downloads

Spider Detector ⭐ 33

A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS

dependent packages 7total releases 21latest release June 29, 2023most recent commit 7 months ago

npm spider-detector} Downloads

Node Tarantula ⭐ 23

web crawler/spider for nodejs

dependent packages 5total releases 9latest release April 18, 2014most recent commit 9 years ago

npm tarantula} Downloads

The 10 Latest Releases In Javascript Spider Open Source Projects

Infor You Mation ⭐ 5

latest release November 21, 2023most recent commit 6 years ago

X Crawl ⭐ 718

x-crawl is a flexible Node.js multifunctional crawler library. Flexible usage and numerous functions can help you quickly, safely, and stably crawl pages, interfaces, and files. ---------------- x-crawl 是一个灵活的 Node.js 多功能爬虫库。灵活的使用方式和众多的功能可以帮助您快速、安全、稳定地爬取页面、接口以及文件。

dependent packages 1total releases 59latest release November 09, 2023most recent commit 3 months ago

npm x-crawl} Downloads

Webster ⭐ 465

a reliable high-level web crawling & scraping framework for Node.js.

dependent packages 2total releases 42latest release November 09, 2023most recent commit 6 months ago

npm webster} Downloads

Spider Detector ⭐ 33

A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS

dependent packages 7total releases 21latest release June 29, 2023most recent commit 7 months ago

npm spider-detector} Downloads

React framework for high performance SPAs

dependent packages 40total releases 18latest release May 07, 2023most recent commit 3 months ago

npm @anansi/browserslist-config} Downloads

新浪博客批量备份工具

dependent packages 2total releases 29latest release March 31, 2023most recent commit a year ago

npm dature} Downloads

Papercrawlerutil ⭐ 8

一套工具组，包括访问链接，获取元素，抽取文件等等也有已经实现好通过scihub获取论文的小工具，还有对于pdf转doc，文本翻译,代理连接获取以及通 PDF文件合并，PDF文件截取某些页，CSV，xls文件处理等

total releases 135latest release January 26, 2023most recent commit 8 months ago

Node Crawler ⭐ 6,610

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

dependent packages 146total releases 31latest release December 30, 2022most recent commit 4 months ago

npm crawler} Downloads

Cb Webtool ⭐ 9

Cloud-Barista Web Tool

total releases 10latest release December 22, 2022most recent commit 8 months ago

Xxl Crawler ⭐ 650

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

dependent packages 1total releases 6latest release October 15, 2022most recent commit a year ago

Popular Programming Languages Categories

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.