Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Java Spider Open Source Projects

Open source projects categorized as Java Spider
Spider Flow ⭐ 8,075
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
most recent commit 10 months ago
Novel Plus ⭐ 3,358
novel-plus 是一个多端（PC、WAP）阅读 、功能完善的小说 CMS 系统。包括小说推荐、小说检索、小说排行、小说阅读、小说书架、小说评论、小说爬虫、会员中心、作家专区、
most recent commit 3 months ago
Java ⭐ 2,787
java项目实战练习
most recent commit 6 months ago
Catvodtvspider ⭐ 1,270
most recent commit 2 years ago
Checkinpanel ⭐ 1,175
一个主要运行在 𝐞𝐥𝐞𝐜𝐕𝟐𝐏 或 𝐪𝐢𝐧𝐠𝐥𝐨𝐧𝐠 等定时面板，同时支持系统运行环境的签到项目（环境：𝑷𝒚𝒕𝒉𝒐𝒏 3.8+ / 𝑵𝒐𝒅𝒆.𝒋𝒔 10+ / 𝑩𝒂𝒔𝒉 4+ / 𝑶𝒑𝒆𝒏𝑱𝑫𝑲8 / 𝑷𝒆𝒓𝒍5）
most recent commit a year ago
Magic Api ⭐ 1,104
magic-api 是一个接口快速开发框架，通过Web页面编写脚本以及配置，自动映射为HTTP接口，无需定义Contro
most recent commit 7 months ago
Oneblog ⭐ 952
👽 OneBlog，一个简洁美观、功能强大并且自适应的Java博客
most recent commit 10 months ago
Spider ⭐ 907
A configurable web spider with a easy-to-use web console
most recent commit 6 years ago
Zhihu Crawler ⭐ 843
zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬
most recent commit 5 years ago
Android Charts ⭐ 787
Open-source native Android graph/chart framework includes line chart,stick chart,candlestick chart,pie chart,spider-web chart etc.
most recent commit 7 years ago
Istock ⭐ 770
👉一个基于spring boot 实现的java股票爬虫(仅支持A股)，如果你❤️请⭐ . V2升级版正在开发中！
most recent commit a year ago
Domain_hunter ⭐ 658
A Burp Suite Extension that try to find all sub-domain, similar-domain and related-domain of an organization automatically! 基于流量自动收集整个企业或组织的子域名、相似域名、相关域名的burp插件
most recent commit 10 months ago
Xxl Crawler ⭐ 650
A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）
dependent packages 1total releases 6most recent commit a year ago
Netdiscovery ⭐ 557
NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
most recent commit 3 years ago
Go_jobs ⭐ 536
带你了解一下Golang的市场行情
total releases 1most recent commit 4 years ago
Lxbook ⭐ 426
《爬虫逆向进阶实战》书籍代码库
most recent commit 6 months ago
Templatespider ⭐ 390
扒网站工具，看好哪个网站，指定好URL，自动扒下来做成模版。所见网站，皆可为我所用！
most recent commit 3 years ago
Weatherspider ⭐ 321
天气爬虫（全国城镇天气自动定时抓取更新，并开放RESTful查询接口），附带代理IP池定时更新并检测
most recent commit 6 years ago
Zhihuspider ⭐ 276
知乎爬虫/可以爬出关注关系的爬虫
most recent commit 7 years ago
Java Spider ⭐ 276
一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集
most recent commit 3 years ago
Yfax Parent ⭐ 274
SprintBoot开发的Rest API接口项目实战，集成了拦截器，日志处理，mysql，mybatis, oauth2.0, spring secutity等，已投入生产线上使用。应用了https://github.com/hemin100 所含功能。配套的后台管理系统实战见：https://github.com/hemin1003/ayl
most recent commit 3 years ago
Javacrawling ⭐ 252
"奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现
most recent commit 7 years ago
Imageloader ⭐ 235
a wrapper for glidev4, a solution for image load and big image preview, debug tool for imageview. image spiders on Android
most recent commit 9 months ago
The 4 Most Depended On Java Spider Open Source Projects
Webcrawler Verifier ⭐ 27
Java library providing functionality to verify that user-agents are who they claim to be.
dependent packages 1total releases 1latest release April 05, 2015most recent commit 7 years ago
Crawler ⭐ 17
A simple and flexible web crawler framework for java.
dependent packages 1total releases 1latest release June 22, 2017most recent commit 6 years ago
Cockroach ⭐ 112
又一个 java 内容（pa）获取（chong）工具
dependent packages 1total releases 2latest release February 28, 2018most recent commit 4 years ago
Xxl Crawler ⭐ 650
A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）
dependent packages 1total releases 6latest release October 15, 2022most recent commit a year ago
The 10 Latest Releases In Java Spider Open Source Projects
Xxl Crawler ⭐ 650
A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）
dependent packages 1total releases 6latest release October 15, 2022most recent commit a year ago
Retrofit Crawler ⭐ 5
A simple api to craw html. Base on jsoup and retrofit
total releases 1latest release April 22, 2021most recent commit 3 years ago
Go_jobs ⭐ 536
带你了解一下Golang的市场行情
total releases 1latest release May 17, 2020most recent commit 4 years ago
Cetty ⭐ 36
基于事件分发的爬虫框架
total releases 9latest release March 07, 2019most recent commit 2 years ago
Gspider ⭐ 11
a groory spider .
total releases 6latest release May 07, 2018most recent commit 7 years ago
Scriptspider ⭐ 159
一个java版本的分布式的通用爬虫，可以插拔各个组件
total releases 4latest release March 30, 2018most recent commit 5 months ago
Cockroach ⭐ 112
又一个 java 内容（pa）获取（chong）工具
dependent packages 1total releases 2latest release February 28, 2018most recent commit 4 years ago
Crawler ⭐ 17
A simple and flexible web crawler framework for java.
dependent packages 1total releases 1latest release June 22, 2017most recent commit 6 years ago
Gospy ⭐ 7
🕷 a flexible web crawler framework
total releases 2latest release May 19, 2017most recent commit 6 years ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.