Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for java webscraper
java
x
webscraper
x
5 search results found
Spider Flow
⭐
8,075
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Webcollector
⭐
2,974
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
Nutch
⭐
2,742
Apache Nutch is an extensible and scalable web crawler
Gecco
⭐
2,403
Easy to use lightweight web crawler(易用的轻量化网络爬虫)
100projectsofcode
⭐
1,293
A list of practical knowledge-building projects.
Storm Crawler
⭐
834
A scalable, mature and versatile web crawler based on Apache Storm
Sparkler
⭐
401
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
News Crawl
⭐
229
News crawling with StormCrawler - stores content as WARC
Crawler Commons
⭐
217
A set of reusable Java components that implement functionality common to any web crawler
Collector Http
⭐
162
Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.
Screenslicer
⭐
159
Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JSON API. Currently unmaintained.
Project Tauro
⭐
48
A Router WiFi key recovery/cracking tool with a twist.
Wpcrawler
⭐
43
a web crawler for single WordPress site
Flink Crawler
⭐
35
Continuous scalable web crawler built on top of Flink and crawler-commons
Crawler4j
⭐
30
Open Source Simple Web Crawler for Java. Simple Flexible And Lightweight
Stormscraper
⭐
29
A Storm based web crawler with Cassandra backend
Jfitbit
⭐
26
A web scraper to download intraday Fitbit data (previously) unavailable in the official API
Charles
⭐
25
Java web crawling library
Widow
⭐
23
Distributed, asynchronous web crawler
Twitterscraper4j
⭐
22
a java library which scrapes twitter to fetch publicly available info
Nofbeventscraper
⭐
21
This app scrapes Facebook event links and adds the event to your calendar.
Wcofun.com_downloader
⭐
17
A java & Kotlin cartoon and anime downloader for https://www.wcofun.com/
Gumtree Scraper
⭐
16
Are you looking for an apartment on gumtree.pl? You will like this a lot.
Koronawirus Api
⭐
14
API do śledzenia statystyk o koronawirusie w Polsce
Robots.txt
⭐
13
🤖 robots.txt as a service. Crawls robots.txt files, downloads and parses them to check rules through an API
Scraper
⭐
12
A simple web scraper built around the JavaFX WebEngine
Ghost Login
⭐
11
Specifically designed to solve the web crawler when collecting Internet web data who need to login the web-site by useing some Simulated ways.
Hwcollection
⭐
11
A project to create a HOT WHEELS COLLECTION
Semantic Web Scraper
⭐
10
Googleplayscraper
⭐
9
Simple web scraper to get app information from Google Play
Codechef Crawler
⭐
9
[deprecated] A web crawler that can download all successful submissions of a user in Codechef. Just provide the username.
Chronicrawl
⭐
8
Experimental continouous web crawler for web archiving
Storecompare
⭐
8
A multi-threaded price comparison tool built with Java, MongoDB and Swing
Gospy
⭐
7
🕷 a flexible web crawler framework
Vertx Crawler
⭐
7
Web Crawler based on Vert.x
Scrapie
⭐
7
Web Scraper
Cis555 Project
⭐
7
The final project for CIS555 at the University of Pennsylvania.
Born2crawl
⭐
7
A highly performant and versatile crawling engine, designed with scalability and extensibility in mind.
Duckduckgo
⭐
5
An unofficial Duckduckgo.com API with performance and simplicity in mind
Restless Man
⭐
5
孜孜不断的技术分享。包含Java技术相关,实用工具分享,开源项目环境搭建等内容。每周持续更新哦!
Webcrawler
⭐
5
A Recursive Web crawler built with Java 8, reactive streams, async queues and AWS DynamoDB.
Giua Webscraper
⭐
5
A webscraper of the online school workbook giua@school
Related Searches
Java Spring (21,350)
Java Spring Boot (11,982)
Java Video Game (8,093)
Java Gradle (8,072)
Java Docker (6,180)
Java Database (6,015)
Java Mysql (5,954)
Java Sdk (5,864)
Java Rest (4,956)
Java Algorithms (4,705)
1-5 of 5 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.