Project Name	Stars	Most Recent Commit	Open Issues	License	Language
Flink Crawler	35	5 years ago	27	apache-2.0	Java
Continuous scalable web crawler built on top of Flink and crawler-commons
Webcrawler	11	3 years ago		mit	JavaScript
A focused web crawler based on Playwright, RMQ, Kafka and Flink.

Alternatives To Flink Crawler

Select To Compare

Flink Crawler ⭐ 35

Continuous scalable web crawler built on top of Flink and crawler-commons

most recent commit 5 years ago

Webcrawler ⭐ 11

A focused web crawler based on Playwright, RMQ, Kafka and Flink.

most recent commit 3 years ago

Suggest An Alternative To flink-crawler

Alternative Project Comparisons

Flink Crawler vs Webcrawler

Popular Flink Projects

Xgboost ⭐ 25,253

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

dependent packages 972total releases 79latest release November 13, 2023most recent commit 3 months ago

Flink ⭐ 22,747

Apache Flink

dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago

Bigdata Notes ⭐ 14,872

大数据入门指南 :star:

most recent commit 4 months ago

Flink Learning ⭐ 13,801

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》

most recent commit 7 months ago

God Of Bigdata ⭐ 8,483

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.

most recent commit 9 months ago

Popular Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Lux ⭐ 24,752

👾 Fast and simple video download library and CLI tool written in Go

dependent packages 8total releases 40latest release November 06, 2023most recent commit 24 days ago

Colly ⭐ 21,902

Elegant Scraper and Crawler Framework for Golang

dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago

Easyspider ⭐ 20,149

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化

most recent commit 23 days ago

Proxy_pool ⭐ 19,442

Python ProxyPool for web spider

most recent commit 4 months ago

Popular Data Processing Categories