Hbase Writer
HBase-Writer is an extension to the Heritrix open source crawler written by the Internet Archive (http://crawler.archive.org/) that enables it to store crawled content directly into HBase tables.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Spring Boot Quick | 2,282 | 7 months ago | 13 | Java | ||||||
| :herb: 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、k3s、k3d、k8s、mybatis加解密插件、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等:pushpin: | ||||||||||
| Crawler Framework | 12 | 8 years ago | Java | |||||||
| 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入 | ||||||||||
| Nutch Indexer Discovery | 9 | 6 years ago | 1 | Java | ||||||
| Watson Discovery Service indexing plugin for Apache Nutch | ||||||||||
| Weather Mrs | 9 | 5 years ago | Java | |||||||
| 天气爬虫采集，kafka实时分发，flume 收集数据导入到 Hbase, 再由 Hive 与 Hbase 建立映射，Superset 分析和展示数据。 | ||||||||||
| Hbase Writer | 6 | 12 years ago | other | Java | ||||||
| HBase-Writer is an extension to the Heritrix open source crawler written by the Internet Archive (http://crawler.archive.org/) that enables it to store crawled content directly into HBase tables. | ||||||||||
Alternatives To Hbase WriterSelect To Compare
Alternative Project Comparisons
Popular Hbase Projects
Popular Crawler Projects
Popular Data Storage Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Java
Crawler
Hadoop
Writer
Hbase