Java Spider
一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Dataengineeringproject | 644 | a year ago | 4 | mit | Python | |||||
| Example end to end data engineering project. | ||||||||||
| Freshonions Torscraper | 313 | 4 years ago | 22 | agpl-3.0 | Python | |||||
| Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion | ||||||||||
| Gopa | 281 | 3 years ago | 6 | May 19, 2021 | 11 | other | Go | |||
| [WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn | ||||||||||
| Java Spider | 276 | 3 years ago | 6 | Java | ||||||
| 一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。 | ||||||||||
| Od Database | 113 | 4 years ago | 5 | mit | Python | |||||
| Distributed crawler, database and web frontend for public directories indexing | ||||||||||
| Scraper | 109 | a year ago | 8 | mit | JavaScript | |||||
| AlphaReigns DHT Scraper, includes peer updater and categorizer | ||||||||||
| Job_search | 85 | 7 years ago | 1 | mit | Elixir | |||||
| An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components. | ||||||||||
| Alphareign | 50 | 7 years ago | 1 | |||||||
| Docs, About, Etc | ||||||||||
| Facebook Multi Scraper | 48 | 6 years ago | 5 | Python | ||||||
| Multi-threaded Facebook scraper for social analytics of public and owned pages | ||||||||||
| Trollhunter | 27 | 3 years ago | 15 | March 27, 2020 | 4 | gpl-3.0 | Jupyter Notebook | |||
| Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news | ||||||||||
Alternatives To Java SpiderSelect To Compare
Alternative Project Comparisons
Popular Elasticsearch Projects
Popular Scraper Projects
Popular Data Storage Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Java
Elasticsearch
Scraper
Spider