Sitecrawler
This is a Java library which can be used to crawl the content of some of web properties (www.salesforce.com, blogs.salesforce.com for example). It supports dynamic scaling (depending on available machine power (CPU, RAM) and network capacity) out of the box. It also has a Plugin structure, which allows others to write code (plugins) that act on the crawled pages.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Cyworld Bot | 54 | 4 years ago | 6 | mit | Python | |||||
| 🤖 Cyworld image crawler | ||||||||||
| Sitecrawler | 18 | 3 years ago | 1 | July 30, 2018 | 3 | bsd-3-clause | Java | |||
| This is a Java library which can be used to crawl the content of some of web properties (www.salesforce.com, blogs.salesforce.com for example). It supports dynamic scaling (depending on available machine power (CPU, RAM) and network capacity) out of the box. It also has a Plugin structure, which allows others to write code (plugins) that act on the crawled pages. | ||||||||||
| Imoocgo | 5 | 6 years ago | HTML | |||||||
| imoocGo code | ||||||||||
Alternatives To SitecrawlerSelect To Compare
Alternative Project Comparisons
Popular Cpu Projects
Popular Crawler Projects
Popular Hardware Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Java
Crawler
Cpu