Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Pyrailgun | 346 | 2 | 4 years ago | 10 | June 10, 2014 | 5 | Python | |||
Simple And Easy Python Crawler Framework,支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块 | ||||||||||
Twitter Mentors | 68 | 7 years ago | 3 | Python | ||||||
A list of people willing to help/mentor others. Data from Twitter. | ||||||||||
Get Site Urls | 25 | 1 | 5 | a year ago | 17 | August 25, 2022 | 2 | mit | JavaScript | |
🔗 Get all of the URL's from a website. | ||||||||||
Trackupdates | 20 | 2 years ago | 5 | February 09, 2018 | 1 | mit | Python | |||
A simple yaml-based xpath crawler framework for easy tracking site updates. https://zhupeng.github.io/ | ||||||||||
Crawlerflow | 12 | 2 years ago | 6 | mit | Python | |||||
Web Crawlers orchestration Framework that lets you create datasets from multiple web sources. | ||||||||||
Publiccode Parser Go | 12 | 5 months ago | 4 | eupl-1.2 | Go | |||||
publiccode.yml parser library and validator in Go | ||||||||||
Screenshot Crawler | 5 | 1 | 6 years ago | 2 | April 14, 2018 | isc | JavaScript | |||
Screenshot crawler, taking instructions from YAML file and outputting TAP |