Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Gatsby Plugin Robots Txt | 107 | 262 | 147 | a year ago | 32 | November 13, 2022 | 9 | mit | JavaScript | |
Gatsby plugin that automatically creates robots.txt for your site | ||||||||||
Robotstxt | 21 | 12 years ago | 5 | mit | CoffeeScript | |||||
robots.txt parser coffeescript | ||||||||||
Express Robots Txt | 15 | a year ago | JavaScript | |||||||
express middleware to serve and generate robots.txt | ||||||||||
Obey_robots_dot_txt | 11 | 15 years ago | Ruby | |||||||
Easy to use extension of Net::HTTP to let you obey robots.txt while crawling/scrapping/mining | ||||||||||
Simplified_eye_hand_calibration | 10 | 3 years ago | 1 | C++ | ||||||
A cmake project for robot eye hand calibration (eye in hand and eye to hand). | ||||||||||
Wp Robots Txt | 10 | 9 years ago | 1 | May 03, 2015 | mit | PHP | ||||
Adds an option to the Privacy Settings page that allows you edit the content of your `robots.txt` file. | ||||||||||
Robots_txt | 9 | 4 | 1 | 4 years ago | 10 | March 31, 2020 | 5 | other | Rust | |
Lightweight robots.txt parser and generator written in Rust. | ||||||||||
Robots Txt | 7 | 2 | 2 | 8 years ago | 10 | July 12, 2016 | mit | JavaScript | ||
Check user agents against robots.txt files | ||||||||||
Grunt Robots Txt | 7 | 15 | 4 | 8 years ago | 15 | November 14, 2016 | mit | JavaScript | ||
UNMAINTAINED Grunt plugin to generate a robots.txt file |