Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Agent | 4,362 | 798 | 268 | 6 months ago | 29 | June 13, 2020 | 79 | mit | PHP | |
👮 A PHP desktop/mobile user agent parser with support for Laravel, based on Mobiledetect | ||||||||||
Robots.txt | 69 | 2 years ago | other | |||||||
Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites. | ||||||||||
Robots.js | 63 | 50 | 20 | 6 years ago | 19 | July 07, 2017 | 6 | mit | JavaScript | |
Parser for robots.txt for node.js | ||||||||||
Robotsexclusiontools | 18 | 2 years ago | mit | C# | ||||||
A "robots.txt" parsing and querying library for .NET | ||||||||||
Express Robots | 13 | 37 | 7 | 5 years ago | 8 | June 02, 2016 | 4 | JavaScript | ||
Robotstxt | 10 | 1 | 6 years ago | 1 | November 27, 2017 | mit | Go | |||
Go robots.txt parser | ||||||||||
Robot_rules | 6 | 15 years ago | 1 | August 11, 2014 | mit | Ruby | ||||
A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI. |