Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Robotstxtparser | 21 | 4 | 5 | 3 years ago | 12 | April 10, 2021 | mit | PHP | ||
An extensible robots.txt parser and client library, with full support for every directive and specification. | ||||||||||
Robotsexclusiontools | 18 | 2 years ago | mit | C# | ||||||
A "robots.txt" parsing and querying library for .NET |