Robots Txt vs Crawler User Agents
| Crawler User Agents | Robots Txt | |
|---|---|---|
| Stars | 1,045 | 201 |
| Downloads |  |  |
| Dependent Packages | 8 | 8 |
| Dependent Repos | 5 | 43 |
| Most Recent Commit | 4 months ago | 5 months ago |
| Total Releases | 118 | 18 |
| Latest Release | November 20, 2023 | November 22, 2023 |
| Open Issues | 7 | |
| License | mit | mit |
| Programming Language | Python | PHP |