Robots Txt vs Crawler
| Crawler | Robots Txt | |
|---|---|---|
| Stars | 2,417 | 201 |
| Downloads |  |  |
| Dependent Packages | 28 | 8 |
| Dependent Repos | 116 | 43 |
| Most Recent Commit | 4 months ago | 5 months ago |
| Total Releases | 101 | 18 |
| Latest Release | November 22, 2023 | November 22, 2023 |
| Open Issues | ||
| License | mit | mit |
| Programming Language | PHP | PHP |