Robots.txt vs Supercrawler
| Supercrawler | Robots.txt | |
|---|---|---|
| Stars | 324 | 69 |
| Downloads |  | |
| Dependent Packages | 3 | |
| Dependent Repos | 1 | |
| Most Recent Commit | 2 years ago | 3 years ago |
| Total Releases | 45 | |
| Latest Release | November 24, 2019 | |
| Open Issues | 19 | |
| License | apache-2.0 | other |
| Programming Language | JavaScript |