Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Crawler User Agents | 1,045 | 5 | 8 | 4 months ago | 118 | November 20, 2023 | 7 | mit | Python | |
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star: | ||||||||||
Venom | 146 | 3 years ago | mit | Python | ||||||
All Terrain Autonomous Quadruped | ||||||||||
Counter Robots | 55 | a year ago | 3 | mit | Shell | |||||
Official list of user agents that are regarded as robots/spiders by COUNTER | ||||||||||
Nestedprefab_demos | 43 | 5 years ago | C# | |||||||
用于2019年2月27日Unity官方直播中关于嵌套式Prefabs功能的演示 | ||||||||||
Spider | 36 | 6 years ago | 1 | mit | Jupyter Notebook | |||||
Open source spider robot for machine learning fun | ||||||||||
Mechanize.net | 25 | 1 | 6 years ago | 3 | December 08, 2017 | 2 | mit | C# | ||
Stateful programmatic web browsing, based on Python-Mechanize, which is based on Andy Lester’s Perl module WWW::Mechanize. | ||||||||||
Sakurajimamai | 21 | 2 years ago | gpl-3.0 | Python | ||||||
(BiliBili/AcFun/微博/RSS)信息聚合自动推送机器人 | ||||||||||
Hexapod_spiderbot_tutorials | 16 | 4 months ago | other | Jupyter Notebook | ||||||
Welcome to the HexaPod Robot Tutorial! This repo offers a step-by-step guide to build a hexapod spider robot. From hardware specs and Raspberry Pi-driven servo control, to software algorithms and sensor integrations, we've got you covered. Ideal for both hobbyists and engineers eager to explore multi-legged robotics. | ||||||||||
Nrobots | 14 | 58 | 5 | 6 years ago | 4 | January 19, 2016 | 3 | ms-pl | C# | |
The Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable. This project provides an easy-to-use class, implemented in C#, to work with robots.txt files. | ||||||||||
Robots.txt | 13 | 3 years ago | 7 | gpl-3.0 | Java | |||||
:robot: robots.txt as a service. Crawls robots.txt files, downloads and parses them to check rules through an API |