Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Is_crawler

is_crawler does exactly what you might think it does: determine if the supplied string matches a known crawler or bot.
Stars
30
License
mit
Open Issues
2
Most Recent Commit
6 years ago
Programming Language
Ruby
Dependent Repos
2
Total Releases
9
Latest Release
May 23, 2013
Categories
Repo
Alternatives To Is_crawler
Select To Compare
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 4 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40most recent commit a month ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22most recent commit 2 months ago
Pyspider ⭐ 15,943
A Powerful Spider(Web Crawler) System in Python.
dependent packages 2total releases 17most recent commit 10 months agopypi pyspider} Downloads
Newspaper ⭐ 13,147
News, full-text, and article metadata extraction in Python 3. Advanced docs:
dependent packages 97total releases 18most recent commit 7 months agopypi newspaper3k} Downloads


Suggest An Alternative To is_crawler
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Ruby
Crawler
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.