Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Proxy_pool	19,442			4 months ago			273	mit	Python
Python ProxyPool for web spider
Proxypool	5,154			4 months ago			40	mit	Python
An Efficient ProxyPool with Getter, Tester and Server
Scylla	3,819	5		5 months ago	30	August 25, 2019	42	apache-2.0	Python
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
Proxybroker	3,561	9	3	5 months ago	12	March 12, 2019	101	apache-2.0	Python
Proxy [Finder \| Checker \| Server]. HTTP(S) & SOCKS :performing_arts:
Crawler User Agents	1,045	5	8	4 months ago	118	November 20, 2023	7	mit	Python
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
Scrapyrt	793	5		6 months ago	7	September 20, 2023	31	bsd-3-clause	Python
HTTP API for Scrapy spiders
Staticgen	668			3 years ago	3	September 23, 2020	13	mit	Go
Static website generator that lets you use HTTP servers and frameworks you already know
Http Status Check	587	4	1	4 months ago	22	June 14, 2023		mit	PHP
CLI tool to crawl a website and check HTTP status codes
Player	483	2		3 months ago	86	November 28, 2023	15	mit	PHP
Blackfire Player is a powerful Web Crawling, Web Testing, and Web Scraper application. It provides a nice DSL to crawl HTTP services, assert responses, and extract data from HTML/XML/JSON responses.
Sitemap Generator	331	74	27	a year ago	61	September 11, 2020	32	mit	JavaScript
Easily create XML sitemaps for your website.

Alternatives To Is_bot

Select To Compare

Proxy_pool ⭐ 19,442

Python ProxyPool for web spider

most recent commit 4 months ago

Proxypool ⭐ 5,154

An Efficient ProxyPool with Getter, Tester and Server

most recent commit 4 months ago

Scylla ⭐ 3,819

Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era

total releases 30most recent commit 5 months ago

Proxybroker ⭐ 3,561

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS :performing_arts:

dependent packages 3total releases 12most recent commit 5 months ago

Crawler User Agents ⭐ 1,045

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:

dependent packages 8total releases 118most recent commit 4 months ago

Scrapyrt ⭐ 793

HTTP API for Scrapy spiders

total releases 7most recent commit 6 months ago

Staticgen ⭐ 668

Static website generator that lets you use HTTP servers and frameworks you already know

total releases 3most recent commit 3 years ago

Http Status Check ⭐ 587

CLI tool to crawl a website and check HTTP status codes

dependent packages 1total releases 22most recent commit 4 months ago

packagist spatie/http-status-check} Downloads

Player ⭐ 483

Blackfire Player is a powerful Web Crawling, Web Testing, and Web Scraper application. It provides a nice DSL to crawl HTTP services, assert responses, and extract data from HTML/XML/JSON responses.

total releases 86most recent commit 3 months ago

Sitemap Generator ⭐ 331

Easily create XML sitemaps for your website.

dependent packages 27total releases 61most recent commit a year ago

Suggest An Alternative To is_bot

Alternative Project Comparisons

Is_bot vs Proxy_pool

Is_bot vs Proxypool

Is_bot vs Scylla

Is_bot vs Proxybroker

Is_bot vs Crawler User Agents

Is_bot vs Scrapyrt

Is_bot vs Staticgen

Is_bot vs Http Status Check

Is_bot vs Player

Is_bot vs Sitemap Generator

Popular Http Projects

Frp ⭐ 76,428

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

dependent packages 18total releases 93latest release October 24, 2023most recent commit 3 months ago

Hoppscotch ⭐ 59,845

👽 Open source API development ecosystem - https://hoppscotch.io

dependent packages 2total releases 11latest release October 14, 2023most recent commit 18 days ago

Caddy ⭐ 53,386

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

dependent packages 462total releases 383latest release December 07, 2023most recent commit 17 days ago

Requests ⭐ 51,284

A simple, yet elegant, HTTP library.

dependent packages 57,003total releases 151latest release July 20, 2023most recent commit 19 days ago

Okhttp ⭐ 44,954

Square’s meticulous HTTP client for the JVM, Android, and GraalVM.

dependent packages 3,974total releases 91latest release October 17, 2023most recent commit 3 months ago

Popular Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Lux ⭐ 24,752

👾 Fast and simple video download library and CLI tool written in Go

dependent packages 8total releases 40latest release November 06, 2023most recent commit a month ago

Colly ⭐ 21,902

Elegant Scraper and Crawler Framework for Golang

dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago

Easyspider ⭐ 20,149

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化

most recent commit 24 days ago

Pyspider ⭐ 15,943

A Powerful Spider(Web Crawler) System in Python.

dependent packages 2total releases 17latest release April 18, 2018most recent commit 10 months ago

Popular Networking Categories