Argus

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-0
Alternatives To Argus
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Scrapy49,9184,1854452 months ago96September 18, 2023692bsd-3-clausePython
Scrapy, a fast high-level web crawling & scraping framework for Python.
Crawlab10,521
3 months ago1March 03, 201958bsd-3-clauseGo
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Awesome Crawler5,859
4 months ago27mit
A collection of awesome web crawler,spider in different languages
Wechatsogou5,753
24 months ago25April 10, 201981apache-2.0Python
基于搜狗微信搜索的微信公众号爬虫接口
Scrapy Redis5,392176214 months ago18July 26, 202229mitPython
Redis-based components for Scrapy.
Haipproxy5,372
1a year ago7June 18, 201844mitPython
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
Ecommercecrawlers3,724
a year ago43mitPython
实战🐍多种网站、电商数据爬虫🕷。包含🕸:淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评、携程、小米应用商店、安居客、途家民宿❤️❤️❤️。微信爬虫展示项目:
Distribute_crawler3,176
7 years ago26Python
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
Gerapy3,144
82 months ago49July 19, 202360mitPython
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
Python3 Spider2,582
5 months ago6Python
Python爬虫实战 - 模拟登陆各大网站 包含但不限于:滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝,如果喜欢请start ❤️
Alternatives To Argus
Select To Compare


Alternative Project Comparisons
Popular Scrapy Projects
Popular Crawler Projects
Popular Data Processing Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Scraper
Crawler
Curl
Web Crawler
Scrapy