Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Docker Crawler Open Source Projects

Open source projects categorized as Docker Crawler
Categories > Data Processing > Crawler
Categories > Virtualization > Docker
Crawlab ⭐ 10,521
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
total releases 1most recent commit 3 months ago
Proxypool ⭐ 5,154
An Efficient ProxyPool with Getter, Tester and Server
most recent commit 4 months ago
Gerapy ⭐ 3,144
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
total releases 49most recent commit 3 months ago
Packtpub Crawler ⭐ 701
Download your daily free Packt Publishing eBook https://www.packtpub.com/packt/offers/free-learnin
most recent commit 4 years ago
Newcrawler ⭐ 583
Free Web Scraping Tool with Java
most recent commit 5 months ago
Crawljax ⭐ 493
Crawljax
dependent packages 6total releases 18most recent commit 10 months ago
Browsertrix Crawler ⭐ 470
Run a high-fidelity browser-based crawler in a single Docker container
most recent commit 3 months ago
Scrapybook ⭐ 378
Scrapy Book Code
most recent commit 6 years ago
Spidy ⭐ 287
The simple, easy to use command line web crawler.
total releases 12most recent commit 2 years ago
Go Movies ⭐ 232
golang spider Crawler 爬虫 电影
most recent commit 5 months ago
Goose Parser ⭐ 222
Universal scraping tool, which allows you to extract data using multiple environments
dependent packages 6total releases 87most recent commit 5 years agonpm goose-parser} Downloads
Zhihuspider ⭐ 215
多线程知乎用户爬虫，基于python3
most recent commit a year ago
Zimit ⭐ 209
Make a ZIM file from any Web site and surf offline!
most recent commit 3 months ago
Portia Dashboard ⭐ 190
portia-dashboard is a visual web crawler based on scrapinghub/portia
most recent commit 6 years ago
Black Widow ⭐ 168
GUI based offensive penetration testing tool (Open Source)
total releases 13most recent commit 2 years ago
Github_commit_crawler ⭐ 167
Tool used to continuously monitor a Github org for mistaken public commits
most recent commit 8 years ago
Estela ⭐ 142
estela, an elastic web scraping cluster 🕸
most recent commit 3 months ago
Crawler ⭐ 138
Go process used to crawl websites
most recent commit 4 years ago
Acm Statistics ⭐ 137
An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge
most recent commit 4 months ago
Javbus Api ⭐ 136
一个自我托管的 JavBus API 服务
most recent commit 5 months ago
Poopak ⭐ 110
POOPAK - TOR Hidden Service Crawler
most recent commit a year ago
Councilor Voter Guide ⭐ 104
縣市長 / 議員 投票指南
most recent commit 5 years ago
Fexm ⭐ 103
Automated fuzzing framework
most recent commit 3 years ago
The 5 Most Depended On Docker Crawler Open Source Projects
Goose Parser ⭐ 222
Universal scraping tool, which allows you to extract data using multiple environments
dependent packages 6total releases 87latest release April 17, 2019most recent commit 5 years agonpm goose-parser} Downloads
Crawljax ⭐ 493
Crawljax
dependent packages 6total releases 18latest release June 01, 2023most recent commit 10 months ago
Aragog ⭐ 9
Distributed web scraping framework
dependent packages 2total releases 9latest release December 15, 2021most recent commit 2 years agonpm aragog-client} Downloads
Toripchanger ⭐ 24
Python powered way to get a unique Tor IP
dependent packages 1total releases 6latest release July 25, 2020most recent commit 4 years agopypi toripchanger} Downloads
Microdocs ⭐ 11
Documentation that scales with your Microservices
dependent packages 1total releases 23latest release October 21, 2021most recent commit 2 years ago
The 10 Latest Releases In Docker Crawler Open Source Projects
Snapcrawl ⭐ 51
Crawl a website and take screenshots
total releases 27latest release July 27, 2023most recent commit 9 months ago
Gerapy ⭐ 3,144
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
total releases 49latest release July 19, 2023most recent commit 3 months ago
Crawljax ⭐ 493
Crawljax
dependent packages 6total releases 18latest release June 01, 2023most recent commit 10 months ago
Worker ⭐ 12
Containerized Ferret worker
total releases 26latest release March 29, 2023most recent commit a year ago
Black Widow ⭐ 168
GUI based offensive penetration testing tool (Open Source)
total releases 13latest release June 17, 2022most recent commit 2 years ago
Aragog ⭐ 9
Distributed web scraping framework
dependent packages 2total releases 9latest release December 15, 2021most recent commit 2 years agonpm aragog-client} Downloads
Microdocs ⭐ 11
Documentation that scales with your Microservices
dependent packages 1total releases 23latest release October 21, 2021most recent commit 2 years ago
Toripchanger ⭐ 24
Python powered way to get a unique Tor IP
dependent packages 1total releases 6latest release July 25, 2020most recent commit 4 years agopypi toripchanger} Downloads
Goose Parser ⭐ 222
Universal scraping tool, which allows you to extract data using multiple environments
dependent packages 6total releases 87latest release April 17, 2019most recent commit 5 years agonpm goose-parser} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.