Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Chronicrawl

Experimental continouous web crawler for web archiving
Stars
8
License
apache-2.0
Open Issues
9
Most Recent Commit
a year ago
Programming Language
Java
Categories
Repo
Alternatives To Chronicrawl
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Heritrix32,57925 months ago9July 27, 202248otherJava
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Awesome Web Archiving1,669
3 months ago3cc0-1.0
An Awesome List for getting started with web archiving
Grab Site1,254
a month ago92otherPython
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Awesome Datahoarding892
7 months ago4
List of data-hoarding related tools
Brozzler613
23 months ago23January 02, 202040apache-2.0Python
brozzler - distributed browser-based web crawler
Archivebot328
5 months ago169mitPython
ArchiveBot, an IRC bot for archiving websites
Tumblr_crawler258
6 years ago2gpl-3.0Python
This is a Multi-thread crawler for Tumblr.
Google Group Crawler213
2 years ago6Shell
[Deprecated] Get (almost) original messages from google group archives. Your data is yours.
Cc Crawl Statistics97
4 months agoapache-2.0Python
Statistics of Common Crawl monthly archives mined from URL index files
Wget Lua72
4 months ago10gpl-3.0C
Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
Alternatives To Chronicrawl
Select To Compare
Brozzler ⭐ 613
brozzler - distributed browser-based web crawler
total releases 23most recent commit 3 months ago


Suggest An Alternative To chronicrawl
Alternative Project Comparisons
Chronicrawl vs Heritrix3
Chronicrawl vs Awesome Web Archiving
Chronicrawl vs Grab Site
Chronicrawl vs Awesome Datahoarding
Chronicrawl vs Brozzler
Chronicrawl vs Archivebot
Chronicrawl vs Tumblr_crawler
Chronicrawl vs Google Group Crawler
Chronicrawl vs Cc Crawl Statistics
Chronicrawl vs Wget Lua
Popular Archive Projects
Vim ⭐ 34,054
The official Vim repository
total releases 1,494latest release October 28, 2022most recent commit 3 months ago
Jmeter ⭐ 7,700
Apache JMeter open-source load testing tool for analyzing and measuring the performance of a variety of services
dependent packages 75total releases 27latest release July 11, 2023most recent commit 3 months ago
Manifest ⭐ 7,240
Component for reading phar.io manifest information from a PHP Archive (PHAR)
dependent packages 13total releases 8latest release July 20, 2021most recent commit a year agopackagist phar-io/manifest} Downloads
Popular Crawler Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 17 days ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Popular Data Storage Categories
Database
Mysql
Redis
Mongodb
Postgresql
Firebase
Elasticsearch
Backup
Sqlite
Archive
Related Searches
Crawler Archive
Crawler Chromium
Archive Web Crawler
Crawler Web Archiving

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Java
Archive
Crawler
Web Crawler
Chromium
Web Archiving
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.