Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Web Archiving Open Source Projects

Open source projects categorized as Python Web Archiving
Archivebox ⭐ 19,721
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
dependent packages 1total releases 26most recent commit 11 days agopypi archivebox} Downloads
Conifer ⭐ 1,434
Collect and revisit web pages.
most recent commit 6 months ago
Pywb ⭐ 1,259
Core Python Web Archiving Toolkit for replay and recording of web archives
dependent packages 3total releases 98most recent commit 5 months agopypi pywb} Downloads
Ipwb ⭐ 577
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
total releases 241most recent commit 3 months ago
Auto Archiver ⭐ 439
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
total releases 46most recent commit 3 months ago
Archivenow ⭐ 376
A Tool To Push Web Resources Into Web Archives
most recent commit 3 months ago
Wail ⭐ 330
🐋 Web Archiving Integration Layer: One-Click User Instigated Preservation
most recent commit 5 months ago
Waybackpy ⭐ 235
Wayback Machine API interface & a command-line tool
dependent packages 5total releases 35most recent commit a year agopypi waybackpy} Downloads
Warcio ⭐ 173
Streaming WARC/ARC library for fast web archive IO
dependent packages 34total releases 22most recent commit 3 years agopypi warcio} Downloads
Sfm Ui ⭐ 148
Social Feed Manager user interface application.
most recent commit 9 months ago
Ph Submissions ⭐ 133
The repository and website hosting the peer review process for new Programming Historian lessons
most recent commit 3 months ago
Cdx_toolkit ⭐ 121
A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
total releases 29most recent commit a year ago
Fatcat ⭐ 98
Perpetual Access To The Scholarly Record
dependent packages 1total releases 5most recent commit a year agopypi fatcat-openapi-client} Downloads
Warcworker ⭐ 33
A dockerized, queued high fidelity web archiver based on Squidwarc
most recent commit 4 years ago
Metawarc ⭐ 21
metawarc: a command-line tool for metadata extraction from files from WARC (Web ARChive)
most recent commit 5 months ago
Sandcrawler ⭐ 19
Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki
most recent commit a year ago
Bookmark Archiver ⭐ 18
🗄 Save an archived copy of websites from Pocket/Pinboard/Bookmarks/RSS. Outputs HTML, PDFs, and more...
most recent commit 6 years ago
Cdxj Indexer ⭐ 17
CDXJ Indexing of WARC/ARCs
dependent packages 2total releases 12most recent commit 2 years agopypi cdxj-indexer} Downloads
Seeder ⭐ 15
Seeder - Czech webarchive curating tool and public site
most recent commit 3 months ago
Debian Archivebox ⭐ 13
Home of the official apt/deb package for Ubuntu/Debian-based systems.
most recent commit 5 months ago
Pip Archivebox ⭐ 13
Official Python package for ArchiveBox, the self-hosted internet archiving solution.
most recent commit 6 months ago
Webarchiver ⭐ 9
Decentralized web archiving
most recent commit 6 years ago
Capture Urls ⭐ 5
Archive a list of URLs using the Wayback Machine
most recent commit 4 months ago
The 6 Most Depended On Python Web Archiving Open Source Projects
Warcio ⭐ 173
Streaming WARC/ARC library for fast web archive IO
dependent packages 34total releases 22latest release August 11, 2020most recent commit 3 years agopypi warcio} Downloads
Waybackpy ⭐ 235
Wayback Machine API interface & a command-line tool
dependent packages 5total releases 35latest release March 15, 2022most recent commit a year agopypi waybackpy} Downloads
Pywb ⭐ 1,259
Core Python Web Archiving Toolkit for replay and recording of web archives
dependent packages 3total releases 98latest release May 19, 2023most recent commit 5 months agopypi pywb} Downloads
Cdxj Indexer ⭐ 17
CDXJ Indexing of WARC/ARCs
dependent packages 2total releases 12latest release June 25, 2022most recent commit 2 years agopypi cdxj-indexer} Downloads
Fatcat ⭐ 98
Perpetual Access To The Scholarly Record
dependent packages 1total releases 5latest release November 24, 2021most recent commit a year agopypi fatcat-openapi-client} Downloads
The 9 Latest Releases In Python Web Archiving Open Source Projects
Ipwb ⭐ 577
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
total releases 241latest release August 16, 2023most recent commit 3 months ago
Pywb ⭐ 1,259
Core Python Web Archiving Toolkit for replay and recording of web archives
dependent packages 3total releases 98latest release May 19, 2023most recent commit 5 months agopypi pywb} Downloads
Cdxj Indexer ⭐ 17
CDXJ Indexing of WARC/ARCs
dependent packages 2total releases 12latest release June 25, 2022most recent commit 2 years agopypi cdxj-indexer} Downloads
Waybackpy ⭐ 235
Wayback Machine API interface & a command-line tool
dependent packages 5total releases 35latest release March 15, 2022most recent commit a year agopypi waybackpy} Downloads
Cdx_toolkit ⭐ 121
A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
total releases 29latest release March 02, 2022most recent commit a year ago
Fatcat ⭐ 98
Perpetual Access To The Scholarly Record
dependent packages 1total releases 5latest release November 24, 2021most recent commit a year agopypi fatcat-openapi-client} Downloads
Warcio ⭐ 173
Streaming WARC/ARC library for fast web archive IO
dependent packages 34total releases 22latest release August 11, 2020most recent commit 3 years agopypi warcio} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.