Utils for streaming large files (S3, HDFS, gzip, bz2...)
Alternatives To Smart_open
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Seaweedfs21,5412a month ago296April 24, 2021312apache-2.0Go
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Ceph12,859516 months ago1August 26, 2014705otherC++
Ceph is a distributed object, block, and file storage platform
Juicefs9,25216 months ago136November 28, 2023120apache-2.0Go
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
4 months ago94mitPython
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Tiledb1,70066 months ago87November 05, 2022133mitC++
The Universal Storage Engine
Kafka Connect Ui494
7 months ago24otherJavaScript
Web tool for Kafka Connect |
Bigdata File Viewer269
9 months ago2gpl-2.0Java
A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
3 years ago4November 19, 202121mitGo
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Pysparkling253712 years ago69November 13, 20229otherPython
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
a year ago4December 03, 2019134otherJava
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Alternatives To Smart_open
Select To Compare

Alternative Project Comparisons
Popular Hdfs Projects
Popular S3 Projects
Popular Data Storage Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Streaming Data