Smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Seaweedfs | 20,994 | 2 | a day ago | 296 | April 24, 2021 | 312 | apache-2.0 | Go | ||
| SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. | ||||||||||
| Ceph | 12,859 | 5 | 1 | 3 months ago | 1 | August 26, 2014 | 705 | other | C++ | |
| Ceph is a distributed object, block, and file storage platform | ||||||||||
| Juicefs | 9,252 | 1 | 3 months ago | 136 | November 28, 2023 | 120 | apache-2.0 | Go | ||
| JuiceFS is a distributed POSIX file system built on top of Redis and S3. | ||||||||||
| Smart_open | 3,065 | a month ago | 94 | mit | Python | |||||
| Utils for streaming large files (S3, HDFS, gzip, bz2...) | ||||||||||
| Tiledb | 1,700 | 6 | 3 months ago | 87 | November 05, 2022 | 133 | mit | C++ | ||
| The Universal Storage Engine | ||||||||||
| Kafka Connect Ui | 494 | 4 months ago | 24 | other | JavaScript | |||||
| Web tool for Kafka Connect | | ||||||||||
| Bigdata File Viewer | 269 | 6 months ago | 2 | gpl-2.0 | Java | |||||
| A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc. | ||||||||||
| Storagetapper | 269 | 2 years ago | 4 | November 19, 2021 | 21 | mit | Go | |||
| StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service | ||||||||||
| Pysparkling | 253 |  | 7 | 1 | a year ago | 69 | November 13, 2022 | 9 | other | Python |
| A pure Python implementation of Apache Spark's RDD and DStream interfaces. | ||||||||||
| Rumble | 194 | a year ago | 4 | December 03, 2019 | 134 | other | Java | |||
| ⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more | ||||||||||
Alternatives To Smart_openSelect To Compare
Alternative Project Comparisons
Popular Hdfs Projects
Popular S3 Projects
Popular Data Storage Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Streaming
S3
Hdfs
Streaming Data