Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Hdfs Open Source Projects

Open source projects categorized as Hdfs
Seaweedfs ⭐ 24,942
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
dependent packages 2total releases 296most recent commit 15 days ago
Bigdata Notes ⭐ 14,872
大数据入门指南 ⭐
most recent commit 2 years ago
Mycat Server ⭐ 9,431
most recent commit 2 years ago
Juicefs ⭐ 9,252
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
dependent packages 1total releases 136most recent commit a year ago
God Of Bigdata ⭐ 8,483
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.
most recent commit 2 years ago
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32most recent commit 2 years ago
Smart_open ⭐ 3,225
Utils for streaming large files (S3, HDFS, gzip, bz2...)
most recent commit 8 months ago
Docker Hadoop ⭐ 1,955
Apache Hadoop docker image
most recent commit 2 years ago
Xlearning ⭐ 1,729
AI on Hadoop
most recent commit 2 years ago
Bigdata Growth ⭐ 1,625
大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
most recent commit 2 months ago
Bigdata Interview ⭐ 1,397
🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop
most recent commit 4 years ago
Hopsworks ⭐ 1,041
Hopsworks - Data-Intensive AI platform with a Feature Store
total releases 1most recent commit a year ago
Addax ⭐ 1,034
Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.
dependent packages 67total releases 10most recent commit 2 years ago
Sqoop ⭐ 820
Mirror of Apache Sqoop
most recent commit 4 years ago
Devops Python Tools ⭐ 709
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
most recent commit 2 years ago
Hawq ⭐ 677
Apache HAWQ
most recent commit 2 years ago
Daily Deeplearning ⭐ 532
🔥机器学习/深度学习/Python/算法面试/自然语言处理教程/剑指offer/machine learning/deeplearning/Python/Algorithm interview/NLP Tutorial
most recent commit a year ago
Sparta ⭐ 525
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 6 years ago
Kafka Connect Ui ⭐ 511
Deprecated - See Lenses.io Community Edition
most recent commit 2 months ago
Minos ⭐ 508
Minos is beyond a hadoop deployment system.
most recent commit 3 years ago
Docker Hadoop Spark Workbench ⭐ 503
[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.
most recent commit 5 years ago
Kafka Connect Hdfs ⭐ 473
Kafka Connect HDFS connector
most recent commit 2 years ago
Storm Yarn ⭐ 419
Storm-yarn enables Storm clusters to be deployed into machines managed by Hadoop YARN.
most recent commit 5 years ago
The 10 Most Depended On Hdfs Open Source Projects
Teraslice ⭐ 50
Scalable data processing pipelines in JavaScript
dependent packages 31total releases 129latest release September 27, 2023most recent commit a year agonpm @terascope/utils} Downloads
Kite ⭐ 366
Kite SDK
dependent packages 17total releases 62latest release January 20, 2017most recent commit 5 years ago
Tnt4j Streams ⭐ 5
TNT4J Streams allows data streaming, parsing from various data sources into TNT4J event sinks
dependent packages 11total releases 47latest release March 30, 2023most recent commit a year ago
Rlink Rs ⭐ 316
High-performance Stream Processing Framework. An alternative to Apache Flink.
dependent packages 10total releases 64latest release August 31, 2021most recent commit 2 years agocargo rlink} Downloads
Rubix ⭐ 121
Cache File System optimized for columnar formats and object stores
dependent packages 8total releases 39latest release November 24, 2020most recent commit 5 years ago
Hdfs ⭐ 257
API and command line interface for HDFS
dependent packages 7total releases 15latest release December 13, 2022most recent commit 2 years ago
Tempto ⭐ 60
A testing framework for Presto
dependent packages 6total releases 11latest release July 01, 2022most recent commit 3 years ago
Skein ⭐ 126
A tool and library for easily deploying applications on Apache YARN
dependent packages 6total releases 23latest release April 05, 2022most recent commit 3 years agopypi skein} Downloads
The 10 Latest Releases In Hdfs Open Source Projects
Hdfs.jl ⭐ 22
HDFS interface for Julia as a wrapper over Hadoop HDFS library.
latest release December 02, 2023most recent commit 10 years ago
Juicefs ⭐ 9,252
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
dependent packages 1total releases 136latest release November 28, 2023most recent commit a year ago
Megfile ⭐ 99
Megvii FILE Library - Working with Files in Python same as the standard library
dependent packages 2total releases 68latest release November 27, 2023most recent commit a year agopypi megfile} Downloads
Mesos Chapel ⭐ 22
Cray Chapel scheduler for Apache Mesos
latest release November 20, 2023most recent commit 11 years ago
Godownloader ⭐ 15
downloader service by golang
latest release November 20, 2023most recent commit 11 years ago
Cluster Pack ⭐ 44
A library on top of either pex or conda-pack to make your Python code easily available on a cluster
dependent packages 4total releases 39latest release November 07, 2023most recent commit 2 years agopypi cluster-pack} Downloads
Cobrix ⭐ 131
A COBOL parser and Mainframe/EBCDIC data source for Apache Spark
dependent packages 2total releases 43latest release October 16, 2023most recent commit a year ago
Teraslice ⭐ 50
Scalable data processing pipelines in JavaScript
dependent packages 31total releases 129latest release September 27, 2023most recent commit a year agonpm @terascope/utils} Downloads
Tiledb R ⭐ 96
R interface to TileDB: The Modern Database
total releases 33latest release September 27, 2023most recent commit a year ago
Popular Data Storage Categories
Database
Mysql
Redis
Mongodb
Postgresql
Firebase
Elasticsearch
Backup
Sqlite
Archive
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2025 Awesome Open Source.  All rights reserved.