Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Hdfs Open Source Projects

Open source projects categorized as Python Hdfs
Cat ⭐ 18,237
CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，
total releases 5most recent commit 4 months ago
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32most recent commit 10 months ago
Ibis ⭐ 3,404
The flexibility of Python with the scale and performance of modern SQL.
dependent packages 29total releases 68most recent commit 3 months agopypi ibis-framework} Downloads
Smart_open ⭐ 3,065
Utils for streaming large files (S3, HDFS, gzip, bz2...)
most recent commit a month ago
Hopsworks ⭐ 1,041
Hopsworks - Data-Intensive AI platform with a Feature Store
total releases 1most recent commit 3 months ago
Snakebite ⭐ 854
A pure python HDFS client
dependent packages 10total releases 63most recent commit 2 years agopypi snakebite} Downloads
Devops Python Tools ⭐ 709
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
most recent commit 3 months ago
Daily Deeplearning ⭐ 532
🔥机器学习/深度学习/Python/算法面试/自然语言处理教程/剑指offer/machine learning/deeplearning/Python/Algorithm interview/NLP Tutorial
most recent commit 3 months ago
Minos ⭐ 508
Minos is beyond a hadoop deployment system.
most recent commit 2 years ago
Deeplog ⭐ 320
Pytorch Implementation of DeepLog.
most recent commit 9 months ago
Packetpig ⭐ 309
Packetpig - Open Source Big Data Security Analytics
most recent commit 6 years ago
Tensorspark ⭐ 302
TensorFlow on Spark
most recent commit 7 years ago
Hdfs ⭐ 257
API and command line interface for HDFS
dependent packages 7total releases 15most recent commit 6 months ago
Pysparkling ⭐ 253
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
dependent packages 1total releases 69most recent commit a year agopypi pysparkling} Downloads
Omniduct ⭐ 247
A toolkit providing a uniform interface for connecting to and extracting data from a wide variety of (potentially remote) data stores (including HDFS, Hive, Presto, MySQL, etc).
total releases 73most recent commit 6 months ago
Hadoopy ⭐ 244
Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.
total releases 3most recent commit 8 years ago
Wradlib ⭐ 238
weather radar data processing - python package
most recent commit 5 months ago
Hadoop Attack Library ⭐ 200
A collection of pentest tools and resources targeting Hadoop environments
most recent commit 7 years ago
Tiledb Py ⭐ 167
Python interface to the TileDB storage engine
dependent packages 23total releases 125most recent commit 3 months agopypi tiledb} Downloads
Juicy Bigdata ⭐ 162
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
most recent commit a year ago
Ipython Spark Docker ⭐ 151
most recent commit 8 years ago
Portainer ⭐ 130
Apache Mesos framework for building Docker images on a cluster of machines
most recent commit 7 years ago
Plsc ⭐ 129
Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.
total releases 3most recent commit a year ago
The 10 Most Depended On Python Hdfs Open Source Projects
Ibis ⭐ 3,404
The flexibility of Python with the scale and performance of modern SQL.
dependent packages 29total releases 68latest release December 10, 2023most recent commit 3 months agopypi ibis-framework} Downloads
Tiledb Py ⭐ 167
Python interface to the TileDB storage engine
dependent packages 23total releases 125latest release November 29, 2023most recent commit 3 months agopypi tiledb} Downloads
Snakebite ⭐ 854
A pure python HDFS client
dependent packages 10total releases 63latest release August 30, 2016most recent commit 2 years agopypi snakebite} Downloads
Hdfs ⭐ 257
API and command line interface for HDFS
dependent packages 7total releases 15latest release December 13, 2022most recent commit 6 months ago
Skein ⭐ 126
A tool and library for easily deploying applications on Apache YARN
dependent packages 6total releases 23latest release April 05, 2022most recent commit 2 years agopypi skein} Downloads
Pyhdfs ⭐ 88
Python HDFS client
dependent packages 6total releases 8latest release January 05, 2020most recent commit 6 months agopypi PyHDFS} Downloads
Cluster Pack ⭐ 44
A library on top of either pex or conda-pack to make your Python code easily available on a cluster
dependent packages 4total releases 39latest release November 07, 2023most recent commit 4 months agopypi cluster-pack} Downloads
Snakebite Py3 ⭐ 20
Pure python HDFS client: python3.x version
dependent packages 4total releases 6latest release November 14, 2019most recent commit 2 years agopypi snakebite-py3} Downloads
Megfile ⭐ 99
Megvii FILE Library - Working with Files in Python same as the standard library
dependent packages 2total releases 68latest release November 27, 2023most recent commit 3 months agopypi megfile} Downloads
Pyox ⭐ 7
A simple REST client library for Hadoop / Knox in Python
dependent packages 1total releases 1latest release September 21, 2018most recent commit 5 years agopypi pyox} Downloads
The 10 Latest Releases In Python Hdfs Open Source Projects
Ibis ⭐ 3,404
The flexibility of Python with the scale and performance of modern SQL.
dependent packages 29total releases 68latest release December 10, 2023most recent commit 3 months agopypi ibis-framework} Downloads
Tiledb Py ⭐ 167
Python interface to the TileDB storage engine
dependent packages 23total releases 125latest release November 29, 2023most recent commit 3 months agopypi tiledb} Downloads
Megfile ⭐ 99
Megvii FILE Library - Working with Files in Python same as the standard library
dependent packages 2total releases 68latest release November 27, 2023most recent commit 3 months agopypi megfile} Downloads
Cluster Pack ⭐ 44
A library on top of either pex or conda-pack to make your Python code easily available on a cluster
dependent packages 4total releases 39latest release November 07, 2023most recent commit 4 months agopypi cluster-pack} Downloads
Pfio ⭐ 51
IO library to access various filesystems with unified API
total releases 30latest release October 06, 2023most recent commit 5 months ago
Hdfs ⭐ 257
API and command line interface for HDFS
dependent packages 7total releases 15latest release December 13, 2022most recent commit 6 months ago
Pysparkling ⭐ 253
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
dependent packages 1total releases 69latest release November 13, 2022most recent commit a year agopypi pysparkling} Downloads
Pydfs ⭐ 5
Distributed File System written in Python
total releases 1latest release August 04, 2022most recent commit 2 years ago
Popular Data Storage Categories
Database
Mysql
Redis
Mongodb
Postgresql
Firebase
Elasticsearch
Backup
Sqlite
Archive
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.