Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Hadoop Big Data Open Source Projects

Open source projects categorized as Python Hadoop Big Data
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46most recent commit 4 months ago
Data Science Ipython Notebooks ⭐ 25,668
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
most recent commit 7 months ago
H2o 3 ⭐ 6,618
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
dependent packages 33total releases 49most recent commit 4 months ago
Ambari ⭐ 2,030
Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.
total releases 4most recent commit 4 months ago
Coding Now ⭐ 925
学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、
most recent commit 2 years ago
Hadoop Attack Library ⭐ 200
A collection of pentest tools and resources targeting Hadoop environments
most recent commit 7 years ago
Juicy Bigdata ⭐ 162
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
most recent commit a year ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Griffon Vm ⭐ 129
Griffon Data Science Virtual Machine
most recent commit 2 years ago
Aut ⭐ 128
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
total releases 27most recent commit 10 months ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 4 years ago
Cqu_bigdata ⭐ 77
重庆大学计算机学院“大数据课程群”实验及PPT
most recent commit 2 years ago
Apache Spark Hands On ⭐ 64
Educational notes,Hands on problems w/ solutions for hadoop ecosystem
most recent commit 5 years ago
Serverless Spark Workshop ⭐ 56
Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service
most recent commit 6 months ago
Datapipelines Essentials Python ⭐ 45
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
most recent commit a year ago
Yuzhouwan ⭐ 42
Code Library for My Blog
most recent commit 4 months ago
Big Data ⭐ 37
Python tools for big data
most recent commit 7 months ago
Ambari Metrics ⭐ 34
Apache Ambari Metrics is a sub project of Apache Ambari.
most recent commit 6 months ago
Telemetry Analysis Service ⭐ 33
Telemetry Analysis Service
most recent commit 4 years ago
Awesome Tools ⭐ 32
curated list of awesome tools and libraries for specific domains
most recent commit 4 months ago
Clusterdock ⭐ 26
clusterdock is a framework for creating Docker-based container clusters
total releases 27most recent commit 2 years ago
Real_time_social_media_mining ⭐ 24
DevOps pipeline for Real Time Social/Web Mining
most recent commit 6 months ago
Learn Hadoop And Spark ⭐ 22
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
most recent commit 6 years ago
The 2 Most Depended On Python Hadoop Big Data Open Source Projects
The 7 Latest Releases In Python Hadoop Big Data Open Source Projects
Aut ⭐ 128
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
total releases 27latest release November 17, 2022most recent commit 10 months ago
Spooq ⭐ 8
total releases 10latest release August 16, 2022most recent commit a year ago
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46latest release May 09, 2021most recent commit 4 months ago
Clusterdock ⭐ 26
clusterdock is a framework for creating Docker-based container clusters
total releases 27latest release August 11, 2020most recent commit 2 years ago
Hadeploy ⭐ 5
An Hadoop Application Deployment tool
total releases 12latest release January 22, 2019most recent commit 5 years ago
Ambari ⭐ 2,030
Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.
total releases 4latest release December 12, 2016most recent commit 4 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.