Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Mapreduce Open Source Projects

Open source projects categorized as Python Mapreduce
Data Science Ipython Notebooks ⭐ 25,668
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
most recent commit 6 months ago
Dev Setup ⭐ 5,802
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
most recent commit 2 years ago
Dpark ⭐ 2,637
Python clone of Spark, a MapReduce alike framework in Python
total releases 19most recent commit 3 years ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62most recent commit 2 years agopypi mrjob} Downloads
Cdap ⭐ 735
An open source framework for building data analytic applications.
dependent packages 56total releases 23most recent commit 3 months ago
Mincemeatpy ⭐ 467
Lightweight MapReduce in python
most recent commit 3 years ago
Tdigest ⭐ 332
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
dependent packages 19total releases 14most recent commit 2 years agopypi tdigest} Downloads
Hadoopy ⭐ 244
Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.
total releases 3most recent commit 8 years ago
Appengine Mapreduce ⭐ 229
A library for running MapReduce jobs on App Engine
dependent packages 2total releases 16most recent commit 5 months ago
Juicy Bigdata ⭐ 162
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
most recent commit a year ago
Cc Mrjob ⭐ 157
Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
most recent commit 2 years ago
Pda_book ⭐ 154
Code Examples Data Science using Python
most recent commit 7 years ago
Data Algorithms With Spark ⭐ 151
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
most recent commit 10 months ago
Python Bigdata ⭐ 128
Data science and Big Data with Python
most recent commit 8 months ago
Kaylee ⭐ 123
MapReduce with ZeroMQ
most recent commit 11 years ago
Flox ⭐ 112
Fast & furious GroupBy operations for dask.array
dependent packages 10total releases 40most recent commit 3 months agopypi flox} Downloads
Introtohadoopandmr__udacity_course ⭐ 103
🐘 Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"
most recent commit 10 years ago
Dampr ⭐ 101
Python Data Processing library
total releases 9most recent commit 4 months ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 4 years ago
Big Data Engineering Coursera Yandex ⭐ 91
Big Data for Data Engineers Coursera Specialization from Yandex
most recent commit a year ago
Annotated Wikiextractor ⭐ 88
Simple Wikipedia plain text extractor with article link annotations and Hadoop support.
most recent commit 13 years ago
Solutions Google Compute Engine Cluster For Hadoop ⭐ 81
This sample app will get up and running quickly with a Hadoop cluster on Google Compute Engine. For more information on running Hadoop on GCE, read the papers at https://cloud.google.com/resources/.
most recent commit 6 years ago
Rail ⭐ 70
Scalable RNA-seq analysis
most recent commit 3 years ago
The 7 Most Depended On Python Mapreduce Open Source Projects
Cdap ⭐ 735
An open source framework for building data analytic applications.
dependent packages 56total releases 23latest release September 01, 2023most recent commit 3 months ago
Tdigest ⭐ 332
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
dependent packages 19total releases 14latest release August 27, 2016most recent commit 2 years agopypi tdigest} Downloads
Flox ⭐ 112
Fast & furious GroupBy operations for dask.array
dependent packages 10total releases 40latest release November 30, 2023most recent commit 3 months agopypi flox} Downloads
Pyrallel ⭐ 10
Yet another easy-to-use python3 parallel library for humans.
dependent packages 2total releases 8latest release March 02, 2021most recent commit 3 years agopypi pyrallel.lib} Downloads
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62latest release December 15, 2021most recent commit 2 years agopypi mrjob} Downloads
Appengine Mapreduce ⭐ 229
A library for running MapReduce jobs on App Engine
dependent packages 2total releases 16latest release September 14, 2017most recent commit 5 months ago
Pyxtension ⭐ 36
Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
dependent packages 2total releases 54latest release November 05, 2023most recent commit 5 months agopypi pyxtension} Downloads
The 10 Latest Releases In Python Mapreduce Open Source Projects
Flox ⭐ 112
Fast & furious GroupBy operations for dask.array
dependent packages 10total releases 40latest release November 30, 2023most recent commit 3 months agopypi flox} Downloads
Chess ⭐ 60
A MapReduce job to explore blunders in chess games.
latest release November 20, 2023most recent commit 7 years ago
Pyxtension ⭐ 36
Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
dependent packages 2total releases 54latest release November 05, 2023most recent commit 5 months agopypi pyxtension} Downloads
Madoop ⭐ 6
A light weight MapReduce framework for education
total releases 8latest release November 04, 2023most recent commit 6 months ago
Cdap ⭐ 735
An open source framework for building data analytic applications.
dependent packages 56total releases 23latest release September 01, 2023most recent commit 3 months ago
Mr4mp ⭐ 5
Thin MapReduce-like layer that wraps the Python multiprocessing library.
total releases 25latest release June 09, 2023most recent commit a year ago
Pydfs ⭐ 5
Distributed File System written in Python
total releases 1latest release August 04, 2022most recent commit 2 years ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62latest release December 15, 2021most recent commit 2 years agopypi mrjob} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.