Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Amazon Web Services Hadoop Open Source Projects

Open source projects categorized as Amazon Web Services Hadoop
Categories > Cloud Computing > Amazon Web Services
Data Science Ipython Notebooks ⭐ 25,668
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
most recent commit 6 months ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62most recent commit 2 years agopypi mrjob} Downloads
Devops Bash Tools ⭐ 2,224
1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
most recent commit 3 months ago
Nagios Plugins ⭐ 1,119
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
most recent commit 2 months ago
Devops Python Tools ⭐ 709
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
most recent commit 3 months ago
Flintrock ⭐ 627
A command-line tool for launching Apache Spark clusters.
total releases 14most recent commit 5 months ago
Aws Glue Libs ⭐ 568
AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
most recent commit 9 months ago
Data Engineering Interview Questions ⭐ 554
More than 2000+ Data engineer interview questions.
most recent commit 7 months ago
Spark Redshift ⭐ 514
Redshift data source for Apache Spark
dependent packages 1total releases 10most recent commit 4 years ago
Cloudbreak ⭐ 348
CDP Public Cloud is an integrated analytics and data management platform deployed on cloud services. It offers broad data analytics and artificial intelligence functionality along with secure user access and data governance features.
most recent commit 3 months ago
Sagemaker Spark ⭐ 285
A Spark library for Amazon SageMaker.
total releases 36most recent commit 7 months ago
Parquet4s ⭐ 267
Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
dependent packages 6total releases 57most recent commit 3 months ago
Spark Jupyter Aws ⭐ 255
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
most recent commit 6 years ago
Learning Hadoop And Spark ⭐ 160
Companion to Learning Hadoop and Learning Spark courses on Linked In Learning
most recent commit 6 months ago
Variantspark ⭐ 121
machine learning for genomic variants
total releases 38most recent commit a year ago
Streamx ⭐ 95
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
most recent commit 5 years ago
Templates ⭐ 82
DevOps Templates for Kubernetes, AWS, GCP, Terraform, Docker, Packer, Jenkins, CircleCI, GitHub Actions, Lambda, AWS CodeBuild, GCP Cloud Build, Vagrant, Puppet, Python, Bash, Go, Perl, Java, Scala, Groovy, Maven, SBT, Gradle, Make, Jenkinsfile, Makefile, Dockerfile, docker-compose.yml, Vagrantfile, M4 etc...
most recent commit 6 months ago
Terraform Aws Emr Cluster ⭐ 67
Terraform module to provision an Elastic MapReduce (EMR) cluster on AWS
most recent commit a year ago
Hadoop S3a ⭐ 59
An AWS SDK-backed FileSystem driver for Hadoop
most recent commit 7 years ago
Spark Install ⭐ 50
Installation guide for Apache Spark + Hadoop on Mac/Linux
most recent commit 7 years ago
Wikireverse ⭐ 39
Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
most recent commit 6 years ago
Csds Material ⭐ 38
Course material for the Computer Systems for Data Science class at Columbia
most recent commit 6 years ago
Telemetry Analysis Service ⭐ 33
Telemetry Analysis Service
most recent commit 4 years ago
The 3 Most Depended On Amazon Web Services Hadoop Open Source Projects
Parquet4s ⭐ 267
Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
dependent packages 6total releases 57latest release November 12, 2023most recent commit 3 months ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62latest release December 15, 2021most recent commit 2 years agopypi mrjob} Downloads
Spark Redshift ⭐ 514
Redshift data source for Apache Spark
dependent packages 1total releases 10latest release November 01, 2016most recent commit 4 years ago
The 9 Latest Releases In Amazon Web Services Hadoop Open Source Projects
Flintrock ⭐ 627
A command-line tool for launching Apache Spark clusters.
total releases 14latest release November 27, 2023most recent commit 5 months ago
Parquet4s ⭐ 267
Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
dependent packages 6total releases 57latest release November 12, 2023most recent commit 3 months ago
Sagemaker Spark ⭐ 285
A Spark library for Amazon SageMaker.
total releases 36latest release August 26, 2022most recent commit 7 months ago
Variantspark ⭐ 121
machine learning for genomic variants
total releases 38latest release May 20, 2022most recent commit a year ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 2total releases 62latest release December 15, 2021most recent commit 2 years agopypi mrjob} Downloads
Aws Hadoop ⭐ 9
Python project that builds hadoop cluster in amazon aws ec2.
total releases 2latest release December 30, 2017most recent commit 6 years ago
Berilia ⭐ 10
Create hadoop cluster in aws ec2 for development
total releases 3latest release June 09, 2017most recent commit 7 years ago
Spark Redshift ⭐ 514
Redshift data source for Apache Spark
dependent packages 1total releases 10latest release November 01, 2016most recent commit 4 years ago
Haas ⭐ 5
The easiest way to launch a Hadoop cluster in the cloud
total releases 3latest release January 18, 2015most recent commit 9 years ago
Popular Cloud Computing Categories
Amazon Web Services
Cloud Computing
Azure
Lambda Functions
Heroku
Serverless
S3
Google Cloud Platform
Aws Lambda
Aws Ecs
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.