Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Amazon Web Services Emr Open Source Projects

Open source projects categorized as Amazon Web Services Emr
Categories > Cloud Computing > Amazon Web Services
Categories > Emr
Aws Sdk Pandas ⭐ 3,384
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
dependent packages 34total releases 125most recent commit 10 hours agopypi awswrangler} Downloads
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 1total releases 62most recent commit 6 months agopypi mrjob} Downloads
Hudi Resources ⭐ 429
汇总Apache Hudi相关资料
most recent commit 6 days ago
Beginner_de_project ⭐ 276
Beginner data engineering project - batch edition
most recent commit a month ago
Sagemaker Spark ⭐ 263
A Spark library for Amazon SageMaker.
total releases 36most recent commit 7 months ago
Spark Jupyter Aws ⭐ 255
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
most recent commit 5 years ago
Hello Aws Data Services ⭐ 156
Sample code for AWS data service and ML courses on LinkedIn Learning
most recent commit 2 days ago
Aws Glue Data Catalog Client For Apache Hive Metastore ⭐ 156
The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog
most recent commit 4 months ago
Learning Hadoop And Spark ⭐ 148
Companion to Learning Hadoop and Learning Spark courses on Linked In Learning
most recent commit 2 months ago
Repo 2019 ⭐ 135
BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics
most recent commit 2 years ago
Variantspark ⭐ 119
machine learning for genomic variants
total releases 36most recent commit 5 months ago
Emr Serverless Samples ⭐ 85
Example code for running Spark and Hive jobs on EMR Serverless.
most recent commit a month ago
Spark_scala_ml_examples ⭐ 75
Spark 2.0 Scala Machine Learning examples
most recent commit 3 years ago
Sensu Plugins Aws ⭐ 75
This plugin provides native AWS instrumentation for monitoring and metrics collection, including: health and metrics for various AWS services, such as EC2, RDS, ELB, and more, as well as handlers for EC2, SES, and SNS.
dependent packages 1total releases 84most recent commit 2 years agorubygems sensu-plugins-aws} Downloads
Rail ⭐ 70
Scalable RNA-seq analysis
most recent commit 2 years ago
Sparksteps ⭐ 68
⭐️ CLI tool to launch Spark jobs on AWS EMR
total releases 20most recent commit 2 years ago
Aws Concurrent Data Orchestration Pipeline Emr Livy ⭐ 66
This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concurrent data pipeline by using Amazon EMR and Apache Livy. This pipeline is orchestrated by Apache Airflow.
most recent commit 4 years ago
Terraform Aws Emr Cluster ⭐ 62
Terraform module to provision an Elastic MapReduce (EMR) cluster on AWS
most recent commit 4 months ago
Sbt Lighter ⭐ 55
SBT plugin for Apache Spark on AWS EMR
most recent commit 4 years ago
Elasticrawl ⭐ 50
Launch AWS Elastic MapReduce jobs that process Common Crawl data.
total releases 10most recent commit 6 years ago
Emr Bootstrap Spark ⭐ 49
AWS bootstrap scripts for Mozilla's flavoured Spark setup.
most recent commit 3 years ago
Themis ⭐ 45
Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
total releases 22most recent commit 4 years ago
Emr Bootstrap Pyspark ⭐ 43
Quickstart PySpark with Anaconda on AWS/EMR
most recent commit 6 years ago
The 3 Most Depended On Amazon Web Services Emr Open Source Projects
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 1total releases 62latest release September 17, 2020most recent commit 6 months agopypi mrjob} Downloads
The 9 Latest Releases In Amazon Web Services Emr Open Source Projects
Variantspark ⭐ 119
machine learning for genomic variants
total releases 36latest release May 20, 2022most recent commit 5 months ago
Sagemaker Spark ⭐ 263
A Spark library for Amazon SageMaker.
total releases 36latest release April 23, 2021most recent commit 7 months ago
Sparksteps ⭐ 68
:star: CLI tool to launch Spark jobs on AWS EMR
total releases 20latest release December 23, 2020most recent commit 2 years ago
Mrjob ⭐ 2,584
Run MapReduce jobs on Hadoop or Amazon Web Services
dependent packages 1total releases 62latest release September 17, 2020most recent commit 6 months agopypi mrjob} Downloads
Elasticrawl ⭐ 50
Launch AWS Elastic MapReduce jobs that process Common Crawl data.
total releases 10latest release February 15, 2017most recent commit 6 years ago
Themis ⭐ 45
Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
total releases 22latest release January 11, 2017most recent commit 4 years ago
Popular Cloud Computing Categories
Amazon Web Services
Cloud Computing
Heroku
Azure
Lambda Functions
Serverless
S3
Google Cloud Platform
Openstack
Aws Lambda
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.