Awesome AWS

A curated list of awesome AWS libraries, open source repos, guides, blogs, and other resources.

Inspired by the awesome list.

The Fiery Meter of AWSome

Repo with 0100+ Stars: 🔥
Repo with 0200+ Stars: 🔥🔥
Repo with 0500+ Stars: 🔥🔥🔥
Repo with 1000+ Stars: 🔥🔥🔥🔥
Repo with 2000+ Stars: 🔥🔥🔥🔥🔥

Repos not on The Fiery Meter of AWSome can still be awesome, see A Note on Repo AWSomeness.

`awesome-aws` Python Module

The Python module awesome-aws regularly scans repos on Awesome AWS to maintain the accuracy of the Fiery Meter of AWSome.

Contributing

Contributions are welcome!

Review the Contributing Guidelines.

Also check out the Watch List.

Index

SDKs and Samples
- Android
- C++
- Clojure
- Go
- iOS
- IoT
- Java
- JavaScript
- Haskell
- Perl
- PHP
- Python
- Ruby
- Rust
- Scala
- Xamarin
- Unity
- .NET
Command Line Tools
- Universal Command Line Interface
- Windows PowerShell
IDE Toolkits
- Eclipse Toolkit
- Visual Studio Toolkit
Open Source Repos
- API Gateway
- CLI
- CloudFormation
- CloudSearch
- CloudTrail
- CloudWatch
- Code Deploy
- Code Pipeline
- Cognito
- Data Pipeline
- Device Farm
- DynamoDB
- Elastic Beanstalk
- Elastic Container Service
- Elastic File System
- Elastic MapReduce
- Elastic Search
- Elasticache
- Glacier
- Kinesis
- Lambda
- Machine Learning
- Mobile Analytics
- OpsWorks
- Redshift
- Route 53
- S3
- SNS
- SQS
- Data
- DevOps
- Security
- Accompanying
- Miscellaneous
Guides, Books, Documentation, and Training
Social
Latest KPIs and Stats
Appendix of Core Services
Contributing
Credits
Other Awesome Lists
Contact Info
License

SDKs and Samples

AWS and community SDKs with samples and docs, grouped by language.

Android SDK

C++ SDK

The C++ SDK is a labs project with limited docs and/or samples.

Clojure SDK

The Clojure SDK is a community project with limited docs and/or samples.)

Go SDK

Related Repos:

goamz/goamz 🔥🔥

iOS SDK

IoT SDK

The IoT SDK is a labs project with limited docs and/or samples.

Java SDK

JavaScript SDK

Related Repos:

Haskell SDK

Related Repos:

aristidb/aws 🔥🔥

The Haskell SDK is a community project with limited docs and/or samples.

Perl SDK

The Perl SDK is a community project.

PHP SDK

Related Repos:

Python SDK

Related Repos:

Ruby SDK

Related Repos:

Rust SDK

The Rust SDK is a community project with limited docs and/or samples.

Scala SDK

Repo

Related Repos:

The Scala SDK is a labs project with limited docs and/or samples.

Unity SDK

Xamarin SDK

The Xamarin SDK is a labs project with limited docs and/or samples.

.NET SDK

Command Line Tools

AWS and community command line tools with samples and docs.

Universal Command Line Interface

Related Repos:

Windows PowerShell

IDE Toolkits

Official IDE toolkits with samples and docs.

Eclipse Toolkit

Visual Studio Toolkit

Open Source Repos

AWS and community open source projects, grouped by service. See A Note on Repo AWSomeness for more details.

API Gateway

AWS Repos:

api-gateway-secure-pet-store 🔥🔥 - Cognito credentials through Lambda.
aws-apigateway-sdk-java - SDK for Java.
aws-apigateway-swagger-importer 🔥🔥🔥 - Tools to work with Swagger.

Community Repos:

Contribute

CLI

AWS Repos:

awscli-aliases 🔥🔥 - Repository for AWS CLI aliases.
amazon-ecs-cli 🔥🔥🔥🔥 - ECS CLI using the same Docker Compose file format and familiar Compose commands.
aws-cli 🔥🔥🔥🔥🔥 - Universal Command Line Interface.
aws-shell 🔥🔥🔥🔥🔥
awscli-cookbook - Installs the CLI tools and provides a set of LWRPs for use within chef cookbooks.
awsmobile-cli 🔥 - CLI experience for Frontend developers in the JavaScript ecosystem.

Community Repos:

achiku/jungle 🔥🔥🔥 - Operations by EC2 and ELB cli should be simpler.
dbcli/athenacli 🔥 - a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
donnemartin/saws 🔥🔥🔥🔥🔥 - A Supercharged AWS Command Line Interface.
timkay/aws 🔥🔥 - Easy command line access to Amazon EC2, S3, SQS, ELB, and SDB.
wallix/awless 🔥🔥🔥🔥🔥 - a Powerful CLI for EC2, IAM and S3 in Go.
99designs/aws-vault 🔥🔥🔥🔥🔥 - A tool for securely storing AWS credentials, written in Go.

CloudFormation

AWS Repos:

aws-cdk 🔥🔥🔥🔥🔥 - Framework for defining cloud infrastructure in code.
aws-cfn-custom-resource-examples - Custom resource examples.
aws-cfn-resource-bridge - Custom resource framework.
cfn-python-lint 🔥🔥🔥🔥 - A tool for linting/validating CloudFormation.
cfncluster-cookbook - Sample Cookbook.
cfncluster 🔥🔥🔥 - Framework that deploys and maintains HPC clusters.

Community Repos:

Appliscale/perun - A CLI tool for linting/validation and managing CloudFormation templates and stacks.
bazaarvoice/cloudformation-ruby-dsl 🔥🔥 - Ruby DSL for creating templates.
beaknit/cform 🔥 - SublimeText plugin.
cloudreach/sceptre 🔥🔥🔥🔥 - A CLI tool for automating CloudFormation.
cloudtools/troposphere 🔥🔥🔥🔥🔥 - Python library to create descriptions.
peterkh/cumulus 🔥🔥 - Manages stacks.
envato/stack_master 🔥🔥 - A CLI tool to manage CloudFormation stacks.
sparkleformation/sfn - CLI for stack management.
sparkleformation/sparkle_formation 🔥🔥 - Ruby DSL for template creation.
Stelligent/cfn_nag 🔥🔥🔥 - Linting tool for CloudFormation templates

CloudSearch

AWS Repos:

cloudsearchable - An ActiveRecord-style ORM query interface.

Community Repos:

Contribute

CloudTrail

AWS Repos:

aws-cloudtrail-processing-library - Easily consume and process log files.

Community Repos:

AppliedTrust/traildash 🔥🔥 - Slick dashboard.
GorillaStack/auto-tag 🔥🔥 - Automatically tag AWS resources on creation, for cost assignment.

CloudWatch

AWS Repos:

cloudwatch-logs-subscription-consumer 🔥🔥 - Kinesis stream reader.
ecs-cloudwatch-logs - Assets in the blog post on using Amazon ECS and Amazon CloudWatch logs.
logstash-output-cloudwatchlogs - A logstash plugin that sends logs to CloudWatch.
opsworks-cloudwatch-logs-cookbooks - OpsWorks sample cookbook.

Community Repos:

jorgebastida/awslogs 🔥🔥🔥🔥🔥 - Simple CLI for querying groups, streams and events.
newrelic-platform/newrelic_aws_cloudwatch_plugin 🔥 - New Relic plugin.

Code Deploy

AWS Repos:

aws-codedeploy-agent 🔥🔥 - Sample agent.
aws-codedeploy-plugin 🔥 - Jenkins plugin.
aws-codedeploy-samples 🔥🔥🔥 - Samples and template scenarios.

Community Repos:

Contribute

Code Pipeline

AWS Repos:

aws-codepipeline-custom-job-worker - Develop your own job worker when creating a custom action.
aws-codepipeline-jenkins-aws-codedeploy_linux - Four-stage pipeline for Linux.
aws-codepipeline-plugin-for-jenkins - Jenkins plugin.
aws-codepipeline-s3-aws-codedeploy_linux 🔥 - Simple pipeline for Linux.
AWSCodePipeline-Jenkins-AWSCodeDeploy_Windows - Four-stage pipeline for Windows.
AWSCodePipeline-S3-AWSCodeDeploy_Windows - Simple pipeline for Windows.

Community Repos:

Contribute

Cognito

AWS Repos:

amazon-cognito-android - Sync SDK for Android.
amazon-cognito-developer-authentication-sample - Authentication sample.
amazon-cognito-dotnet - Sync SDK for .NET.
amazon-cognito-ios - Sync SDK for iOS.
amazon-cognito-js 🔥🔥 - Sync SDK for JavaScript.
amazon-cognito-streams-sample - Consuming Streams sample.
cognito-sample-nodejs 🔥 - Sample App for Node.js.

Community Repos:

capeless/warrant 🔥🔥 - Python library for using Cognito.
rahulpsd18/cognito-backup-restore 🔥 - Tool for backing up and restoring Cognito user pools.

Data Pipeline

AWS Repos:

data-pipeline-samples 🔥🔥 - Sample pipelines.

Community Repos:

Contribute

Device Farm

AWS Repos:

aws-device-farm-appium-tests-for-sample-app - Appium TestNG Android tests.
aws-device-farm-calabash-tests-for-sample-app - Calabash Android tests.
aws-device-farm-gradle-plugin - Gradle plugin.
aws-device-farm-jenkins-plugin - Jenkins plugin.
aws-device-farm-sample-app-for-android 🔥 - Sample Android app.

Community Repos:

Contribute

DynamoDB

AWS Repos:

aws-dotnet-session-provider - A session state provider for ASP.NET apps.
aws-dotnet-trace-listener - A trace listener for System.Diagnostics that can be used to log events.
aws-dynamodb-encryption-java 🔥 - Encryption Client for Java.
aws-dynamodb-examples 🔥🔥 - Samples using the Java SDK.
aws-dynamodb-mars-json-demo - Stores and indexes NASA JPL Mars images.
aws-dynamodb-session-tomcat - Session store for Apache Tomcat.
aws-sessionstore-dynamodb-ruby - Handles sessions for Ruby web apps.
dynamodb-cross-region-library 🔥🔥 - Cross-region replication.
dynamodb-geo 🔥🔥 - Library to create and query geospatial data.
dynamodb-import-export-tool - Import and export examples.
dynamodb-online-index-violation-detector - Finds violations on an online GSI's hash key and range key.
dynamodb-streams-kinesis-adapter - Kinesis interface to consume and process data from a DynamoDB stream.
dynamodb-tictactoe-example-app - Lightweight python app.
dynamodb-titan-storage-backend 🔥🔥 - Storage Backend for Titan.
dynamodb-transactions 🔥🔥 - Performs atomic writes and isolated reads across multiple items and tables.
logstash-input-dynamodb 🔥 - Logstash input plugin.

Community Repos:

channl/dynamodb-lambda-autoscale 🔥🔥 - Autoscale DynamoDB provisioned capacity using Lambda.
lyft/confidant 🔥🔥🔥🔥 - Stores secrets, encrypted at rest.
sebdah/dynamic-dynamodb 🔥🔥🔥 - Provides auto-scaling.

Elastic Beanstalk

AWS Repos:

aws-eb-glassfish-dockerfiles - GlassFish docker files.
aws-eb-python-dockerfiles - Python docker files.
eb-demo-php-simple-app 🔥 - Simple PHP app.
eb-docker-multiple-ports - Simple Node.js and Tomcat apps using Docker images.
eb-docker-nginx-proxy 🔥 - Simple PHP app using the PHP-FPM and Nginx Docker images.
eb-docker-virtual-hosting - Simple PHP, Tomcat, and Nginx applications using Docker images.
eb-node-express-sample 🔥🔥 - Sample express app.
eb-node-express-signup - Express framework and Bootstrap Node.js sample app.
eb-node-express - Sample app referenced in the Developer Guide.
eb-py-flask-signup-worker - Python app that illustrates worker roles.
eb-py-flask-signup 🔥🔥 - Python signup form app with Flask and Bootstrap.
eb-python-flask - Simple Python and Flask app.
eb-wif-sample - Sample login app with Web Identity Federation.

Community Repos:

alienfast/elastic-beanstalk 🔥 - Gem with rake configuration and deployment for rails apps.
ThoughtWorksStudios/eb_deployer 🔥🔥 - Blue-green deployment automation.

Elastic Compute Cloud

AWS Repos:

Contribute

Community Repos:

alestic/ec2-consistent-snapshot 🔥🔥 - Initiate consistent EBS snapshots in EC2.
ConradIrwin/aws-name-server 🔥🔥🔥 - DNS server that lets you look up instances by name.
cristim/autospotting 🔥🔥🔥🔥 - Automatically rolling-replace on-demand EC2 instances in AutoScaling groups with compatible spot instances.
evannuil/aws-snapshot-tool 🔥🔥 - Automates EBS snapshots and rotation.
kelseyhightower/kubernetes-the-hard-way 🔥🔥🔥🔥🔥 - Bootstrap Kubernetes the hard way on EC2. No scripts.
mirakui/ec2ssh 🔥🔥 - SSH config manager.
openebs/openebs 🔥🔥🔥🔥🔥 - Containerized block storage QoS SLAs, tiering and replica policies across AZs and environments, and predictable and scalable performance.
skavanagh/EC2Box 🔥🔥 - A web-based SSH console to manage multiple instances simultaneously.
wbailey/claws 🔥 - CLI-driven console with capistrano integration.

Elastic Container Service

AWS Repos:

amazon-ecs-agent 🔥🔥🔥🔥 - Agent that runs on and starts containers.
amazon-ecs-amazon-efs - Persists Data from containers.
amazon-ecs-init 🔥 - RPM developed to support the Amazon ECS Container Agent.
blox 🔥🔥🔥 - Open source tools for building custom schedulers on ECS.
ecs-blue-green-deployment 🔥🔥 - Blue-green deployment on ECS.
ecs-cloudwatch-logs - Assets from the blog using Amazon ECS and Amazon CloudWatch logs.
ecs-demo-php-simple-app 🔥 - Simple PHP app.
ecs-mesos-scheduler-driver 🔥 - Integrates Apache Mesos.
ecs-refarch-continuous-deployment 🔥🔥🔥 - Reference Architecture for continuous deployment to ECS using CodePipeline.
ecs-task-kite - Simple ambassador container for inter-task communication.
lambda-ecs-worker-pattern 🔥🔥 - Extends Lambda using SQS and ECS.
py-flask-signup-docker - Python sample app.
service-discovery-ecs-consul 🔥 - Assets from the blog Service Discovery via Consul with Amazon ECS.

Community Repos:

Lumoslabs/broadside - Command line tool for deploying revisions of containerized applications.
Stelligent/mu 🔥🔥🔥 - Command line tool to simplify ECS deployments via CodeBuild and CodePipeline.

Elastic File System

AWS Repos:

amazon-ecs-amazon-efs - Persist data from ECS.

Community Repos:

Contribute

Elastic MapReduce

AWS Repos:

emr-bootstrap-actions 🔥🔥🔥 - Sample bootstrap actions.
emr-sample-apps - Sample apps.

Community Repos:

Yelp/mrjob 🔥🔥🔥🔥🔥 - Run MapReduce jobs on Hadoop or EMR.

Elastic Search

AWS Repos:

logstash-output-amazon_es 🔥🔥 - Logstash output plugin to sign and export events.
opsworks-elasticsearch-cookbook - OpsWorks Elasticsearch sample cookbook.

Community Repos:

elastic/elasticsearch-cloud-aws 🔥🔥🔥 - Plugin for Elasticsearch.

Elasticache

AWS Repos:

aws-elasticache-cluster-client-libmemcached - Libmemcached library support.
aws-elasticache-cluster-client-memcached-for-java - Client for Java.
aws-elasticache-cluster-client-memcached-for-php - Enhanced PHP library connecting to ElastiCache.
elasticache-cluster-config-net - Config object for Enyim's MemcachedClient to enable auto discovery.

Community Repos:

Contribute

Glacier

Community Repos:

vsespb/mt-aws-glacier 🔥🔥🔥 - Perl Multithreaded Multipart sync to Glacier.

Kinesis

AWS Repos:

amazon-kinesis-aggregators 🔥 - Provides a simple way to create real time aggregations.
amazon-kinesis-client-net - Client Library for .NET.
amazon-kinesis-client-nodejs 🔥🔥 - Client Library for Node.js.
amazon-kinesis-client-python 🔥🔥 - Client Library for Python.
amazon-kinesis-client-ruby 🔥 - Client Library for Ruby.
amazon-kinesis-client 🔥🔥🔥 Client library for Amazon Kinesis.
amazon-kinesis-connectors 🔥🔥 - Libary to integrate with other AWS and non-AWS services.
amazon-kinesis-data-visualization-sample 🔥 - Sample data visualization app.
amazon-kinesis-learning - Learning Kinesis Development.
amazon-kinesis-producer 🔥🔥 - Producer Library.
amazon-kinesis-scaling-utils 🔥🔥 - Provides the ability to scale streams.
aws-fluent-plugin-kinesis 🔥🔥 - Fluent Plugin.
dynamodb-streams-kinesis-adapter - DynamoDB Streams Adapter.
kinesis-log4j-appender - Log4J Appender.
kinesis-poster-worker - Simple multi-threaded Python Poster and Worker.
kinesis-storm-spout 🔥 - Spout for Storm.
mqtt-kinesis-bridge - Simple MQTT bridge in Python.

Community Repos:

Contribute

Lambda

AWS Repos:

amazon-elasticsearch-lambda-samples 🔥🔥 - Data ingestion for Elasticsearch from S3 and Kinesis.
awslabs/aws-sam-local 🔥🔥🔥🔥🔥 - CLI tool for local development and testing of Serverless applications.
aws-lambda-go 🔥🔥🔥🔥🔥 - Libraries, samples and tools to help Go developers develop Lambda functions.
aws-lambda-java-libs 🔥🔥 - Official mirror for interface definitions and helper classes.
aws-lambda-redshift-loader 🔥🔥🔥 - Redshift loader.
chalice 🔥🔥🔥🔥🔥 - Python Serverless Microframework.
create-thumbnails-lambda - Uses the grunt-aws-lambda plugin to help you develop and test.
lambda-ecs-worker-pattern 🔥🔥 - Extends Lambda using SQS and ECS.
lambda-refarch-fileprocessing 🔥🔥 - Reference Architecture for Real-time File Processing.
lambda-refarch-iotbackend 🔥🔥 - Reference Architecture for creating an IoT Backend.
lambda-refarch-mobilebackend 🔥🔥🔥 - Reference Architecture for creating a Mobile Backend.
lambda-refarch-webapp 🔥🔥🔥🔥 - Reference Architecture for creating a Web Application.

Community Repos:

alestic/lambdash 🔥🔥🔥 - Lambda shell - Run sh commands inside the Lambda environment.
Alephbet/gimel 🔥🔥 - Run your own A/B testing backend using Lambda.
apex/apex - Minimal AWS Lambda function manager with Go support.
claudiajs/claudia 🔥🔥🔥🔥🔥 - Deploy Node.js projects to Lambda and API Gateway easily.
cloudnative/lambda-chat 🔥🔥 - A chat application without servers.
danilop/LambdAuth 🔥🔥🔥🔥 - Sample authentication service.
eawsy/aws-lambda-go 🔥🔥🔥 - A fast and clean way to execute Go on Lambda.
garnaat/kappa 🔥🔥🔥 - Kappa is a CLI tool that makes it easier to deploy, update, and test functions for AWS Lambda.
goadapp/goad 🔥🔥🔥🔥 - Lambda powered, highly distributed, load testing tool.
graphcool/chromeless 🔥🔥🔥🔥🔥 - Automate Chrome through Lambda.
grycap/scar 🔥🔥🔥 - Transparently execute containers out of Docker images in AWS Lambda.
jeremydaly/lambda-api 🔥🔥🔥 - Lightweight web framework for your serverless applications.
jimpick/lambda-comments 🔥🔥🔥 - Blog commenting system built with Lambda.
jorgebastida/gordon 🔥🔥🔥🔥🔥 - λ Gordon is a tool to create, wire and deploy AWS Lambdas using CloudFormation.
ks888/LambStatus 🔥🔥🔥🔥 - A status page system inspired by StatusPage.io, built on AWS Lambda.
kubek2k/lambdoku 🔥🔥🔥 - Heroku-like experience when using Lambda.
lambci/lambci 🔥🔥🔥🔥🔥 - A continuous integration system built on Lambda.
littlstar/s3-lambda 🔥🔥🔥🔥 - Lambda functions over S3 objects with concurrency control (each, map, reduce, filter).
mentum/lambdaws 🔥🔥🔥🔥 - Deploy, run and get results in a breeze.
Miserlou/Zappa 🔥🔥🔥🔥🔥 - Serverless WSGI Python Web Apps with AWS Lambda + API Gateway.
nficano/python-lambda 🔥🔥🔥🔥 - A toolkit for developing and deploying serverless Python code in Lambda.
serverless/serverless 🔥🔥🔥🔥🔥 The Serverless Application Framework (formerly JAWS).
Tim-B/grunt-aws-lambda 🔥🔥 - Grunt plugin.
trek10inc/aws-lambda-debugger 🔥🔥 - Remote debugging tool for Lambda functions running on Node 6.10

Machine Learning

AWS Repos:

machine-learning-samples 🔥🔥🔥 - Sample apps.

Community Repos:

Contribute

Mobile Analytics

AWS Repos:

aws-sdk-mobile-analytics-js - JavaScript SDK.

Community Repos:

Contribute

OpsWorks

AWS Repos:

opsworks-attribute-customization - Attribute customization example.
opsworks-capistrano - Capistrano with instances.
opsworks-cloudwatch-logs-cookbooks - CloudWatch sample cookbook.
opsworks-cookbooks 🔥🔥🔥🔥 - Chef Cookbooks.
opsworks-demo-php-photo-share-app - Simple PHP photo share app.
opsworks-demo-php-simple-app - Simple PHP app.
opsworks-demo-rails-photo-share-app - A sample Rails app.
opsworks-elasticsearch-cookbook - Elasticsearch sample cookbook.
opsworks-example-cookbooks - Cookbooks used with the sample apps.
opsworks-first-cookbook - Cookbook used to demonstrate simple recipes.
opsworks-windows-demo- - A sample Node.JS app.
opsworks-windows-demo-cookbooks - Cookbooks for Windows.
todo-sample-app-cookbooks - Custom cookbooks associated with the todo-sample-app.

Community Repos:

Contribute

Redshift

AWS Repos:

aws-lambda-redshift-loader 🔥🔥🔥 - Lambda database loader.
amazon-redshift-utils 🔥🔥🔥🔥🔥 - Applies optimal Column Encoding to existing Tables.

Community Repos:

Lumoslabs/aleph - A full featured web application for writing and running Redshift queries. Supports revision tracking of queries and has basic visualization support.
getredash/redash 🔥🔥🔥🔥🔥 - A web application that allows to easily query an existing database, share the dataset and visualize it in different ways. Initially was developed to work with Redshift, and has great support for it.
everythingMe/redshift_console - A simple tool to monitor and manage a Redshift cluster. The first release has basic tools to monitor running queries, WLM queue and your tables/schemas.

Route 53

AWS Repos:

route53-infima 🔥🔥 - Manages service-level fault isolation.

Community Repos:

barnybug/cli53 🔥🔥🔥🔥 - cli53 is a command line tool for Amazon Route 53 which provides import and export from BIND format and simple command line management of Route 53 domains.
winebarrel/roadworker 🔥🔥 - Roadworker is a tool to manage Route53. It defines the state of Route53 using DSL, and updates Route53 according to DSL.

S3

Community Repos:

anomalizer/ngx_aws_auth 🔥🔥 - Implements proxying of authenticated requests.
bloomreach/s4cmd 🔥🔥🔥🔥 - S3 command line tool, faster than S3cmd for large files.
CulturalMe/meteor-slingshot 🔥🔥🔥 - Upload files in meteor.
danilop/yas3fs 🔥🔥🔥 - Yet Another S3-backed File System, inspired by s3fs.
grippy/node-s3 - Node.js app to manage buckets.
jubos/fake-s3 🔥🔥🔥🔥🔥 - Lightweight S3 clone that simulates most commands.
kahing/goofys 🔥🔥🔥🔥🔥 - a Filey System for Amazon S3 written in Go.
littlstar/s3renity 🔥🔥🔥🔥 - Batch functions with concurrency control (each, map, reduce, filter, join)
marcel/aws-s3 🔥🔥🔥 - Ruby implementation of Amazon's S3 REST API.
mardix/flask-cloudy 🔥🔥 - Flask extension.
MathieuLoutre/grunt-aws-s3 🔥🔥 - Grunt plugin.
mickael-kerjean/filestash 🔥🔥🔥🔥🔥 - A modern web client for S3.
minio/mc 🔥🔥🔥🔥 - Minio Client for filesystem and cloud storage.
minio/minio 🔥🔥🔥🔥🔥 - Object storage server compatible with S3.
mumrah/s3-multipart 🔥 - Parallel upload/download to S3 via Python.
ncw/rclone 🔥🔥🔥🔥🔥 - Rsync for various cloud storage providers such as S3.
owocki/s3_disk_util 🔥 - S3 Disk usage (du) utility.
peak/s5cmd 🔥🔥🔥 - Fast S3 and local filesystem execution tool with wildcard and batch command support.
pgherveou/gulp-awspublish 🔥🔥 - Gulp plugin.
rlmcpherson/s3gof3r 🔥🔥🔥🔥 - Fast, concurrent, streaming access, includes a CLI.
s3git/s3git 🔥🔥🔥🔥 - CLI tool that allows you to create a distributed, decentralized and versioned repository.
s3fs-fuse/s3fs-fuse 🔥🔥🔥🔥🔥 - Allows Linux and Mac OS X to mount an S3 bucket via FUSE.
s3tools/s3cmd 🔥🔥🔥🔥🔥 - CLI for managing S3 and CloudFront.
schickling/git-s3 🔥🔥 - Deploy your git repo to a bucket.
sorentwo/carrierwave-aws 🔥🔥 - Adapter for CarrierWave.
spring-projects/aws-maven 🔥🔥 - Maven Wagon for S3.
tongwang/s3fs-c 🔥 - Mounts buckets for use on a local file system.
mishudark/s3-parallel-put 🔥🔥 - CLI that supports parallel uploads.
waynehoover/s3_direct_upload 🔥🔥🔥 - Direct Upload to Amazon S3 With CORS
weavejester/clj-aws-s3 🔥 - Client library for Clojure.

SES

Community Repos:

drewblas/aws-ses 🔥🔥🔥 - Provides an easy ruby DSL & interface.
microapps/MoonMail 🔥🔥🔥🔥 - Shoot billions of emails using SES and Lambda.

Simple Workflow

AWS Repos:

aws-flow-ruby 🔥 - Creates background jobs and multistep workflows.
aws-flow-ruby-samples - AWS Flow Framework for Ruby samples.
aws-flow-ruby-opsworks-helloworld - Hello World sample.

Community Repos:

Contribute

SimpleDB

Community Repos:

rjrodger/simpledb 🔥 - Node.js library.

SNS

AWS Repos:

aws-php-sns-message-validator 🔥 - Message validation for PHP.

Community Repos:

Contribute

SQS

AWS Repos:

amazon-sqs-java-messaging-lib 🔥 - Holds the Java Message Service to communicate with SQS.

Community Repos:

phstc/shoryuken 🔥🔥🔥🔥 - A super efficient SQS thread based message processor for Ruby.

Data

AWS Repos:

aws-data-wrangler 🔥🔥🔥🔥 - Connects Pandas DataFrames and AWS data related services.

Community Repos:

donnemartin/data-science-ipython-notebooks 🔥🔥🔥🔥🔥 - Big data/data science notebooks.
everpeace/vagrant-mesos 🔥🔥 - Spin up your Mesos Cluster with Vagrant.
jhorey/ferry 🔥🔥 - Define, run, and deploy big data apps using Docker.
nathanmarz/storm-deploy 🔥🔥🔥 - One click deploy for Storm clusters.

DevOps

Community Repos:

cloud-custodian/cloud-custodian 🔥🔥🔥🔥🔥 - Rules engine for management, DSL in yaml for query, filter, and actions on resources.
chef-cookbooks/aws 🔥🔥 - Development repository for aws Chef cookbook.
colinbjohnson/aws-missing-tools 🔥🔥🔥🔥 - Tools for managing resources including EC2, EBS, RDS and Route53.
k1LoW/awspec 🔥🔥🔥🔥 - RSpec tests your resources.
mitchellh/vagrant-aws 🔥🔥🔥🔥🔥 - Use Vagrant to manage your EC2 and VPC instances.
NixOS/nixops 🔥🔥🔥 - Use NixOS to provision EC2 instances, S3 buckets, and other resources.

Security

AWS Repos:

aws-sha256-agentcs - SHA256 Agent Compatibility Ccanner.
aws-tvm-anonymous - Token Vending Machine for Anonymous Registration.
aws-tvm-identity - Token Vending Machine for Identity Registration.
s2n 🔥🔥🔥🔥🔥 - An implementation of the TLS/SSL protocols.

Community Repos:

AdRoll/hologram 🔥🔥🔥 - Easy, painless credentials on developer laptops.
alex/letsencrypt-aws 🔥🔥🔥 - Automatically provision and update certificates.
bridgecrewio/checkov 🔥🔥🔥🔥🔥 - Terraform static analysis, verifies security best practices.
cloudsploit/scans 🔥🔥🔥🔥 - Detects security risks.
iSECPartners/Scout2 🔥🔥🔥🔥 - Security auditing tool.
jordanpotti/AWSBucketDump 🔥🔥🔥🔥 - Security Tool to Look For Interesting Files in S3 Buckets.
Netflix/bless 🔥🔥🔥🔥🔥 - SSH Certificate Authority that runs as a Lambda function.
Netflix/security_monkey 🔥🔥🔥🔥🔥 - Monitors policy changes and alerts on insecure configurations.
RiotGames/cloud-inquisitor 🔥🔥 - Tool to enforce ownership and data security.
salesforce/policy_sentry 🔥🔥🔥🔥 - IAM Least Privilege Policy Generator.
sebsto/AWSVPN 🔥 - Start a private VPN server in the cloud.
trailofbits/algo 🔥🔥🔥🔥🔥 - Set up a personal IPSEC VPN on EC2 and other cloud services.
ttlequals0/autovpn 🔥🔥🔥🔥 - Create On Demand Disposable OpenVPN Endpoints.

Accompanying Repos

AWS Repos:

Repos Accompanying Blogs, Training Events, and Conferences.

aws-arch-backoff-simulator 🔥 - Jitter and backoff Simulator for AWS architecture blog.
aws-big-data-blog 🔥🔥🔥 - Samples from the AWS Big Data Blog.
aws-demo-php-simple-app - PHP apps from the AWS Blogs.
aws-mobile-sample-wif - Samples from the AWS Mobile SDK blog.
aws-mobile-self-paced-labs-samples - Android Snake Game from a self-paced lab.
aws-quickstart - Official repository for AWS Quick Start.
aws-spot-labs 🔥🔥🔥 - Best practices using AWS Spot Instances.
aws-training-demo 🔥 - Demos from the Technical Trainers community.
java-meme-generator-sample - Meme generation app from re:Invent 2012.
railsconf2013-tech-demo 🔥 - Seahorse demo from RailsConf 2013.
reinvent2013-js-blog-demo - Demo blogging app from re:Invent 2013.
reinvent2013-mobile-photo-share - Mobile photo share app from re:Invent 2014.
reinvent2014-scalable-site-management - Scalable site management sample from re:Invent 2014.
reinvent2015-dev309 - Large Scale Metrics Analysis from re:Invent 2015.
timely-security-analytics - Security analytics sample from 2015 re:Invent 2015.
todo-sample-app - Simple "Todo" app from RailsConf 2014.

Community Repos:

startup-class/setup 🔥🔥 - EC2 setup files for Startup Engineering MOOC.

Miscellaneous Repos

AWS Repos:

amediamanager - Media manager.
aws-hal-client-java - Java client for the Hypertext Application Language.
aws-model-validators - Tools for validating the AWS service JSON model files.
aws-sdk-js-sample-video-transcoder - Sample cross-platform video transcoder app.
simplebeerservice 🔥🔥 - Cloud-connected kegerator that streams live sensor data to AWS.

Community Repos:

bcoe/thumbd 🔥🔥 - Node.js/ImageMagick-based image thumbnailing service.
cdkpatterns/serverless 🔥🔥🔥🔥 - Deployable serverless architecture patterns built in AWS CDK.
Comcast/cmb 🔥🔥 - Highly available, horizontally scalable queuing and notification service.
convox/rack 🔥🔥🔥🔥 - Open-source PaaS on AWS.
devops-israel/aws-inventory 🔥🔥 - Display all your AWS resources on a single web page.
donnemartin/dev-setup 🔥🔥🔥🔥 - Mac setup of various developer tools and AWS services.
dtan4/terraforming 🔥🔥🔥🔥🔥 - Export existing resources to Terraform style (tf, tfstate).
segmentio/stack 🔥🔥🔥🔥🔥 - A set of Terraform modules for configuring production infrastructure.
j2labs/microarmy - Deploy micro instances to launch a coordinated siege.
jpillora/grunt-aws 🔥 - Grunt interface into the Node.JS SDK.
jvehent/haproxy-aws 🔥🔥 - Documentation on building a HTTPS stack with HAProxy.
localstack/localstack 🔥🔥🔥🔥🔥 - A fully functional local AWS cloud stack. Develop and test your cloud apps offline!
meducation/propono 🔥🔥 - Easy-to-use pub/sub in Ruby.
mozilla/awsbox 🔥🔥🔥 - A featherweight PaaS on top of EC2 for deploying node apps.
Netflix/aminator 🔥🔥🔥 - A tool for creating EBS AMIs.
Netflix/archaius 🔥🔥🔥🔥🔥 - Library for configuration management API.
Netflix/asgard 🔥🔥🔥🔥🔥 - Web interface for application deployments and cloud management.
Netflix/aws-autoscaling 🔥🔥 - Tools for using auto scaling and documentation best practices.
Netflix/chaosmonkey 🔥🔥🔥🔥🔥 - Resiliency tool that helps applications tolerate random instance failures.
Netflix/eureka 🔥🔥🔥🔥🔥 - Service registry for resilient mid-tier load balancing and failover.
Netflix/EVCache 🔥🔥🔥🔥 - A distributed in-memory data store.
Netflix/Fenzo 🔥🔥🔥 - Extensible Scheduler for Mesos Frameworks.
Netflix/ice 🔥🔥🔥🔥🔥 - Usage and cost monitoring tool.
Netflix/ribbon 🔥🔥🔥🔥🔥 - Remote procedure call library with built in software load balancers.
Netflix/SimianArmy 🔥🔥🔥🔥🔥 - Tools to keep your cloud operating in top form.
Netflix/zuul 🔥🔥🔥🔥🔥 - Edge service that provides dynamic routing, monitoring, resiliency, security, and more.
niftylettuce/gulp-aws-splash 🔥🔥 - Open-source LaunchRock alternative. Build beautiful splash pages.
puppetlabs/puppetlabs-aws 🔥 - Puppet module for managing resources to build out infrastructure.
mhart/react-server-routing-example 🔥🔥 - Sample universal client/server routing and data in React.
Similarweb/finala 🔥🔥🔥 - A resource cloud scanner that analyzes and reports wasteful and unused resources to cut unwanted expenses.
snowplow/snowplow 🔥🔥🔥🔥🔥 - Enterprise-strength web, mobile and event analytics, powered by Hadoop, Kafka, Kinesis, Redshift and Elasticsearch.
Spinnaker/spinnaker 🔥🔥🔥🔥🔥 - Successor to asgard supporting pipelines and more.
spulec/moto 🔥🔥🔥🔥🔥 - Allows your python tests to easily mock out the boto library.

Guides, Books, Documentation, and Training

How-to's, training, whitepapers, docs, and case studies.

Getting Started Guides

AWS Guides:

Community Guides:

Contribute

General Guides

AWS Guides:

Community Guides:

Open Guide to AWS 🔥🔥🔥🔥🔥

Books

Amazon Web Services in Action Manning or Amazon.com
AWS Lambda in Action Manning or Amazon.com - Code Repo 🔥🔥

Whitepapers

Documentation

Training

Case Studies: Powered by AWS

Social

Blogs, discussion groups, conferences, and social media.

Blogs

AWS Blogs:

Official Blog
- Brasil
- China
- Germany
- Japan
- Korea
DevOps
Architecture
Big Data
Compute
Mobile
Messaging
Java
PHP
Ruby
.NET
Security
Startup
Partner Network
SAP

Community Blogs:

All Things Distributed - Werner Vogels, AWS CTO.
Things I Like... - Jeff Barr, AWS Chief Evangelist.
Netflix Tech Blog
A Curated List of Engineering Blogs
AWS Geek

Twitter Influencers

AWS Tweeps:

@awscloud - Official Twitter feed.
@AWS_Partners
@AWSIdentity
@AWSMarketplace
@AWSreInvent - Official Twitter account for re:Invent.
@AWSStartups
@ajassy - Andy Jassy: Senior Vice-President.
@Ianmmmm - Ian Massingham - Technical Evangelist.
@jeffbarr - Jeff Barr: Chief Evangelist.
@mndoci - Deepak Singh: GM EC2.
@mza - Matt Wood: Product Strategy.
@Werner - Werner Vogels: CTO.
Community heroes, Evangelists, etc

Community Tweeps:

Facebook Pages

AWS Pages:

amazonwebservices - Official Facebook page.
awsreinvent - Official Facebook page for re:Invent.

Community Pages:

Contribute

YouTube Channels

AWS Channels:

Community Channels:

LinkedIn Groups

AWS Page:

Amazon Web Services

Community Groups:

Subreddits

Conferences

AWS Conferences:

re:Invent - Annual user conference. The event features keynote announcements, training and certification opportunities, over 250 technical sessions, a partner expo, after hours activities, and more.
Summits - Global one-day events that are designed to educate new customers about the AWS platform and offer existing customers deep technical content to be more successful with AWS.
AWSome Day - Global one-day events are delivered by AWS Education's technical instructors and are ideal for IT pros, developers and technical managers who would like to learn about how to get started in the AWS Cloud.

Community Conferences:

Contribute

Latest KPIs and Stats

Latest key performance indicators and other interesting stats.

Over 1 million customers active in past 30 days.¹
$7B+ annual revenue run-rate business.¹
- 81% year over year revenue growth.¹
EC2 usage up 95% year over year.¹
S3 data transfer up 120% year over year.¹
- S3 holds trillions of objects and regularly peaks at 1.5 million requests per second.²
Database services usage up 127% year over year.¹
- $1B annual revenue run-rate business.¹
2 million new EBS volumes created per day.⁴
Customers have launched more than 15 million Hadoop clusters.³
102Tbps network capacity into a data center.²
500+ major new features and services launched since 2014.¹
All 14 other cloud providers combined have 1/5th the aggregate capacity of AWS.²
Every day, AWS adds enough new server capacity to support all of Amazon's global infrastructure when it was a $7B annual revenue enterprise (in 2004).²

Appendix of Core Services

Appendix of official services, grouped by service category.

Services in Plain English

Amazon Web Services in Plain English - Entertaining and educational, a community contribution.

Compute Services

Auto Scaling - Launches or terminates EC2 instances based on policies, schedules, and health checks.
Batch - Run batch jobs at scale.
Blox - Open source projects for building custom schedulers on ECS.
EC2 Container Service (ECS) - Supports Docker containers on EC2 instances.
EC2 Systems Manager - Easily configure and manage EC2 and on-premises systems.
Elastic Beanstalk - Provides quick deployment and management of applications in the cloud.
Elastic Compute Cloud (EC2) - Provides scalable virtual private servers using Xen.
Elastic GPUs - Attach low-cost GPUs to EC2 instances for graphics acceleration.
Elastic Load Balancing (ELB) - Automatically distributes incoming traffic across multiple EC2 instances.
Lambda - Runs code in response to events and automatically manages EC2 instances.
Lightsail - Launch and manage simple virtual private servers.
Virtual Private Cloud (VPC) - Creates a logically isolated set of EC2 instances which can be connected to an existing network using a VPN connection.

Networking Services

Direct Connect - Provides dedicated connections to AWS for faster and cheaper data throughput.
Elastic Load Balancing (ELB) - Automatically distributes incoming traffic across multiple EC2 instances.
Route 53 - Provides a highly available and scalable Domain Name System (DNS) web service.
Virtual Private Cloud (VPC) - Creates a logically isolated set of EC2 instances which can be connected to an existing network using a VPN connection.

Enterprise Applications

WorkDocs - Provides a fully managed, secure enterprise storage and sharing service.
WorkMail - Provides managed email and calendaring service.
WorkSpaces - Provides a cloud-based desktop experience to end-users.
Workspaces Application Manager (WAM) - Simplifies deployment and management of WorkSpaces.

Analytics Services

Athena - Query data on S3 instantly.
Data Pipeline - Provides workload management by processing and moving data between services.
Elastic MapReduce (EMR) - Hosts a Hadoop and Spark framework running on EC2 and S3.
Elasticsearch Service (ES) - Managed Elasticsearch, a popular open-source search and analytics engine.
Glue - Prepare and load data to data stores.
Kinesis - Provides real-time data processing over large, distributed data streams.
Kinesis Analytics - Write standard SQL queries on streaming data without having to learn any new programming skills.
Kinesis Firehose - Captures and automatically loads streaming data into S3 and Redshift.
Quicksight - Provides cloud-powered business intelligence for 1/10th the cost of traditional BI solutions.
Redshift - Provides petabyte-scale data warehousing with columnar storage and multi-node compute.

Artificial Intelligence

Lex - Build conversational interfaces through voice or text.
Machine Learning - Provides managed machine learning technology.
Polly - Turn text into lifelike speech.
Rekognition - Deep learning-based image analysis.

Management Tools

CloudFormation - Provides a file-based interface for provisioning other resources.
CloudTrail - Provides logs of all activity.
CloudWatch - Provides monitoring for AWS cloud resources and applications, starting with EC2.
Command Line Interface (CLI) - Provides a CLI to manage all services.
Config - Provides a detailed view of all resources.
Management Console (AWS Console) - A web-based interface to manage all services.
OpsWorks - Provides configuration of EC2 services using Chef.
Personal Health Dashboard - Your personalized view of service health.
Service Catalog - Service Catalog allows IT administrators to create, manage, and distribute portfolios of approved products to end users, who can then access the products they need in a personalized portal.

Security and Identity Services

Certificate Manager - Lets you easily provision, manage, and deploy SSL/TLS certificates for use with AWS services.
CloudHSM - Helps meet corporate, contractual and regulatory compliance requirements for data security by using dedicated Hardware Security Module (HSM) appliances within the AWS cloud.
Directory Service - A managed service that allows you to connect your resources with an existing on-premises Microsoft Active Directory or to set up a new, stand-alone directory in the AWS Cloud.
Identity and Access Management (IAM) - An implicit service, the authentication infrastructure used to authenticate access to the various services.
Inspector - An automated security assessment service that helps improve the security and compliance of applications deployed on AWS.
Key Management Service (KMS) - A managed service that makes it easy for you to create and control the encryption keys used to encrypt your data.
Shield - Managed DDoS Protection.
WAF - A web application firewall service that monitors and manages CloudFront distributions.

Internet of Things Service

IoT - Enables secure, bi-directional communication between internet-connected things (such as sensors, actuators, embedded devices, or smart appliances) and the AWS cloud over MQTT and HTTP.

Mobile Services

API Gateway - Service for publishing, maintaining and securing web service APIs.
Cognito - Provides user identity and data synchronization.
Device Farm - App testing service for iOS, Android and Fire OS apps on physical devices.
Mobile Analytics - Service for collecting, visualizing, and understanding app usage data.
Mobile Hub - Provides an integrated console that helps you build, test, and monitor your mobile apps.
Pinpoint - Targeted push notifications for mobile apps.
Simple Notification Service (SNS) - Provides a hosted multi-protocol "push" messaging for applications.

Storage and Content Delivery Services

CloudFront - A content delivery network (CDN) for distributing objects to locations near the requester.
Elastic Block Store (EBS) - Provides persistent block-level storage volumes for EC2.
Elastic File System (EFS) - A file storage service for EC2 instances.
Glacier - Provides a low-cost, long-term storage option, intended for archiving data.
Import/Export - Accelerates moving large amounts of data into and out of AWS using portable storage devices for transport.
Simple Storage Service (S3) - Provides Web Service based storage.
Storage Gateway - An iSCSI block storage virtual appliance with cloud-based backup.

Databases

Aurora - MySQL and PostgreSQL compatible relational database with improved performance.
DynamoDB - Provides a scalable, low-latency NoSQL online Database Service backed by SSDs.
ElastiCache - Provides in-memory caching for web apps (Memcached, Redis).
Redshift - Provides petabyte-scale data warehousing with columnar storage and multi-node compute.
Relational Database Service (RDS) - Provides a scalable database server with MySQL, Oracle, SQL Server, PostgreSQL, and MariaDB support.
Schema Conversion Tool - App that helps you convert your database schema from an Oracle or Microsoft SQL Server database, to an RDS MySQL DB instance or an Aurora DB cluster.
SimpleDB - Allows developers to run queries on structured data.

Application Services

API Gateway - Service for publishing, maintaining and securing web service APIs.
AppStream - Flexible, low-latency streaming service for apps and games.
CloudSearch - Provides basic full-text search and indexing of textual content.
DevPay - Provides billing and account management.
Elastic Transcoder (ETS) - Provides video transcoding of S3 hosted videos.
Flexible Payments Service (FPS) - Provides an interface for micropayments.
Simple Email Service (SES) - Provides bulk and transactional email sending.
Simple Notification Service (SNS) - Provides a hosted multi-protocol "push" messaging for applications.
Simple Queue Service (SQS) - Provides a hosted message queue for web applications.
Simple Workflow (SWF) - A workflow service for building scalable, resilient applications.
Step Functions - Coordinate components of distributed applications.

Developer Tools

CodeBuild - Build and test code.
CodeCommit - Hosted Git version control service.
CodeDeploy - Provides automated code deployment to EC2 instances.
CodePipeline - Continuous delivery service.
Command Line Interface (CLI) - Provides a CLI to manage all services.
X-Ray - Analyze and debug your applications.

Miscellaneous Services

Fulfillment Web Service - Provides a programmatic web service for sellers to ship items to and from Amazon using Fulfillment by Amazon.
Mechanical Turk - Manages small units of work distributed among many persons.
Partner Network (APN) - Provides partners with the technical information and sales and marketing support to increase business opportunities.
Product Advertising API - Provides access to product data and electronic commerce functionality.

Credits

Check out the Credits page.

Other Awesome Lists

Other awesome lists can be found in awesome and awesome-awesomeness.

Contact Info

Feel free to contact me to discuss any issues, questions, or comments.

My contact info can be found on my GitHub page.

License

I am providing code and resources in this repository to you under an open source license. Because this is my personal repository, the license you receive to my code and resources is from me and not my employer (Facebook).

Copyright 2017 Donne Martin

Creative Commons Attribution 4.0 International License (CC BY 4.0)

http://creativecommons.org/licenses/by/4.0/

Awesome AWS

The Fiery Meter of AWSome

awesome-aws Python Module

Contributing

Index

SDKs and Samples

Android SDK

C++ SDK

Clojure SDK

Go SDK

iOS SDK

IoT SDK

Java SDK

JavaScript SDK

Haskell SDK

Perl SDK

PHP SDK

Python SDK

Ruby SDK

Rust SDK

Scala SDK

Unity SDK

Xamarin SDK

.NET SDK

Command Line Tools

Universal Command Line Interface

Windows PowerShell

IDE Toolkits

Eclipse Toolkit

Visual Studio Toolkit

Open Source Repos

API Gateway

CLI

CloudFormation

CloudSearch

CloudTrail

CloudWatch

Code Deploy

Code Pipeline

Cognito

Data Pipeline

Device Farm

DynamoDB

Elastic Beanstalk

Elastic Compute Cloud

Elastic Container Service

Elastic File System

Elastic MapReduce

Elastic Search

Elasticache

Glacier

Kinesis

Lambda

Machine Learning

Mobile Analytics

OpsWorks

Redshift

Route 53

S3

SES

Simple Workflow

SimpleDB

SNS

SQS

Data

DevOps

Security

Accompanying Repos

Miscellaneous Repos

Guides, Books, Documentation, and Training

Getting Started Guides

General Guides

Books

Whitepapers

Documentation

Training

Case Studies: Powered by AWS

Social

Blogs

Twitter Influencers

`awesome-aws` Python Module