Lambda Architecture Demo
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Airbyte | 12,918 |  | 11 | 3 months ago | 311 | December 08, 2023 | 5,111 | other | Python | |
| The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | ||||||||||
| Awesome Aws | 11,773 | 6 months ago | 1 | December 21, 2015 | 65 | other | Python | |||
| A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome. | ||||||||||
| Goodreads_etl_pipeline | 593 | 4 years ago | mit | Python | ||||||
| An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. | ||||||||||
| Locopy | 99 | 3 months ago | 21 | December 08, 2023 | 5 | apache-2.0 | Python | |||
| locopy: Loading/Unloading to Redshift and Snowflake using Python. | ||||||||||
| Go Localstack | 73 | 3 | 3 months ago | 98 | November 13, 2023 | 1 | apache-2.0 | Go | ||
| Go Wrapper for using localstack | ||||||||||
| Data Quality Gate | 53 | 7 months ago | 1 | apache-2.0 | Python | |||||
| Data Quality Gate based on AWS | ||||||||||
| Redshift Benchmark | 52 | 10 years ago | 1 | Shell | ||||||
| Redshift Fake Driver | 51 | a year ago | 16 | July 14, 2022 | 23 | apache-2.0 | Scala | |||
| A jdbc driver emulates redshift specific commands. | ||||||||||
| Udacity Data Engineering | 42 | 4 years ago | 1 | Jupyter Notebook | ||||||
| Udacity Data Engineering Nano Degree (DEND) | ||||||||||
| Aws Redshift Spectrum Poc | 27 | 4 years ago | other | TSQL | ||||||
| Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Amazon Redshift Spectrum" post | ||||||||||
Alternatives To Lambda Architecture DemoSelect To Compare
Alternative Project Comparisons
Popular S3 Projects
Popular Redshift Projects
Popular Cloud Computing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Jupyter Notebook
Apache
Lambda Functions
Streaming
Spark
Kafka
S3
Redshift
Spark Streaming