Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for sql pipeline
pipeline
x
sql
x
26 search results found
Prql
⭐
8,953
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Beam
⭐
7,355
Apache Beam is a unified programming model for Batch and Streaming data processing.
Mage Ai
⭐
6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
Versatile Data Kit
⭐
389
One framework to develop, deploy and operate data workflows with Python and SQL.
Yuniql
⭐
292
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
Cuelake
⭐
266
Use SQL to build ELT pipelines on a data lakehouse.
Bulk Writer
⭐
218
Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
Analytics Readings
⭐
155
Readings for Analytics Engineers
Pythoncrawler Scrapy Mysql File Template
⭐
153
scrapy爬虫框架模板,将数据保存到Mysql数据库或者文件中。
Graphquery
⭐
104
GraphQuery is a query language and execution engine tied to any backend service.
Patterns Devkit
⭐
101
Data pipelines from re-usable components
Projects
⭐
76
Sample projects using Ploomber.
Sqlbucket
⭐
67
Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.
Home Credit Default Risk
⭐
59
Default risk prediction for Home Credit competition - Fast, scalable and maintainable SQL-based feature engineering pipeline
Til
⭐
51
Today I Learned
Soda Sql
⭐
50
Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
Arbalest
⭐
41
Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and makes data queryable at scale in AWS.
Mara Etl Tools
⭐
33
Utilities for creating ETL pipelines with mara
Blast
⭐
31
Blast is a data orchestration tool that can run SQL and Python against Google BigQuery and Snowflake. It supports templating with Jinja, data quality tests, query validation, environment management and more.
Datayoga
⭐
27
streaming data pipeline platform
Azuredevopsextensionsforsqlserver
⭐
19
Microsoft SQL Server deployment extensions for Azure DevOps Pipelines
Airflowetl
⭐
16
Blog post on ETL pipelines with Airflow
Querido Diario Data Processing
⭐
15
Text processing repository to free brazilian municipal gazettes from closed file formats for the Querido Diário project.
Purescript Ifrit
⭐
12
An SQL -> NoSQL compiler for data aggregation
Automating Azure Sql Dw
⭐
12
Code samples for an Ignite conference presentation on the topic of Automating Azure SQL Data Warehouse
Ttp Jan 2017
⭐
11
Class Materials for Tech Talent Pipeline at Queens College January 2017
Dataquest_eng
⭐
10
Here's how to get DataQuest's Data Engineering Track missions' content to work on your localhost. Using data from my Valenbisi ARIMA modeling project, I document my steps using PostgreSQL, Postico, and the Command Line to get our DataQuest exercises running out of a Jupyter Notebook.
Greatex
⭐
10
A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.
Pycodehash
⭐
9
PyCodeHash is a generic data and code hashing library that facilitates downstream caching.
Safeql
⭐
7
Composable / async / functional / type-safe / parallel-pipelined queries and relations without SQL injection or N+1s.
Python_scrapy_bank
⭐
7
全国银行联行号
Examples
⭐
7
Sql To Bigquery Dataflow
⭐
6
This project contains a basic pipeline for migrating a MS SQL Server catalog to a BigQuery dataset.
Data Factory Copy Blob To Sql
⭐
5
This sample shows how to copy data from an Azure Blob Storage to an Azure SQL Database
Adfbuild2018
⭐
5
Azure Data Factory demo code for Microsoft Build 2018 Conference session: Building Analytic Solutions with Azure Data Factory and Azure SQL Data Warehouse at Scale
Ttp
⭐
5
Queens College Tech Talent Pipeline 2016
Related Searches
Database Sql (5,501)
Python Pipeline (4,255)
Python Sql (3,922)
Mysql Sql (2,867)
Java Sql (2,781)
Javascript Sql (2,662)
C Sharp Sql (2,429)
Postgresql Sql (2,411)
Php Sql (2,276)
Golang Sql (1,383)
1-26 of 26 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.