Awesome Open Source
Awesome Open Source
Combined Topics
data-warehouse
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 160 Data Warehouse Open Source Projects on Github
Categories
>
Data Storage
>
Data Warehouse
Awesome Bigdata
⭐
10,187
A curated list of awesome big data frameworks, ressources and other awesomeness.
Gpdb
⭐
4,761
Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
Rudder Server
⭐
2,720
Privacy and Security focused Segment-alternative, in Golang and React
Dxy Covid 19 Data
⭐
1,971
2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
Cubes
⭐
1,332
Light-weight Python OLAP framework for multi-dimensional data analysis
Tensorbase
⭐
1,011
TensorBase is a new big data warehousing with modern efforts.
Optimus
⭐
542
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Bigquery Utils
⭐
455
Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Indexr
⭐
422
An open-source columnar data format designed for fast & realtime analytic with big data.
Domainmod
⭐
268
DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.
Hue
⭐
258
Open source SQL Query Assistant service for Databases/Warehouses
Intermine
⭐
209
A powerful open source data warehouse system
Udacity Data Engineering Projects
⭐
191
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Datawarehouse
⭐
187
从数据仓库到用户画像，从数据建设到数据应用
Yuniql
⭐
165
Free and open source schema versioning and database migration made natively with .NET Core.
Mobydq
⭐
147
🐳 Tool to automate data quality checks on data pipelines
Transformalize
⭐
129
Configurable Extract, Transform, and Load
Dbtvault
⭐
124
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Cueobserve
⭐
117
Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
Analytics
⭐
70
Analytics - Open source data warehouse and reporting for Nextcloud
Appdynamics.dexter
⭐
68
Turn your APM data store into a Data Warehouse with advanced reporting, including entities, configuration, metrics, flowmaps, events, snapshots and call graph flame graphs
Etl_with_python
⭐
57
ETL with Python - Taught at DWH course 2017 (TAU)
Beneath
⭐
54
Beneath is a serverless real-time data platform ⚡️
Mbd Bidw
⭐
47
Business Intelligence and Data Warehousing
Lake
⭐
44
Data lake for dev.
Copernic
⭐
35
Versioned structured data, with change-request mechanic, at scale.
Couchwarehouse
⭐
35
Data warehouse for CouchDB
Metamapper
⭐
34
Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.
Etl Framework
⭐
31
A framework for moving data into a data warehouse.
Virtual Data Warehouse
⭐
29
The Virtual Data Warehouse is a code generation / pattern management tool. Part of the data warehouse automation ecosystem.
Alphasql
⭐
28
AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
Bimlflex Community
⭐
24
Community-focused content to supplement working with BimlFlex.
Ixmp
⭐
24
The ix modeling platform for integrated and cross-cutting scenario analysis
Elementary Lineage
⭐
21
Elementary is an open-source data reliability framework for modern data teams. The first module of the framework is data lineage.
Data Warehouse Cloud Content
⭐
21
Use the Bikes Sales sample content to explorer SAP Data Warehouse Cloud during the beta phase. The download contains an import for an SAP HANA 2.x to consume the sample data remotely from your SAP HANA instance and CSV files in case you want to start without an SAP HANA instance.
Data_solution_framework
⭐
21
A library for data warehouse and data integration pattern and architecture documentation.
Guzhenping Blog
⭐
20
写点一路的风景，都很普通，主要还是留给自己。请访问：http://guzhenping.com
Cdc_audit
⭐
19
change data capture via audit tables and triggers for mysql.
Listof
⭐
16
📜 Simple and flexible application to manage configuration data aka lists of values.
Olap Cube
⭐
16
is an hypercube of data
Intelli Swift Core
⭐
16
Distributed, Column-oriented storage, Realtime analysis, High performance Database
Data Warehouse Automation Metadata Schema
⭐
15
Generic interface exchange format for Data Warehouse Automation and ETL generation.
Direct
⭐
15
DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
History
⭐
15
Download and warehouse historical trading data
Tweetsolaping
⭐
14
implementing an end-to-end tweets ETL/Analysis pipeline.
Datacatalog Connectors Hive
⭐
13
Sample code with integration between Data Catalog and Hive data source.
Google Sheets Etl
⭐
13
Live import all your Google Sheets to your data warehouse
Cobra Policytool
⭐
13
Manage Apache Atlas and Ranger configuration for your Hadoop environment.
Cortana Intelligence Customer360
⭐
13
This repository contains instructions and code to deploy a customer 360 profile solution on Azure stack using the Cortana Intelligence Suite.
Backend_learning_notes
⭐
13
后端学习笔记，本项目存放了一些我阅读有关的技术类的书籍和部分源码阅读的笔记整理。 涉及范围包括后端开发中的计算机学科基础知识、高级语言的基础知识、源码阅读笔记、数据库知识、数据挖掘知识等，同时也会涉及到一些具体生产场景中会遇到的一些实际问题。 :-D
Imdb Db Dump Projects
⭐
12
Taking IMDBs database dumps and turning them into a multiple projects
Data Chef
⭐
12
Cook your Data Warehouse! Automatic Data Integration following the Data Vault 2.0 paradigm.
Data Brewery
⭐
12
Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage data warehouse workflow.
Transmart Core
⭐
12
Core components and documentation of the tranSMART platform. https://i2b2transmart.org/
Mbd Bl Bidw
⭐
10
Business Intelligence and Data Warehousing (Blended)
Huemul Bigdatagovernance
⭐
10
Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de derechos ARCO para facilitar la implementación de leyes de protección de datos tipo GDPR, identificar los niveles de seguridad y si se está aplicando algún tipo de encriptación. Adicionalmente permite agregar reglas de validación más complejas sobre la misma tabla.
Real Time Data Warehouse
⭐
10
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
Data Engineering Projects
⭐
9
Personal Data Engineering Projects
Snowflake Json Datapipeline
⭐
9
Building Json data pipeline within Snowflake using Streams and Tasks
Extratorlattescnpq
⭐
9
Extrator em C# para tratar a leitura de currículos XML da Plataforma Lattes do CNPq e alimentá-los em uma base de dados SQL para fins de consulta.
Tilda
⭐
9
Pyomop
⭐
8
Python package for managing OHDSI clinical data models.
Data Warehouse Build
⭐
8
Vau
⭐
7
Data Vault data model and ETL generator for Oracle Databases
Data Warehouse Concepts Design And Data Integration
⭐
7
Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and research papers)
Hephaestus
⭐
7
🌠 Hephaestus - ETL and ML tools for OHDSI - OMOP CDM
Bigdata Mind Map
⭐
7
🌟 大数据知识脑图 🌟
Footprint Frontend
⭐
7
👣Footprint is a data warehouse app to let users record travel history and retrieve customized city ranking list. Frontend is built with React, Redux, Leaflet, Firebase, and Google cloud functions.
Diabetes_data_warehouse
⭐
6
This was done to learn Data Warehousing and Data Mining
Ceds Collaborative Exchange
⭐
6
The CEDS Collaborative Exchange is a repository of code developed by the community that interacts with the CEDS Integration Data Store and the CEDS Elements repositories. All resources provided in this community are considered free and open source.
Rstoolkit
⭐
6
RStoolKit - A utility to perform a complete health check of your AWS RedShift Cluster
Ds4fnp
⭐
6
Data Stacks For Fun & Nonprofits!
Genenotebook
⭐
6
A collaborative notebook for genes and genomes
Ceds Data Warehouse
⭐
5
Modeled for longitudinal storage and reporting of P-20W data, the Common Education Data Standards (CEDS) Data Warehouse implements star schema data warehouse normalization techniques for improved query performance.
Chicago
⭐
5
Data_analysis_pandas_spark_koalas
⭐
4
Data Analytics with Pandas, Spark, Koalas & Visualization
Bigquery Python Tutorial
⭐
4
📊 🐍 Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.
Shevek
⭐
4
Interactive data exploration UI for Druid, aimed at end users.
Zerotosnowflake
⭐
4
Code repository for Zero to Snowflake events
Slicingdice Javascript
⭐
4
Official JavaScript client for SlicingDice, Data Warehouse and Analytics Database as a Service.
Sparketl
⭐
4
Implement a complete data warehouse etl using spark SQL
Oura Ring Api Etl
⭐
4
Load data from the Oura Ring API into a personal data warehouse
Yelp 3nf
⭐
3
3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow
Slicingdice Php
⭐
3
Official PHP client for SlicingDice, Data Warehouse and Analytics Database as a Service.
Chicago Etl
⭐
3
ETL tools for chicago
Business Intelligence On Big Data _ U Tad 2017 Big Data Master Final Project
⭐
3
This is the final project I had to do to finish my Big Data Expert Program in U-TAD in September 2017. It uses the following technologies: Apache Spark v2.2.0, Python v2.7.3, Jupyter Notebook (PySpark), HDFS, Hive, Cloudera Impala, Cloudera HUE and Tableau.
Courseshop_datawarehouse
⭐
3
a data warehouse for an online course shop
Warehousing Stock Tweet Data
⭐
3
A large-scale data framework that will enable us to store and analyze financial market data and drive future predictions for investment.
T Sql Templates
⭐
2
Dedicated repository for Microsoft SQL Server code templates and samples.
Nifi Postgres Metabase
⭐
2
Template for creating batch based ETL workflow for datawarehouses
Iotree42
⭐
2
Open source multiuser sensor network / IoT-Platform with central storage and frontend visualization. With data transfer encryption, REST-API, and authentificaton.
Goscar Export
⭐
2
🔥 CSV to FHIR (For OSCAR EMR EForm Export)
Project_panoply_instagram_data_challenge
⭐
2
Used ETL tool to collect Instagram data using APIs, used SQL to get insights and used BI tool for data visualization
Clouddatawarehouse
⭐
2
Populating Cloud Data Warehouses with Apache NiFi
Data Warehouse
⭐
2
Practice leaning data warehouse
Skytrax Data Warehouse
⭐
2
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
Whereabouts
⭐
2
Data warehouse Inventory Management System
Modern Big Data Analysis Using Sql
⭐
2
RDBMS techniques for Big Data analysis
Football_schools
⭐
2
Using a dimensional model, data warehouse, and Tableau I explored data from the College Scorecard and NCAA Division I FBS football games 🏈
Dend Datawarehouse
⭐
2
Learn to build a Data Warehouse on AWS with an Redshift cluster from S3 data - An Udacity Data Engineer Nano Degree Project
1-100 of 160 projects
Next >
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
