Awesome Open Source

Programming Languages

Search results for java etl

90 search results found

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Pentaho Kettle ⭐ 7,194

Pentaho Data Integration ( ETL ) a.k.a Kettle

Kestra ⭐ 5,257

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Addax ⭐ 1,034

Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.

Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI

Datacleaner ⭐ 557

The premier open source Data Quality solution

Exchangis ⭐ 401

Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

Zdh_web ⭐ 379

大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批

Extensible data integration Java framework for building XML and non-XML fragment-based applications

Replicadb ⭐ 304

ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases

Kafka Connect File Pulse ⭐ 289

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

Kettle Web ⭐ 197

基于spring boot通过java代码调用kette

Bender - Serverless ETL Framework

Hydrograph ⭐ 138

A visual ETL development and debugging tool for big data

(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)

LinkedPipes ETL is an RDF based, lightweight ETL tool

Marklogic Data Hub ⭐ 129

The MarkLogic Data Hub: documentation ==>

Neo4j Jdbc ⭐ 122

JDBC driver for Neo4j

Sequenceiq Samples ⭐ 119

SequenceIQ Hadoop examples

Fhir Data Pipes ⭐ 107

A collection of tools for extracting FHIR resources and analytics services on top of that data.

Deta_cache ⭐ 106

缓存cache服务器

Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm

Batch Scheduler ⭐ 96

Kettleinaction100 ⭐ 85

Kettle实战100篇博文

Scriptella Etl ⭐ 75

Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java

In-memory Java DataFrame library

Mongosyphon ⭐ 68

A tool for transferring data from a Relational Database to MongoDB

Bigquery Etl Dataflow Sample ⭐ 62

Mydataharbor ⭐ 50

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数

Datasphere Integration ⭐ 38

an data-centric integration platform

Flinkproj ⭐ 36

Flink 案例开发数据清洗、数据报表

Orientdb Etl ⭐ 32

OrientDB ETL tools

Link Move ⭐ 32

A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.

Data Mart As A Service

Cvparser ⭐ 24

CVparser is software for parsing or extracting data out of CV/resumes.

Vivo Harvester ⭐ 24

An ETL tool for transferring data from traditional systems into Semantic Systems.

Mongodb Rdbms Sync ⭐ 23

Bi-directional data sync between Relational Databases (Oracle, MySql) & MongoDB.

数据质量控制系统

Clickhouse Highlevel Sinker ⭐ 18

clickhouse-highlevel-sinker

Sql To Redis ⭐ 17

Convert SQL tables to Redis as JSON

Hadoop Etl Udfs ⭐ 17

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Maxwell Sink ⭐ 16

consume maxwell generated message from kafka,export it to another mysql.

Datax Src ⭐ 16

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase 等各种异构数据源之间高效的数据同步功能。

Bi_project ⭐ 14

一个简单的Hive项目，使用了Sqoop、Hadoop、Hive、MySQL，对电商数据进行分析

A lib to transform data from jdbc,csv,json to ecah other.

Kafka Connect Datagen ⭐ 14

A Kafka Connect source connector that generates data for tests

Skycloud Datax ⭐ 13

基于阿里Datax改版web datax ,支持管理平台与restful风格API

Hop Gis Plugins ⭐ 13

🗺 GIS plugins for Apache Hop Orchestration Platform

Mongomovie ⭐ 12

MongoDB movie data model, ETL loader, and queries.

Marketing Data Connectors ⭐ 11

Command line batch job that run java runtime environment to extract and load marketing data using Facebook Marketing API, Google Analytics API, Mailchimp API, Google Webmasters API, Google Sheets API, Mysql, Postgresql, Clickhouse, etc

Tajo Cdh ⭐ 10

Tajo is a distributed data warehouse system on Hadoop that provides low-latency and scalable ad-hoc queries and ETL on large-data sets stored on HDFS and other data sources. This repository is for another Tajo distribution based on CDH.

Dcc Release ⭐ 10

Second generation of the ICGC DCC release ETL built on Spark

A SQL-esque scripting language for spatial processing and ETL

Univocity Api ⭐ 9

uniVocity public API. This project contains interfaces and configuration classes used by our data integration solution. Learn more:

Etl By Example ⭐ 9

Hedera Etl ⭐ 8

ETL scripts for Hedera Hashgraph

This is a framework designed for the creation of testable components which can be interconnected via arbitrary inputs and outputs and those components can be executed in the correct order (inputs satisfied before running) automatically. This is useful since it aids developers in thinking in the paradigm where they plan components ahead of time, allowing for simpler reuse and refactoring later. At yahoo! this was created for a ETL like framework & pipeline, but its applications are not limited t

Kafka Sqlreader Datax ⭐ 8

A delta ETL flow trigger by BINLOG in kafka messages.

Bigdatawarehouse ⭐ 8

Data Vault data model and ETL generator for Oracle Databases

ConTube: A scalable data connector framework that facilitates efficient data transfer between diverse systems.

An NLP pipeline for Wikia data

Lobid Resources ⭐ 7

Transformation, web frontend, and API 2.0 for the hbz catalog as LOD

Spark Kafka Simple Consumer Receiver ⭐ 7

Scs Etl Demo ⭐ 6

Spring Cloud Stream - Event Driven ETL reference examples

Noleme Flow Connectors ⭐ 6

Connectors and utilities for building noleme-flow ETLs

Datapipeline ⭐ 6

Northstar ⭐ 6

北极星数据管理中台

Teleporter ⭐ 6

Automatically synchronizes any database in RDBMS to OrientDB database. Open Source Project - Apache 2 license.

Mailspider ⭐ 6

Opensource ETL for {email,http,ftp} files retrieval, filtering (against a set of rules), tagging and uploading via http.

ETL tool for a telecomm company's data warehouse

Preprocessor Sample ⭐ 6

新版预处理的使用样例

Data Etl Sloth ⭐ 5

大数据元数据管理相关

Datafastlane ⭐ 5

Data in the Fast Lane is a powerful and extensible ETL that leverages Apache Spark.

Nutchpighive ⭐ 5

crawl GooglePlay data with Nutch, ETL with Pig, analyze with Hive

Longneck Core ⭐ 5

Data transformation engine for efficient data integration, data cleaning and ETL.

Scriptella Mongodb ⭐ 5

Canal Client Adapter ⭐ 5

canal客户端适配器, 在原有的es适配器基础上，支持用户名密码xpack方式来访问es

Solrmongodbdataimporter ⭐ 5

Solr MongoDB Data Import

ETL (Extract-Transform-Load) framework based on JavaFBP

Iudx Adaptor Framework ⭐ 5

A data ingestion adaptor to plug data from source to sink with a configuration based pipeline

TRON blockchain data processor: extract, transform and process Tron blockchain data easily

Pentaho ETL compare tool

Ovirt Dwh ⭐ 5

oVirt Engine Data Warehouse

Etlexpress ⭐ 5

ETL元数据注册,表达式注册

Phishing Domain Extractor ⭐ 5

batch jobs for creating a phishing database, using opensource tools and databases.

Related Searches

Java Spring (21,350)

Java Spring Boot (11,982)

Java Video Game (8,093)

Java Gradle (8,072)

Java Docker (6,180)

Java Database (6,015)

Java Mysql (5,954)

Java Sdk (5,864)

Javascript Java (5,468)

Java Rest (4,956)

1-90 of 90 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.