Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for spark dag
dag
x
spark
x
19 search results found
Easyml
⭐
1,966
Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real world tasks.
Taier
⭐
1,220
Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display
Goodreads_etl_pipeline
⭐
593
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Big Whale
⭐
290
Spark、Flink等离线任务的调度以及实时任务的监控
Airflow Spark
⭐
64
Docker with Airflow and Spark standalone cluster
Fb_scraper
⭐
52
FBLYZE is a Facebook scraping system and analysis system.
Spark With Python My Learning Notes
⭐
39
ETL pipeline using pyspark (Spark - Python)
Spark Native Yarn
⭐
32
Tez port for Spark API
Scattersphere
⭐
30
Job Coordination API for Tasks
Airflow Livy Operators
⭐
17
Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.
Peapod
⭐
15
Dependency and data pipeline management framework for Spark and Scala
Airflowjob
⭐
11
Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE
Spark Series
⭐
6
Spark入门系列文章
Pical
⭐
6
(Work In Process) pita is a general distributed computation system with Erlang language base on DAG model. This project is inspired by DouBan 's DPark and Apache Spark.
Scache
⭐
6
A distributed memory cache system for shuffle in map-reduce
Spark Most Frequent Word Counter
⭐
6
This java program counts the most frequent word in a given file using Apache Spark
Mapr Airflow
⭐
5
Dataflow
⭐
5
基于 Spark 任务流
Airflow Dags
⭐
5
Related Searches
Scala Spark (3,279)
Python Spark (2,053)
Java Spark (1,587)
Apache Spark (1,207)
Spark Hadoop (1,188)
Jupyter Notebook Spark (1,151)
Spark Kafka (985)
Spark Streaming (817)
Spark Pyspark (812)
Python Dag (457)
1-19 of 19 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.