Spark2 Etl Examples
A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Spark Jobserver | 2,837 | 4 months ago | 110 | other | Scala | |||||
| REST job server for Apache Spark | ||||||||||
| Pkpmspark | 697 | 4 years ago | Scala | |||||||
| awesome 三维数据挖掘 数据分析 & 推荐 | ||||||||||
| Metorikku | 536 | a year ago | 126 | February 27, 2023 | 65 | mit | Scala | |||
| A simplified, lightweight ETL Framework based on Apache Spark | ||||||||||
| Spark Solr | 440 | 21 | 2 | a year ago | 102 | June 29, 2023 | 57 | apache-2.0 | Scala | |
| Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ. | ||||||||||
| Spark Fast Tests | 385 | 10 | a year ago | 8 | April 27, 2022 | 28 | mit | Scala | ||
| Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit) | ||||||||||
| Connectors | 383 | 9 months ago | 5 | December 06, 2022 | apache-2.0 | Java | ||||
| This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake. | ||||||||||
| Spark Jobserver | 348 | 7 years ago | 50 | other | Scala | |||||
| REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver/spark-jobserver. This fork now serves as a semi-private repo for Ooyala. | ||||||||||
| Sparklint | 293 | 6 years ago | 9 | February 21, 2018 | 16 | apache-2.0 | Scala | |||
| A tool for monitoring and tuning Spark jobs for efficiency. | ||||||||||
| Transport | 288 | 17 | 3 months ago | 27 | October 17, 2023 | 34 | bsd-2-clause | Java | ||
| A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Apache Hive, and Presto. | ||||||||||
| Sagemaker Spark | 285 | 2 | 7 months ago | 36 | August 26, 2022 | 34 | apache-2.0 | Scala | ||
| A Spark library for Amazon SageMaker. | ||||||||||
Alternatives To Spark2 Etl ExamplesSelect To Compare
Alternative Project Comparisons
Popular Spark Projects
Popular Jar Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Scala
Spark
Jar
Hive
Hdfs