Octopufs
OctopuFS library helps managing cloud storage, ADLSgen2 specifically. It allows you to operate on files (moving, copying, setting ACLs) in very efficient manner. Designed to work on databricks, but should work on any other platform as well.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Spark Jobserver | 2,837 | 4 months ago | 110 | other | Scala | |||||
| REST job server for Apache Spark | ||||||||||
| Pkpmspark | 697 | 4 years ago | Scala | |||||||
| awesome 三维数据挖掘 数据分析 & 推荐 | ||||||||||
| Metorikku | 536 | a year ago | 126 | February 27, 2023 | 65 | mit | Scala | |||
| A simplified, lightweight ETL Framework based on Apache Spark | ||||||||||
| Spark Solr | 440 | 21 | 2 | a year ago | 102 | June 29, 2023 | 57 | apache-2.0 | Scala | |
| Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ. | ||||||||||
| Spark Fast Tests | 385 | 10 | a year ago | 8 | April 27, 2022 | 28 | mit | Scala | ||
| Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit) | ||||||||||
| Connectors | 383 | 9 months ago | 5 | December 06, 2022 | apache-2.0 | Java | ||||
| This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake. | ||||||||||
| Spark Jobserver | 348 | 7 years ago | 50 | other | Scala | |||||
| REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver/spark-jobserver. This fork now serves as a semi-private repo for Ooyala. | ||||||||||
| Sparklint | 293 | 6 years ago | 9 | February 21, 2018 | 16 | apache-2.0 | Scala | |||
| A tool for monitoring and tuning Spark jobs for efficiency. | ||||||||||
| Transport | 288 | 17 | 3 months ago | 27 | October 17, 2023 | 34 | bsd-2-clause | Java | ||
| A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Apache Hive, and Presto. | ||||||||||
| Sagemaker Spark | 285 | 2 | 7 months ago | 36 | August 26, 2022 | 34 | apache-2.0 | Scala | ||
| A Spark library for Amazon SageMaker. | ||||||||||
Alternatives To OctopufsSelect To Compare
Alternative Project Comparisons
Popular Spark Projects
Popular Jar Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Scala
Spark
Jar
Hive
Azure Storage