Awesome Open Source

Programming Languages

Search results for spark sbt

136 search results found

Delta ⭐ 6,656

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Learning Spark ⭐ 3,804

Example code from Learning Spark book

Spark Testing Base ⭐ 1,475

Base classes to use when writing tests with Spark

Spark Scala Tutorial ⭐ 922

A free tutorial for Apache Spark.

Mongo Spark ⭐ 692

The MongoDB Spark Connector

Fregata ⭐ 674

A light weight, super fast, large scale machine learning library on spark .

Spark Training ⭐ 365

Apache Spark training material

Former GraphX development repository. GraphX has been merged into Apache Spark; please submit pull requests there.

Spark Jobserver ⭐ 348

REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver/spark-jobserver This fork now serves as a semi-private repo for Ooyala.

An open-source toolkit for large-scale genomic analysis

Example Spark ⭐ 197

Spark, Spark Streaming and Spark SQL unit testing strategies

Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine

Dbscan On Spark ⭐ 146

An implementation of DBSCAN runing on top of Apache Spark

Sbt Spark Package ⭐ 137

Sbt plugin for Spark packages

Logvision ⭐ 136

分布式实时日志分析与入侵检测系统

Scala Samples ⭐ 125

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

An Apache Spark-shell backend for IPython

Streaming Matrix Factorization ⭐ 100

Distributed Streaming Matrix Factorization implemented on Spark for Recommendation Systems

Mongo Spark ⭐ 93

Example application on how to use mongo-hadoop connector with Spark

Sparkprojecttemplate.g8 ⭐ 88

Template for Spark Projects

Spark Validator ⭐ 87

A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support.

Sbt Spark Submit ⭐ 86

sbt plugin for spark-submit

Scalding Example Project ⭐ 85

The Scalding WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR

Spark Deployer ⭐ 77

Deploy Spark cluster in an easy way.

MLeap allows for easily putting Spark ML pipelines into production

Spark_scala_ml_examples ⭐ 75

Spark 2.0 Scala Machine Learning examples

Jgit Spark Connector ⭐ 67

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

Sparkmultitool ⭐ 66

Tools for spark which we use on the daily basis

Spark Pagerank ⭐ 61

PageRank in Spark

Stellar Random Walk ⭐ 61

Sbt Lighter ⭐ 55

SBT plugin for Apache Spark on AWS EMR

Spark Integration Tests ⭐ 55

Integration tests for Spark

Spark Sbt.g8 ⭐ 54

A giter8 template for Spark SBT projects

Model Serving Tutorial ⭐ 53

Code and presentation for Strata Model Serving tutorial

Spark Select ⭐ 53

A library for Spark DataFrame using MinIO Select API

Play Spark Scala ⭐ 52

Sparkstreamingapps ⭐ 51

A spark sbt blueprint to build your own spark apps off of (for cloud native runtime, see the kube/spark examples)

Spark Stringmetric ⭐ 50

Spark functions to run popular phonetic and string matching algorithms

Hydra Spark ⭐ 46

Spark Es ⭐ 44

ElasticSearch integration for Apache Spark

Spark Parquet Thrift Example ⭐ 44

Example Spark project using Parquet as a columnar store with Thrift objects.

一个为spark批量导入数据到hbase的库

Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark

Swiftvis2 ⭐ 35

Plotting/visualization with graphical dataflow analysis.

Telemetry Batch View ⭐ 32

A Scala framework to build derived datasets, aka batch views, of Telemetry data.

Spark Sandbox ⭐ 27

A playground for Spark jobs.

Predictiveanalatics Using Dl4j And Apachespark ⭐ 26

Predictive analatics using deepLearning4j and Spark

Java Sizeof ⭐ 25

Memory consumption estimator for Scala/Java

Spark Cassandra Example ⭐ 25

Example usage of spark cassandra connector

Sparkdatalog ⭐ 24

A Datalog API for Spark

Sbt Spark ⭐ 24

Simple SBT plugin to configure Spark applications

Avro Schema Evolution made easy

Hazelcast Spark ⭐ 22

Spark Connector for Hazelcast

Bigdatadevkit ⭐ 21

Big Data Development Kit (Hadoop / Spark / Zeppelin / IntelliJ)

Book Examples ⭐ 21

Examples from Learning Hadoop 2 (Packt Publishing, 2015)

Geotrellis Pointcloud ⭐ 20

GeoTrellis PointCloud library to work with any pointcloud data on Spark

Ruscello ⭐ 19

Real time and offline time series analysis with Spark, Spark Streaming and Storm

Admm Spark ⭐ 19

Implementation of ADMM algorithm on Apache Spark

Spark Streaming With Google Cloud Example ⭐ 19

an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore

Spark Scala Eks ⭐ 19

Spark Scala docker container sample for AWS testing - EKS & S3

Spark Notes ⭐ 18

Note anything during writing spark or scala

Mesos Spark Integration Tests ⭐ 17

Mesos Integration Tests on Docker/Ec2

Opentsdb Spark ⭐ 17

Access OpenTSDB data from Spark

Spark Hdf5 ⭐ 17

A plugin to enable Apache Spark to read HDF5 files

Setting Up Spark ⭐ 16

Quick guide for setting up Spark project running on a local cluster

Address Index Data ⭐ 16

Spark Tensorflow Connector ⭐ 16

Import and export TensorFlow records from/to Spark

Spark Example Project ⭐ 15

A Spark WordCount example as a standalone SBT project

Spark Netezza ⭐ 15

Netezza Connector for Apache Spark

Sparksql Scalapb Test ⭐ 14

Test for SparkSQL ScalaPB

Sparkgraph ⭐ 14

Minikube for big data with Scala and Spark

Scala library for converting Spark rows to case classes

Spark Emr ⭐ 12

Spark S3 ⭐ 11

Spark Plugin for Amazon S3

Spark Testing ⭐ 11

Opentsdb Spark ⭐ 11

Module for accessing OpenTSDB data in HBASE and creating a SparkRDD

Spark Sample Project ⭐ 11

Spark Sample Project

Spark Jobserver.g8 ⭐ 11

giter8 template for Spark Jobserver

Spark Scala Tutorial Ko ⭐ 11

Tutorial for Scala on Spark only

Genericspark ⭐ 10

Sparkstr ⭐ 10

Spark Streaming jobs.

Spark Project Template ⭐ 10

Template of a Spark project, with IDEA support, bundling with assembly, examples, ...

Lazy Linalg ⭐ 10

A package full of linear algebra operators for Apache Spark MLlib's linalg package

Spark2demo ⭐ 10

Yl Netty Rpc ⭐ 10

基于 Spark Netty Rpc 框架，重新实现的一个 Netty Rpc 框架 ( scala + java )

Location Based Nearest Neighbours ⭐ 9

Using k-d trees with Apache Spark and Scala

Spark Streaming Mqtts ⭐ 9

Spark Streaming receiver that supports MQTT over TLS v1.2 with X.509 client certificate based authentication.

Spark2cassandrabulkload ⭐ 8

Spark Library for Bulk Loading into Cassandra

Spark HbaseETL Tools. Support bulk

Spark Examples ⭐ 8

Examples for exploring Spark

Mikasa_ol ⭐ 8

Mikasa Recommendation System. Twitter Data Analyzer

The rooster crows immediately before sunrise, the rooster causes the sun to rise

This test program uses structured streaming of spark, receive message that is json type from kafka, then get counts of DNS for every people In one minute. (I think one source Ip addr is one people). Finally, the result will insert to mysql database.

Sbt Spark Ec2 Plugin ⭐ 8

Sbt plugin to submit Spark jobs

Fast Gt Perfect ⭐ 7

Spark Powerbi Connector ⭐ 7

Spark to Microsoft PowerBI connector

Divolte Spark ⭐ 7

Utilities for using data created by Divolte collector in Spark, Spark Streaming and PySpark

Transmogrifai Helloworld Sbt ⭐ 7

Spark Proto ⭐ 7

A library for reading and writing Protobuf3 data from Spark RDDs.

Related Searches

Scala Sbt (4,158)

Scala Spark (3,279)

Python Spark (2,053)

Java Spark (1,587)

Apache Spark (1,207)

Spark Hadoop (1,188)

Jupyter Notebook Spark (1,151)

Spark Kafka (985)

Spark Streaming (817)

Spark Pyspark (812)

1-100 of 136 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.