Awesome Open Source

Programming Languages

Search results for apache spark

583 search results found

Distributed Bayesian Entity Resolution in Apache Spark

Spark Of Life ⭐ 38

Example of running a Genetic Algorithm (Travelling Salesman) on Apache Spark

Vietnamese Language Processing Toolkit

Spark Ref Architecture ⭐ 38

Reference Architectures for Apache Spark

Archived Sansa Examples ⭐ 37

Usage examples for the SANSA Stack

Distributed execution of bioinformatics tools on Apache Spark. Apache 2 licensed.

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Spark Transformers ⭐ 37

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows

Lstm Tensorspark ⭐ 35

Implementation of a LSTM with TensorFlow and distributed on Apache Spark

Mastering Machine Learning On Aws ⭐ 35

Mastering Machine Learning on AWS, published by Packt

Bigclam Apachespark ⭐ 34

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Apache Spark 2 For Beginners ⭐ 33

Apache Spark 2 for Beginners, published by Packt

Distributed least squares approximation (dlsa) implemented with Apache Spark

Spark Twitter Sentiment Analysis ⭐ 33

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Spark Gpu ⭐ 33

GPU Acceleration for Apache Spark

Spark Gradle Template ⭐ 32

Apache Spark in your IDE with gradle

Spark Flow ⭐ 32

Library for organizing batch processing pipelines in Apache Spark

dllib is a distributed deep learning library running on Apache Spark

Awesome Tools ⭐ 32

curated list of awesome tools and libraries for specific domains

Learning Spark With Java ⭐ 32

Self-contained examples using Apache Spark with the functional features of Java 8

Spark Docker Swarm ⭐ 31

running apache spark with docker swarm

Pysparkcheatsheet ⭐ 30

PySpark Cheatsheet

Spark Utils ⭐ 30

Basic framework utilities to quickly start writing production ready Apache Spark applications

Baskerville ⭐ 30

Security Analytics Engine - Anomaly Detection in Web Traffic

Spark Notebook Ml Labs ⭐ 30

Data Science with Apache Spark and Spark Notebook

Apache Spark Deep Learning Cookbook ⭐ 30

Apache Spark Deep Learning Cookbook, published by Packt

Spark As Service Using Embedded Server ⭐ 30

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Spark Flamegraph ⭐ 30

Easy CPU Profiling for Apache Spark applications

Netapp Hadoop Nfs Connector ⭐ 29

This projects provides a NFSv3 connector for Hadoop. Using the connector, Apache Hadoop and Apache Spark can use NFSv3 server as their storage backend.

Pu4spark ⭐ 29

Positive-Unlabeled Learning for Apache Spark

Apache Spark 2x Machine Learning Cookbook ⭐ 28

Apache Spark 2x Machine Learning Cookbook, published by Packt

Btcspark ⭐ 28

A toolkit for using apache spark to efficiently query Bitcoin Blockchain data.

Sparkplayground ⭐ 28

Playground used to learn and experiment with Apache Spark

Sparqlgx ⭐ 28

Efficient Distributed Evaluation of SPARQL with Apache Spark

Metrics Spark Reporter ⭐ 28

Dropwizard Metrics reporter for Apache Spark

Docker Pyspark ⭐ 28

Docker image of Apache Spark with its Python interface, pyspark.

Almaren Framework ⭐ 28

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

Sparkplug ⭐ 27

Clojure API bindings for Apache Spark

Statisticsonspark ⭐ 27

Assembly of fundamental statistics implemented based on Apache Spark

Isarn Sketches Spark ⭐ 27

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Pyspark Asyncactions ⭐ 26

Asynchronous actions for PySpark

Amazon Emr Cli ⭐ 26

A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs

Sparkproject ⭐ 26

Using Apache Spark in an ArcMap Toolbox

Odsc_india_2018 ⭐ 26

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Chronicler Spark ⭐ 25

InfluxDB connector to Apache Spark on top of Chronicler

Cloud Based Sql Engine Using Spark ⭐ 25

Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.

Spark Scala Playground ⭐ 25

Sample processing code using Spark 2.1+ and Scala

Spark Esri ⭐ 25

Repo to demonstrate the usage of Apache Spark within a Jupyter notebook within ArcGIS Pro

Spark Power Bi ⭐ 25

Power BI API adapter for Apache Spark (deprecated)

Amazon Emr Vscode Toolkit ⭐ 25

A VS Code Extension to make it easier to manage and develop Spark jobs on EMR

Spark Structured Streaming Examples ⭐ 25

Spark structured streaming examples with using of version 3.4.0

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Spark Fsm ⭐ 24

This project provides sequential pattern mining for Apache Spark. The algorithms are based on the work of Philippe Fournier-Viger and comprise his SPADE and TSR algorithm. This enables to perform sequential pattern and also sequential rule mining.

Traj Sim Spark ⭐ 24

Distributed Trajectory Similarity Search Algorithms based on Apache Spark

Hands On Deep Learning With Apache Spark ⭐ 24

Hands-On Deep Learning with Apache Spark, Published by Packt

Sparksql.jl ⭐ 23

SparkSQL.jl enables Julia programs to work with Apache Spark data using just SQL.

Location Based Restaurants Recommendation System ⭐ 23

Big Data Management and Analysis Final Project

Sql Based Etl With Apache Spark On Amazon Eks ⭐ 23

A solution that provides declarative data processing capability, and workflow orchestration automation to help your business users (such as analysts and data scientists) access their data and create meaningful insights without the need for manual IT processes.

Sparkucx ⭐ 23

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Pulsar Adapters ⭐ 23

Apache Pulsar Adapters

Go bindings for Apache Spark

Detecting Malicious Url Machine Learning ⭐ 23

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Awesome Sparklyr ⭐ 22

An awesome sparklyr related package collection

Spark For Data Engineers ⭐ 22

Apache Spark for data engineers

Learn Hadoop And Spark ⭐ 22

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

Spark State Tools ⭐ 22

Spark Structured Streaming State Tools

Apache Spark 2x For Java Developers ⭐ 22

Apache Spark 2x for Java Developers, published by Packt

Spark Ensemble ⭐ 21

Ensemble Learning for Apache Spark 🌲

Spark Monotasks ⭐ 21

Fast, predictable data analytics based on (and API-compatible with) Apache Spark

Sample Kafkasparkcassandra ⭐ 21

Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.

Spark_recommender ⭐ 21

Spark Recommender example

Spark.sas7bdat ⭐ 21

Read in SAS data in parallel into Apache Spark

Eta Spark Core ⭐ 21

eta-spark is a library that provides complete bindings for Apache Spark

Cassandra Spark Analytics ⭐ 21

Supercharge your analysis of Cassandra data with Apache Spark

Cloud Integration ⭐ 21

Spark cloud integration: tests, cloud committers and more

Apache Spark Docker ⭐ 21

Dockerizing an Apache Spark Standalone Cluster

Spark Based Ripley K Functions ⭐ 20

A visual analytics framework for Distributed Ripley's K functions based on Apache Spark, including Space K function, Space-Time K function, Local K function and Cross K function. This framework consists of three parts, i.e., front-end web visualization components, Web service API component and back-end Spark-based algorithm packages.

Spark Cassandra Csv ⭐ 20

An example stand alone program to import CSV files into Apache Cassandra using Apache Spark

Spark Pmml Exporter Validator ⭐ 20

Using JPMML Evaluator to validate the PMML models exported from Spark

Mmtf Spark ⭐ 19

Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.

Learning Apache Spark 2 ⭐ 19

Code repository for Learning Apache Spark 2, published by Packt

Spark Athena ⭐ 19

AWS Athena data source for Apache Spark

Spark Kubernetes ⭐ 19

Apache Spark on Kubernetes

Covid 19 Data Engineering Pipeline ⭐ 19

A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.

Admm Spark ⭐ 19

Implementation of ADMM algorithm on Apache Spark

Spark Flight Connector ⭐ 19

A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL

Spark Sframe ⭐ 19

This project contains the code to translate between Apache Spark and SFrame.

Mastering Apache Spark 2x ⭐ 19

Mastering Apache Spark 2x, published by Packt

Spark Distcp ⭐ 18

A re-implementation of Hadoop DistCP in Apache Spark

Spark Fuzzy Matching ⭐ 18

Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardw

Sparkprogramminginscala ⭐ 18

Apache Spark Course Material

Apache Spark 2 Data Processing And Real Time Analytics ⭐ 18

Master complex big data processing, stream analytics, and machine learning with Apache Spark

Kubernetes 100days ⭐ 18

Notes from 100 days with Kubernetes

Cerebro System ⭐ 18

Data System for Optimized Deep Learning Model Selection

Apache Spark Scala Project Template ⭐ 18

A simple Scala Based Project Template for Apache Spark

Dspbench ⭐ 17

a suite of benchmark applications for distributed data stream processing systems

Spark Structured Streaming ⭐ 17

A short course on the new, experimental features by The Data Incubator and O'Reilly Strata.

Related Searches

Scala Apache Spark (497)

201-300 of 583 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.