Awesome Open Source

Programming Languages

Search results for apache spark

583 search results found

Scalable inference of gene regulatory networks using Apache Spark and XGBoost

Spark Pipeline ⭐ 9

Machine learning pipeline for Apache Spark

A Simple Neural Network On Spark ⭐ 9

A simple implementation of an artificial neural network based with Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-

Ml_streaming_spark ⭐ 9

An introduction to machine learning techniques in the high velocity case (including sequential learning) with Apache Spark.

Real Time Risk Management System ⭐ 9

Gaussian Process Classification and Regression on Apache Spark

Spark Kafka Sink ⭐ 9

A Kafka metric sink for Apache Spark

CVPR 2018 Tutorial

Biojava Spark ⭐ 9

💥 Algorithms that are built around BioJava and run on Apache Spark

Mockingbird ⭐ 9

Document classification with Apache Spark on an American Classic

💻💻💻 A commandline tool for analysis of big biological data sets for distributed HPC clusters.

Ibmos2spark ⭐ 9

Facilitates Data I/O between Spark and IBM Object Storage services.

DGST: Efficient and Scalable Generalized Suffix Tree Construction on Apache Spark

Spark Pipeline ⭐ 9

Example End-to-End Data Pipeline with Apache Spark from Data Analysis to Data Product

Spark Mongodb Connector ⭐ 9

A prototype native MongoDB connector for Apache Spark, using Spark's external datasource API

Spark Tools ⭐ 9

Executable Apache Spark Tools: Format Converter & SQL Processor

Location Based Nearest Neighbours ⭐ 9

Using k-d trees with Apache Spark and Scala

Spark Intro To Ml ⭐ 9

A Gentle introduction to Machine Learning with Apache Spark

Docker Spark ⭐ 9

Apache Spark under Docker

Mc Var Spark ⭐ 9

Monte Carlo implementation of VaR using Apache Spark

Awesome Spark ⭐ 9

Apache Spark Awesome List

Elastic Tools ⭐ 9

Apache Spark based command line tools for ElasticSearch

Kittenwhisker ⭐ 9

debugging performance issues for Spark applications

Sparkitecture ⭐ 9

A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

Spark Avro Example ⭐ 9

Example of using Avro with Apache Spark

Real Time Streaming Using Apache Spark Streaming ⭐ 8

Real Time Streaming using Apache Spark Streaming [Video], published by Packt

Net.jgp.books.spark.ch08 ⭐ 8

Spark in Action, 2nd edition - chapter 8

The 4 Ways To Group Sum Count Spark Snippets ⭐ 8

The 4 Simple Ways to group, sum & count in Spark 2.0 : Understanding groupBy, reduceByKey & mapValues in Apache Spark by Example

Spark Hyperloglog ⭐ 8

Algebird's HyperLogLog support for Apache Spark.

Spark Jdbc Mssql ⭐ 8

Connect to SQL Server using Apache Spark

Apache Spark Etl Pipeline Example ⭐ 8

Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computing.

Intrusion Detection Spark Conv Lstm ⭐ 8

Intrusion detection system with Apache Spark and deep learning

Enable spatial functions in Spark through the `sparklyr` package

Caseclass Evolution ⭐ 8

Scala Case Class Extendable

Financial Data Project In Azure ⭐ 8

Free High-Quality Financial Data in Azure

Allows reading ROOT TTrees into Apache Spark as DataFrames

Flipstackweekly ⭐ 8

FLiP Stack Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...

Spark Python Knn ⭐ 8

Function for computing K-NN in Apache Spark

Distributed linear algebra operations using Apache Spark

Xmltocsv_stackexchange ⭐ 8

Xml to Csv converter for Large files using Apache Spark

Spark In A Box ⭐ 8

Template-based Dockerfile generator for Apache Spark applications.

Spark Scala Boilerplate ⭐ 8

Example Apache Spark 2.0.0-2.4.5 + Scala application.

Hybrid Girvan Newman. Code for the "A Distributed Hybrid Community Detection Methodology for Social Networks" paper.

Spark Python Celery Demo ⭐ 8

Apache Spark Python 3 Async Results with Celery

빅데이터 pipeline 구성 요소 기술들에 관한 coding 실습 및 연구

K8s Bigdata ⭐ 8

Apache Spark with HDFS cluster within Kubernetes

Redrock V2 ⭐ 8

RedRock v2 Repository

Prep Buddy ⭐ 8

A Scala / Java / Python library for cleansing, transforming and preparing large datasets for ML operations on Apache Spark.

Apache Spark Quick Start Guide ⭐ 8

Apache Spark Quick Start Guide, Published by Packt

Hadoop Hands On ⭐ 8

Learning how to tame the Big Data with Hadoop and related technologies

Firehose - Spark streaming 2.2 + Kafka 0.8_2

Spectral Clustering On Apache Spark ⭐ 7

Spark’s built- in power iteration clustering (PIC) to simulate an approximate variant of spectral clustering.

Apache Toree Demos ⭐ 7

Demos of the Apache Toree kernel

Spark Shp ⭐ 7

A library for parsing and querying shapefile data with Apache Spark, for Spark SQL and DataFrames.

Net.jgp.books.spark.ch17 ⭐ 7

Spark in Action, 2nd edition - chapter 16 - exporting data, using delta lake

Spark Etl Framework ⭐ 7

A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml

Spark Ecs Connector ⭐ 7

[Archived] ArchiveECS connector for Apache Spark

Sparklyr.flint ⭐ 7

Sparklyr extension making Flint time series library functionalities (https://github.com/twosigma/flint) easily accessible through R

Cve 2022 33891 ⭐ 7

Apache Spark Command Injection PoC Exploit for CVE-2022-33891

Ma Inf 4223 Dbda Lab ⭐ 7

Repository for Lab “Distributed Big Data Analytics” (MA-INF 4223), University of Bonn

Terrier Spark ⭐ 7

A Spark API for the Terrier.org information retrieval platform

Apache Spark With Java Learn Spark From A Big Data Guru ⭐ 7

Spark Privacy Preserver ⭐ 7

Anonymizing Library for Apache Spark

An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.

Externalvalidity ⭐ 7

This package contains the code for calculating external clustering validity indices in Spark. The package includes Chi Index among others.

Spark2 Template ⭐ 7

Intellij template to develop Apache Spark 2.x applications

Itmo_technologies_and_infrastructure_for_big_data ⭐ 7

📊 My smth from ITMO; Dis - BiggusDatus

Spark Alarm ⭐ 7

Alerting and monitoring tool for Apache Spark

Bullet Spark ⭐ 7

The Apache Spark Streaming implementation of the Bullet backend

Apache Spark With Scala Learn Spark From A Big Data Guru ⭐ 7

Monorepo to boost myself

Spark Play Activator ⭐ 7

Traffic Data Analysis With Apache Spark Based On Mobile Robot Data ⭐ 7

Mobile robot data were analyzed with Apache-Spark to extract five different statistical result such as travel time, waiting time, average speed, occupancy and density were produced.

Apache Spark Build Pipeline ⭐ 7

Docker container, equipped with all necessary tools to Build Apache Spark and generate RPMs

Pydata London2015 ⭐ 7

Scalable Duplicate Detection Framework utilizing Apache Spark

Music Recommender System using Apache Spark and Python

Enmasse Iot Demo ⭐ 7

EnMasse - IoT demo

Music Recommender System ⭐ 7

Music Recommender System using Apache Spark and Python

Single Cell Experiments ⭐ 7

Experiments to run single cell analyses efficiently at scale using Zarr, anndata, Scanpy, and Apache Spark

Geospatial Tutorial ⭐ 7

ICDE 2019 Tutorial: Geospatial Data Management in Apache Spark

Dbnet Python ⭐ 7

A Python/VueJS database client (Web GUI) to access Oracle, Spark (Hive), Postgres, etc.

Transactional Datalake Using Apache Iceberg On Aws Glue ⭐ 7

Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and DMS

小白大数据学习笔记，学习路线，技术路线

Bahir Iot Demo ⭐ 6

Apache Bahir - MQTT Analytics demo using Apache Spark and Apache Bahir

Spark Tutorials ⭐ 6

PySpark notebooks to learn Apache Spark (WIP)

Capabilities of StanfordNLP and OpenNLP on Spark

Apache Spark Deep Learning Recipes ⭐ 6

Apache Spark Deep Learning Recipes, published by Packt Publishing

Intro_spark_zeppelin_meetup ⭐ 6

Hands-On Intro to Big Data Analytics using Apache Spark and Apache Zeppelin

imNet: a Sequence Network Construction Toolkit

Vegalite4s ⭐ 6

Vega-Lite4s is a small library over the comprehensive Vega-Lite Javascript visualisation library, allowing you to create beautiful Vega-Lite visualisations in Scala

Jfall Sentiment ⭐ 6

JFall Presentation: Sentiment Analysis of Social Media Posts with Apache Spark

SAMbA: Extending Apache Spark for Scientific Computational Experiments

Spark Word2vec Example ⭐ 6

Learn Spark ⭐ 6

Project Based Learning for Apache Spark

Cookie Datasets ⭐ 6

Read well-known ML datasets in Apache Spark

Stock Price Prediction Spark Cassandra ⭐ 6

This is a data pipeline for predicting stock prices using Apache Spark, Apache Cassandra, and machine learning techniques. It collects and preprocesses stock data from Alpha Vantage API, engineers features, trains models, and performs data analysis and predictions.

Spark Databricks ⭐ 6

🔥 Master Apache Spark & Databricks! Dive into a world of big data with exclusive insights from Udemy courses, personal notes, and practical guides. Whether you're starting out or scaling new heights in data engineering, this is your ultimate resource hub! 🌟🚀

Quarry Platform ⭐ 6

An open source platform-as-a-service for Apache Spark

Related Searches

Scala Apache Spark (497)

401-500 of 583 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.