Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for kubernetes spark
kubernetes
x
spark
x
89 search results found
Docker_practice
⭐
23,279
Learn and understand Docker&Container technologies, with real DevOps practice!
Pipeline
⭐
4,158
PipelineAI
Spark On K8s Operator
⭐
2,526
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Spring Boot Quick
⭐
2,282
🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如:rabbitmq(延迟队列)、K
Ballista
⭐
2,244
Distributed compute platform implemented in Rust, and powered by Apache Arrow.
Kyuubi
⭐
1,849
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Docker Spark
⭐
1,783
Apache Spark docker image
Cube Studio
⭐
1,710
cube studio开源云原生一站式机器学习/深度学习AI平台,支持sso登录,多租户/多项目组,数据资产对
Seldon Server
⭐
1,420
Machine Learning Platform and Recommendation Engine built on Kubernetes
Dockerfiles
⭐
1,171
50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak
Datasophon
⭐
823
The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.
Enterprise_gateway
⭐
607
A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.
Sidekick
⭐
503
High Performance HTTP Sidecar Load Balancer
Data On Eks
⭐
439
DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS
Ballista
⭐
411
Experimental Distributed Compute Platform based on Kubnernetes and Apache Arrow
Cook
⭐
337
Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark
Cloudflow
⭐
323
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
Every Single Day I Tldr
⭐
311
A daily digest of the articles or videos I've found interesting, that I want to share with you.
Delight
⭐
299
A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
Hydro Serving
⭐
248
MLOps Platform
Spark On Kubernetes Helm
⭐
195
Spark on Kubernetes infrastructure Helm charts repo
K8s Spark Scheduler
⭐
173
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
Dcos Commons
⭐
162
DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.
Spark Operator
⭐
152
Operator for managing the Spark clusters on Kubernetes and OpenShift.
Batch Processing Gateway
⭐
148
The gateway component to make Spark on K8s much easier for Spark users.
Bigdata
⭐
142
hadoop,hbase,storm,spark,etc..
Spark Kubernetes
⭐
96
spark on kubernetes
Flink Spark Submiter
⭐
92
从本地IDEA提交Flink/Spark任务到Yarn/k8s集群
Mloperator
⭐
89
Machine Learning Operator & Controller for Kubernetes
Spark Dashboard
⭐
79
This repo provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.
Bigdata Learning Notes
⭐
79
Generator Mitosis
⭐
75
A micro-service infrastructure generator based on Yeoman/Chatbot, Kubernetes/Docker Swarm, Traefik, Ansible, Jenkins, Spark, Hadoop, Kafka, etc.
Lighter
⭐
72
REST API for Apache Spark on K8S or YARN
Sparkplugins
⭐
70
Code and examples of how to write and deploy Apache Spark Plugins with Spark 3.x. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.
Awesome Ai Kubernetes
⭐
62
❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
Cowait
⭐
54
Containerized distributed programming framework for Python
Aiopen
⭐
52
AIOpen是一个按人工智能三要素(数据、算法、算力)进行AI开源项目分类的汇集项目,项目致力于跟踪
Flowml
⭐
41
流程化 机器学习框架 基于 scala java语言 ,一站式自动机器学习平台 ,主要包括数据分析 特征工程 ,机器模型,自动部署,超参数优化,模型自动优化,自动扩容分配创建功能,类似第四范式、阿里PAI平台、 autoMl、亚马逊SageMaker
Devops
⭐
40
DevOps
Eks Spark Benchmark
⭐
28
Performance optimization for Spark running on Kubernetes
Flokkr
⭐
28
Documentation placeholder and utilities for all the other containers.
Kubeflow Spark
⭐
26
Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.
Docker Spark
⭐
26
Apache Spark docker container image (Standalone mode)
Ansible Kubernetes Cluster
⭐
25
Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster
Spark On K8s Gcp Examples
⭐
24
Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
Cloudtik
⭐
23
Cloud Scale Platform for Distributed Analytics and AI
Starters
⭐
23
java python and punchlang samples to discover the punch platform FaaS
Insightedge
⭐
22
InsightEdge Core
Kafka Connect Msk Demo
⭐
21
For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR
Spark Jobserver
⭐
20
REST job server for Apache Spark
Daf Kylo
⭐
20
Kylo integration with PDND (previously DAF).
Eskimo
⭐
20
Eskimo is a state of the art Big Data Infrastructure and Management Web Console to build, manage and operate Big Data 2.0 Analytics clusters on Kubernetes. This is the git repository of Eskimo Community Edition.
Tobetopgopher
⭐
20
go的成神之路
Olh
⭐
19
Open source stack lakehouse
Spark Kubernetes
⭐
19
Apache Spark on Kubernetes
Kubernetes 100days
⭐
18
Notes from 100 days with Kubernetes
Spark Hdfs On Kubernetes
⭐
18
Spark Dev Env Docker
⭐
17
Spark development environment for kubernetes, spark-submit and jupyter notebook
Data Mill
⭐
16
A K8s-based infrastructure for analytics
Tdengine K8s
⭐
16
taos,tdengine,docker,k8s
Blog Data
⭐
14
储存日常的博客原文
Distributed Compute Operator
⭐
14
🤖 Kubernetes operator providing Ray|Spark|Dask|MPI clusters on-demand
Project Fortis Pipeline
⭐
14
Project Fortis is a data ingestion, analysis and visualization pipeline.
Bigkube
⭐
14
Minikube for big data with Scala and Spark
Pyspark K8s Example
⭐
14
Databricks Kube Operator
⭐
14
A Kubernetes operator to enable GitOps style deploys for Databricks resources
Flokkr Runtime Kubernetes
⭐
13
Examples to run Hadoop/Spark cluster with kubernetes.
K8s Big Data Experiments
⭐
12
Experiments produced during an end of studies project (ETS, H2018)
Kubernetes Netapp
⭐
11
Sample projects and examples on using NetApp technologies with Kubernetes
Show Episode Recommender
⭐
11
A Spark job that outputs the ranked list of episode to watch based on one preference "keyword"
Userdocs
⭐
11
Repo to host documentation site for Apache Spark on Kubernetes
Deep Learning Toolkit
⭐
11
Deep Learning Toolkit for Splunk
Spark Serverless
⭐
11
Instant access to the Spark cluster from anywhere
Labtools K8s
⭐
10
Complete data engineering pipeline running on Minikube Kubernetes, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, Airflow, Kafka Strimzi, Datahub, Zeppelin, Jupyter
Hadoop On Kubernetes
⭐
10
hadoop on kubernetes. It contains the configuration of HDFS and Yarn
Big Data Open Os
⭐
10
The definitive open source big data operating system.
Spark Operator
⭐
10
This is now being developed at https://github.com/GoogleCloudPlatform/spark-on-k8
Kyuubi Docker
⭐
9
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Jaeger_exporter
⭐
9
🌀Prometheus Opentracing Jaeger exporter based on Elasticsearch
Roadmap Data Scientist
⭐
9
The basic roadmap to become a data scientist
K8s Spark Scheduler Lib
⭐
9
Kubernetes CRDs and API definitions used by the k8s-spark-scheduler and other related services
Cassandra.lunch
⭐
9
Resources from weekly Zoom lunches revolving around Apache Cassandra and Apache Cassandra-related topics. Hosted by Anant Corporation.
Goto Cassandra Spark
⭐
8
A Spark job that outputs the ranked list of episode to watch based on one preference "keyword". Results of previous searches are stored in Cassandra.
Hsdocker
⭐
8
Hadoop, Spark with Docker in Action
Hadoop Env
⭐
7
Hadoop cluster setup and related helper files for learning purpose.
Spark Integration
⭐
7
Integration tests for Spark. FROZEN: contribute new CI development to Apache Spark upstream
Spark Kubernetes Demo
⭐
7
Spark on Kubernetes for Demo
Aws Etl
⭐
7
This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/data/blob/main/A it's a zipped file with some .csvs inside that we will apply transformations.
Spark On K8s
⭐
7
Presenting 3 ways to run Spark over containers, this project is recommended to those who seek to explore Big Data out of a Hadoop Cluster.
Leo
⭐
6
LEO is an open source tool to industrialise machine learning models
Data.engineers.lunch
⭐
6
Resources from weekly Zoom lunches revolving around Data Engineering. Hosted by Anant Corporation.
Benchmark For Spark
⭐
6
benchmark-for-spark
Jconf 2020
⭐
6
Native Spark Executors on K8s: Diving Into a Data Lake - JConf 2020
Spark Eks
⭐
5
Examples and custom spark images for working with the spark-on-k8s operator on AWS
Alpine Python3 Numpy Pandas Sparkcontainer Spark Submit
⭐
5
Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.
Airflow Dags
⭐
5
Bitcoinparser
⭐
5
Scale-out parsing for the entire bitcoin blockchain in hrs
Spark
⭐
5
Spark On Kubernetes
⭐
5
docker image of spark for k8s
Related Searches
Golang Kubernetes (7,229)
Docker Kubernetes (4,357)
Shell Kubernetes (3,639)
Scala Spark (3,279)
Kubernetes Helm (2,623)
Python Kubernetes (2,446)
Deployment Kubernetes (2,265)
Python Spark (2,053)
Cloud Computing Kubernetes (1,664)
Amazon Web Services Kubernetes (1,645)
1-89 of 89 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.