Enterprise_gateway
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Docker_practice | 21,934 | 23 days ago | 9 | December 01, 2021 | 4 | Go | ||||
| Learn and understand Docker&Container technologies, with real DevOps practice! | ||||||||||
| Pipeline | 4,140 | 5 months ago | 85 | July 18, 2017 | 1 | apache-2.0 | Jsonnet | |||
| PipelineAI Kubeflow Distribution | ||||||||||
| Spark On K8s Operator | 2,292 | 21 | a day ago | 18 | April 24, 2021 | 455 | apache-2.0 | Go | ||
| Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes. | ||||||||||
| Ballista | 2,244 | 13 | 2 years ago | 4 | May 10, 2020 | apache-2.0 | ||||
| Distributed compute platform implemented in Rust, and powered by Apache Arrow. | ||||||||||
| Spring Boot Quick | 2,152 | 3 days ago | 12 | Java | ||||||
| :herb: 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、k3s、k3d、k8s、mybatis加解密插件、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等:pushpin: | ||||||||||
| Docker Spark | 1,783 | 9 months ago | 36 | Shell | ||||||
| Apache Spark docker image | ||||||||||
| Kyuubi | 1,539 | 5 hours ago | 343 | apache-2.0 | Scala | |||||
| Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses. | ||||||||||
| Seldon Server | 1,420 | 3 years ago | 44 | June 28, 2017 | 26 | apache-2.0 | Java | |||
| Machine Learning Platform and Recommendation Engine built on Kubernetes | ||||||||||
| Dockerfiles | 1,055 | 7 months ago | 15 | mit | Shell | |||||
| 50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak | ||||||||||
| Cube Studio | 1,029 | 7 hours ago | 82 | other | Jupyter Notebook | |||||
| 云原生一站式机器学习平台，多租户，数据资产，notebook在线开发，拖拉拽任务流编排，多机多卡分布式训练，超参搜索，推理服务，多集群调度，多项目组资源组，边缘计算，大模型实时训练, ai应用商店 | ||||||||||
Website | Technical Overview | Installation | System Architecture | Contributing
Jupyter Enterprise Gateway
Jupyter Enterprise Gateway enables Jupyter Notebook to launch remote kernels in a distributed cluster, including Apache Spark managed by YARN, IBM Spectrum Conductor, Kubernetes or Docker Swarm.
It provides out of the box support for the following kernels:
- Python using IPython kernel
- R using IRkernel
- Scala using Apache Toree kernel
Full Documentation for Jupyter Enterprise Gateway can be found here
Jupyter Enterprise Gateway does not manage multiple Jupyter Notebook deployments, for that you should use JupyterHub.
Technical Overview
Jupyter Enterprise Gateway is a web server that provides headless access to Jupyter kernels within an enterprise. Inspired by Jupyter Kernel Gateway, Jupyter Enterprise Gateway provides feature parity with Kernel Gateway's jupyter-websocket mode in addition to the following:
- Adds support for remote kernels hosted throughout the enterprise where kernels can be launched in the following ways: _ Local to the Enterprise Gateway server (today's Kernel Gateway behavior) _ On specific nodes of the cluster utilizing a round-robin algorithm * On nodes identified by an associated resource manager
- Provides support for Apache Spark managed by YARN, IBM Spectrum Conductor, Kubernetes or Docker Swarm out of the box. Others can be configured via Enterprise Gateway's extensible framework.
- Secure communication from the client, through the Enterprise Gateway server, to the kernels
- Multi-tenant capabilities
- Persistent kernel sessions
- Ability to associate profiles consisting of configuration settings to a kernel for a given user (see Project Roadmap)
Installation
Detailed installation instructions are located in the
Users Guide
of the project docs. Here's a quick start using pip:
# install from pypi
pip install --upgrade jupyter_enterprise_gateway
# show all config options
jupyter enterprisegateway --help-all
# run it with default options
jupyter enterprisegateway
Please check the configuration options within the Operators Guide for information about the supported options.
System Architecture
The System Architecture page includes information about Enterprise Gateway's remote kernel, process proxy, and launcher frameworks.
Contributing
The Contribution page includes information about how to contribute to Enterprise Gateway along with our roadmap. While there, you'll want to set up a development environment and check out typical developer tasks.