Orchest

Build data pipelines, the easy way 🛠️
Alternatives To Orchest
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Prefect12,91511386 hours ago225August 01, 2023565apache-2.0Python
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Tpot9,213402023 days ago61January 06, 2021281lgpl-3.0Python
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
Great_expectations8,855356 hours ago236August 04, 2023143apache-2.0Python
Always know what to expect from your data.
Dagster8,548416 hours ago105September 30, 20222,024apache-2.0Python
An orchestration platform for the development, production, and observation of data assets.
Pachyderm5,979112 hours ago504August 04, 2023882apache-2.0Go
Data-Centric Pipelines and Data Versioning
Mage Ai5,572
6 hours ago278August 08, 2023140apache-2.0Python
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
Orchest3,876
4 months ago19December 13, 2022125apache-2.0TypeScript
Build data pipelines, the easy way 🛠️
Datascienceresources3,826
a month ago20
Open Source Data Science Resources.
Polyaxon3,387412a day ago377August 14, 2023122apache-2.0
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
Pipelines3,29327120 hours ago125July 28, 20231,043apache-2.0Python
Machine Learning Pipelines for Kubeflow
Alternatives To Orchest
Select To Compare


Alternative Project Comparisons
Readme

Notice: we’re no longer actively developing Orchest. We could not find a way to make building a workflow orchestrator commercially viable. Check out Apache Airflow for a robust workflow solution.

Build data pipelines, the easy way 🙌

No frameworks. No YAML. Just write your data processing code directly in Python, R or Julia.

💡 Watch the full narrated video to learn more about building data pipelines in Orchest.

Note: Orchest is in beta.

Features

  • Visually construct pipelines through our user-friendly UI
  • Code in Notebooks and scripts (quickstart)
  • Run any subset of a pipelines directly or periodically (jobs)
  • Easily define your dependencies to run on any machine (environments)
  • Spin up services whose lifetime spans across the entire pipeline run (services)
  • Version your projects using git (projects)

When to use Orchest? Read it in the docs.

👉 Get started with our quickstart tutorial or have a look at our video tutorials explaining some of Orchest's core concepts.

Roadmap

Missing a feature? Have a look at our public roadmap to see what the team is working on in the short and medium term. Still missing it? Please let us know by opening an issue!

Examples

Get started with an example project:

👉 Check out the full list of example projects.

Open in Orchest

Installation

Want to skip the installation and jump right in? Then try out our managed service: Orchest Cloud.

Slack Community

Join our Slack to chat about Orchest, ask questions, and share tips.

Join us on Slack

License

The software in this repository is licensed as follows:

  • All content residing under the orchest-sdk/ and orchest-cli/ directories of this repository are licensed under the Apache-2.0 license as defined in orchest-sdk/LICENSE and orchest-cli/LICENSE respectively.
  • Content outside of the above mentioned directories is available under the AGPL-3.0 license.

Contributing

Contributions are more than welcome! Please see our contributor guides for more details.

Alternatively, you can submit your pipeline to the curated list of Orchest examples that are automatically loaded in every Orchest deployment! 🔥

Contributors

Popular Pipeline Projects
Popular Data Science Projects
Popular Data Processing Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Typescript
Jupyter
Docker
Deployment
Machine Learning
Cloud
Kubernetes
Pipeline
Data Science
Ide
Etl
Self Hosted
Dag
Airflow