Awesome Open Source

Programming Languages

Search results for python pipeline

2,593 search results found

Jina ⭐ 19,097

☁️ Build multimodal AI applications with cloud-native stack

Luigi ⭐ 16,786

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Prefect ⭐ 12,850

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

Airbyte ⭐ 11,796

Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

Great_expectations ⭐ 8,785

Always know what to expect from your data.

Kedro ⭐ 8,692

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Dagster ⭐ 8,497

An orchestration platform for the development, production, and observation of data assets.

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stanza ⭐ 6,781

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Awesome Pipeline ⭐ 5,565

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

Mage Ai ⭐ 5,527

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

Papermill ⭐ 5,256

📚 Parameterize, execute, and analyze notebooks

Build powerful pipelines in any programming language.

Clearml ⭐ 4,729

ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management

Orchest ⭐ 3,876

Build data pipelines, the easy way 🛠️

Datascienceresources ⭐ 3,826

Open Source Data Science Resources.

Pipelines ⭐ 3,290

Machine Learning Pipelines for Kubeflow

Ploomber ⭐ 3,164

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

Zenml ⭐ 3,045

ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.

Opensfm ⭐ 3,021

Open source Structure-from-Motion pipeline

Hmmlearn ⭐ 2,823

Hidden Markov Models in Python, with scikit-learn like API

Towhee ⭐ 2,657

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Professional Services ⭐ 2,572

Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.

Jenkins Zero To Hero ⭐ 2,343

Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.

Pyfunctional ⭐ 2,218

Python library for creating data pipelines with chain functional programming

Blenderproc ⭐ 2,209

A procedural Blender pipeline for photorealistic training image generation

Mara Pipelines ⭐ 2,019

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

TFX is an end-to-end platform for deploying production ML pipelines

Zero_nlp ⭐ 1,874

中文nlp解决方案(大模型、数据、模型、训练、推理)

Elyra ⭐ 1,652

Elyra extends JupyterLab with an AI centric approach.

Automl Gs ⭐ 1,642

Provide an input CSV and a target field to predict, generate a model + code to run it.

Scispacy ⭐ 1,479

A full spaCy pipeline and models for scientific/biomedical documents.

Django Pipeline ⭐ 1,474

Pipeline is an asset packaging library for Django.

Mleap ⭐ 1,474

MLeap: Deploy ML Pipelines to Production

Pytorch Toolbelt ⭐ 1,418

PyTorch extensions for fast R&D prototyping and Kaggle farming

Pypeln ⭐ 1,412

Concurrent data pipelines in Python >>>

Mlbox ⭐ 1,403

MLBox is a powerful Automated Machine Learning python library.

Transcoder ⭐ 1,360

Public release of the TransCoder research project https://arxiv.org/pdf/2006.03511.pdf

Roadtools ⭐ 1,341

A collection of Azure AD tools for offensive and defensive security purposes

Deepnlp ⭐ 1,311

Deep Learning NLP Pipeline implemented on Tensorflow

Pyslam ⭐ 1,299

pySLAM contains a monocular Visual Odometry (VO) pipeline in Python. It supports many modern local features based on Deep Learning.

Meltano ⭐ 1,186

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Galaxy ⭐ 1,153

Data intensive science for everyone.

Deepstream_python_apps ⭐ 1,137

DeepStream SDK Python bindings and sample applications

TODS: An Automated Time-series Outlier Detection System

Saas Boilerplate ⭐ 1,066

SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!

Mlrun ⭐ 1,066

Machine Learning automation and tracking

Deepaudioclassification ⭐ 983

Finding the genre of a song with Deep Learning

Bk Sops ⭐ 945

蓝鲸智云标准运维(SOPS)

Renderpipeline ⭐ 929

Physically Based Shading and Deferred Rendering for the Panda3D game engine

Sematic ⭐ 877

An open-source ML pipeline development platform

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Serving ⭐ 772

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

Lightautoml ⭐ 769

LAMA - automatic model creation framework

Paradedb ⭐ 762

PostgreSQL for Search

Syntax_sugar_python ⭐ 730

A library adding some anti-Pythonic syntatic sugar to Python

Sqlmesh ⭐ 720

SQLMesh is a data transformation framework that brings the benefits of DevOps to data teams. It enables data scientists, analysts, and engineers to efficiently run and deploy data transformations written in SQL or Python.

Framework for large distributed pipelines

Smarter data pipelines for audio.

Spacy Stanza ⭐ 677

💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy

Sklearn2pmml ⭐ 663

Python library for converting Scikit-Learn pipelines to PMML

EvalML is an AutoML library written in python.

Openisp ⭐ 633

Image Signal Processor

Turns Data and AI algorithms into full web applications in no time.

Houdini ⭐ 627

Houdini pipeline and learning database

Tools to download and cleanup Common Crawl data

Goodreads_etl_pipeline ⭐ 593

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Trankit ⭐ 581

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

A graph-based functional API for building complex scikit-learn pipelines.

Image_pipeline ⭐ 569

An image processing pipeline for ROS.

Devsecopsguideline ⭐ 567

The OWASP DevSecOps Guideline can help us to embedding security as a part of the development pipeline.

Socorro ⭐ 566

Socorro is the Mozilla crash ingestion pipeline. It accepts and processes Breakpad-style crash reports. It provides analysis tools.

React Python ⭐ 563

Python bridge to JSX & the React JavaScript library.

Pylivetrader ⭐ 563

Python live trade execution library with zipline interface.

Paddleocr2pytorch ⭐ 553

PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/Paddle

Monk_object_detection ⭐ 550

A one-stop repository for low-code easily-installable object detection pipelines.

Open Bandit Pipeline: a python library for bandit algorithms and off-policy evaluation

Python Opengl ⭐ 538

An open access book on Python, OpenGL and Scientific Visualization, Nicolas P. Rougier, 2018

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

Neuraxle ⭐ 533

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.

Kubeflow’s superfood for Data Scientists

Vehicle Detection ⭐ 509

Created vehicle detection pipeline with two approaches: (1) deep neural networks (YOLO framework) and (2) support vector machines ( OpenCV + HOG).

Covalent ⭐ 505

Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.

Data Pipelines With Apache Airflow ⭐ 503

Code for Data Pipelines with Apache Airflow

Powerful Python pipelines for your shell

Pipelinec ⭐ 480

A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.

Torchgpipe ⭐ 479

A GPipe implementation in PyTorch

Openfda ⭐ 471

openFDA is a research project to provide open APIs, raw data downloads, documentation and examples, and a developer community for an important collection of FDA public datasets.

Sklearn Onnx ⭐ 457

Convert scikit-learn models and pipelines to ONNX

Open Solution Home Credit ⭐ 440

Open solution to the Home Credit Default Risk challenge 🏡

Whispers ⭐ 437

Identify hardcoded secrets in static structured text

Copy number variant detection from targeted DNA sequencing

Wordbatch ⭐ 413

Python library for distributed AI processing pipelines, using swappable scheduler backends.

Aspect Based Sentiment Analysis ⭐ 413

💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)

Singlehdr ⭐ 385

[CVPR 2020] Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline

Model Card Toolkit ⭐ 381

A toolkit that streamlines and automates the generation of model cards

Megflow ⭐ 380

Efficient ML solution for long-tailed demands.

Recon Pipeline ⭐ 374

An automated target reconnaissance pipeline.

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Pytorch (17,863)

Python Jupyter Notebook (17,055)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Javascript Python (10,214)

Python Database (10,072)

Python Natural Language Processing (8,742)

1-100 of 2,593 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2023 Awesome Open Source. All rights reserved.