Awesome Open Source

Programming Languages

Search results for pipeline data processing

data-processing x

23 search results found

Numaflow ⭐ 866

Kubernetes-native platform to run massively parallel data/streaming jobs

Dataflowjavasdk ⭐ 853

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

Fondant ⭐ 293

Production-ready data processing made easy and shareable

Forte is a flexible and powerful ML workflow builder. This is part of the CASL project: http://casl-project.ai/

Batchflow ⭐ 195

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Dolphinnext ⭐ 92

A graphical user interface for distributed data processing of high throughput genomics

Breast Cancer Risk Prediction ⭐ 83

Classification of Breast Cancer diagnosis Using Support Vector Machines

Sentieon Scripts ⭐ 53

Helper scripts for biological data processing from Sentieon

Five Dollar Genome Analysis Pipeline ⭐ 40

Workflows used for WGS data processing -- replaced by https://github.com/gatk-workflows/gatk4-genome-pro

Barnard59 ⭐ 20

An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.

Cdp Backend ⭐ 20

Data storage utilities and processing pipelines used by CDP instances.

Kahpp Oss ⭐ 18

Kafka Streams made easy with a YAML file

Baleen 3 is a data processing tool based on the Annot8 framework

Smartpipeline ⭐ 16

A framework for rapid development of robust data pipelines following a simple design pattern

Sparklanes ⭐ 16

A lightweight data processing framework for Apache Spark

Querido Diario Data Processing ⭐ 15

Text processing repository to free brazilian municipal gazettes from closed file formats for the Querido Diário project.

Go library to create and manage data pipelines on your machine

A simplistic, general purpose pipeline framework.

Simple functional pipes

Connectome ⭐ 10

A library for datasets containing heterogeneous data

Panoptes Pipeline ⭐ 10

PANOPTES Data Processing Pipeline

Extraction pipeline and analysis tools for Aperture Masking Interferometry mode of the last generation of instruments (ground-based and space).

Pipelines for Modern C++

A modular, containerized pipeline for PRO-seq data processing

Create simple flows based on user-defined filters (data stream processing).

Tictactube ⭐ 7

A versatile pipelining library created with media organization in mind.

Core part of pipes framework plus some commonly used extensions

Asynchronous Processing Pipeline

Chip Seq Pipeline ⭐ 5

A pipeline of ChIP-Seq raw data processing and downstream analysis

Stormdrain ⭐ 5

Pipeline for evented multidimensional data processing

Microcore ⭐ 5

Core library for simple creation of pipelinening microservices in Node.js with RabbitMQ

IRDAP is a highly-automated end-to-end pipeline to reduce SPHERE-IRDIS polarimetric data

Related Searches

Python Pipeline (4,279)

Javascript Pipeline (1,369)

Pipeline Jenkins (1,150)

Shell Pipeline (1,143)

Docker Pipeline (1,018)

Jupyter Notebook Pipeline (976)

Java Pipeline (868)

1-23 of 23 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.