Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for python data flow
data-flow
x
python
x
9 search results found
Pipedream
⭐
7,797
Connect APIs, remarkably fast. Free for developers.
Beam
⭐
7,355
Apache Beam is a unified programming model for Batch and Streaming data processing.
Professional Services
⭐
2,635
Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.
Pyt
⭐
2,005
A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
Botflow
⭐
1,129
Python Fast Dataflow programming framework for Data pipeline work( Web Crawler,Machine Learning,Quantitative Trading.etc)
Minpy
⭐
1,123
NumPy interface with mixed backend execution
Ipyflow
⭐
1,030
A reactive Python kernel for Jupyter notebooks.
Bytewax
⭐
957
Python Stream Processing
Pytm
⭐
801
A Pythonic framework for threat modeling
Nipype
⭐
707
Workflows and interfaces for neuroimaging packages
Conversational Datasets
⭐
678
Large datasets for conversational AI
Task_oriented_dialogue_as_dataflow_synthesis
⭐
251
Code to reproduce experiments in the paper "Task-Oriented Dialogue as Dataflow Synthesis" (TACL 2020).
Pythonflow
⭐
244
🐍 Dataflow programming for python.
Dffml
⭐
235
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Nipyapi
⭐
227
A convenient Python wrapper for Apache NiFi
Pythonect
⭐
187
A general-purpose dataflow programming language based on Python, written in Python
Notebook
⭐
170
我的技术笔记本~
Dataflow
⭐
169
Efficient Data Loading Pipeline in Pure Python
Persimmon
⭐
168
A visual dataflow programming language for sklearn
Tensorflow Recorder
⭐
158
TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.
Dataflowpythonsdk
⭐
157
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
Nn_dataflow
⭐
123
Explore the energy-efficient dataflow scheduling for neural networks.
Eventkit
⭐
119
Event-driven data pipelines
Gcp Variant Transforms
⭐
114
GCP Variant Transforms
Pydra
⭐
110
Pydra Dataflow Engine
Megalista
⭐
109
First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).
Bigflow
⭐
108
A Python framework for data processing on GCP.
Dampr
⭐
101
Python Data Processing library
Dataflow Ops
⭐
97
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
Entangle
⭐
89
A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.
Rapidstream
⭐
85
[FPGA 2022, Best Paper Award] Parallel placement and routing of Vivado HLS dataflow designs.
Dataflow Prediction Example
⭐
73
Simpleflow
⭐
70
Python library for dataflow programming.
Prefect Deployment Patterns
⭐
48
Code examples showing flow deployment to various types of infrastructure
Schedula
⭐
45
A smart function scheduler for dynamic flow-based programming.
Plumbermanager
⭐
39
A helper tool to design CG Pipeline interactive diagrams and data flow documentation
Gae Dataflow
⭐
38
An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.
Resnet50 Pynq
⭐
37
Quantized ResNet50 Dataflow Acceleration on Alveo, with PYNQ
Rr Dataflow
⭐
37
An 'origin' command that continue to the origin of a piece of data in rr
Prefect Dataplatform
⭐
37
Example repository showing how to build a data platform with Prefect, dbt and Snowflake
Resolwe
⭐
34
Open source dataflow engine in Django
Dataflow Contact Center Speech Analysis
⭐
34
Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.
Grizzly
⭐
34
End-to-end DataOps platform deployed by Terraform.
Lazy
⭐
33
Python Library for Lazy Interfaces
Gvprof
⭐
31
GVProf: A Value Profiler for GPU-based Clusters
Thingflow Python
⭐
31
Streaming dataflow library for IoT applications. Program at a higher level, with reusable "things".
Graph Llvm Ir
⭐
30
Visualization of LLVM IR
End To End Machine Learning With Google Cloud
⭐
29
End to End Machine Learning with Google Cloud Platform
Oracle Dataflow Samples
⭐
28
Sample examples Examples demonstrating how to use OCI Data Flow
Interstellar Cnn Scheduler
⭐
27
Tool for optimize CNN blocking
Qt Dataflow
⭐
24
A qt-based dataflow canvas.
Example_dataproc_twitter
⭐
23
This repository is used as source code for the medium post about implementing a Twitter recommender system using GCP.
Dmazerunner
⭐
23
dMazeRunner: Dataflow acceleration optimization infrastructure for coarse-grained programmable accelerators
Pysql Beam
⭐
23
Puma Simulator
⭐
22
[ASPLOS 2019] PUMA-simulator provides a detailed simulation model of a dataflow architecture built with NVM (non-volatile memory), and runs ML models compiled using the puma compiler.
Data Flow Graph
⭐
21
Uses your app logs to visualize how the data moves between the code, database, HTTP services, message queue, external storages etc.
Python Beam Dataflow Cron
⭐
19
Base project for creating Python Apache Beam pipelines and running them in Google DataFlow using CRON scheduler
Question Classification
⭐
19
Question Classification for the dataset UIUC's CogComp QC Dataset - [ http://cogcomp.org/Data/QA/QC/ ].
Rapidstream
⭐
19
[FPGA 2022] Parallel placement and routing of Vivado HLS dataflow designs.
Dragdl
⭐
18
dataflow graph\deep learning\async task
Zounds
⭐
17
Zounds is a dataflow library for building directed acyclic graphs that transform audio. It uses the featureflow library to define the processing pipelines.
Batch Predict
⭐
17
Repository for batch predict
Nuts Flow
⭐
17
A simple dataflow framework in Python
Systolic Array Dataflow Optimizer
⭐
16
A general framework for optimizing DNN dataflow on systolic array
Bzcompute
⭐
14
bzCompute is a computation graph library with built-in support for domain-decomposition and prallel computation. The library can be used for expressing and executing large number of mathematical and text-processing operations using Data-Flow graphs, (Educational version of tensorflow), written in pure python code with numpy support.
Dataflow_launcher
⭐
14
A unified way of launching Dataflow jobs
Ops241
⭐
14
OmniPreSense OPS241 Radar driver
Pglineage
⭐
13
pglineage is a tool to create data flow diagrams for PostgreSQL by analyzing SQL
Count Tokens Hf Datasets
⭐
12
This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Dataflow.
Cop
⭐
11
coroutines for dataflow pipelines
Doublex
⭐
11
Statically Detecting Vulnerable Data Flows in Browser Extensions at Scale
Soda Compiler
⭐
11
Stencil with Optimized Dataflow Architecture Compiler
Serving Model Cards
⭐
11
Collection of OSS models that are containerized into a serving container
Covid 19 Apache Beam Statistics
⭐
10
Statistical processing of COVID-19 data using Apache Beam for Google Cloud Dataflow in Python. Project for the exam of "Sistemi ed Applicazioni Cloud" (2019-20), Magistrale di Ingegneria Informatica at the Dipartimento di Ingegneria Enzo Ferrari.
Prefect Cloud Gcp
⭐
10
Repository template to get started with Prefect Cloud & Google Cloud
Dataflow
⭐
9
This is a preprocessor of Steam price historical data.
Reductus
⭐
9
Web-based, visual dataflow data reduction for neutron scattering instruments
Beam
⭐
9
Unified programming model to create a data processing pipelines for batch and streaming models
Pydflow
⭐
9
Task-parallel computing in Python with dataflow coordination
Vis For Pd
⭐
8
VIS for Pd is a dataflow programming extension for the VIS-Framework.
Turbine
⭐
8
Dataflow Graph Generator
Dataflow Samples
⭐
8
Examples using Google Cloud Dataflow - Apache Beam
Convert Polyai Torch
⭐
8
Pothospython
⭐
7
Python bindings for the Pothos framework
Pipe Template Python
⭐
7
Template for dataflow pipelines using python
Soda
⭐
7
Stencil with Optimized Dataflow Architecture
Spark Streaming Twitter
⭐
7
Building pipeline to process the real-time data using Spark and Mongodb.
Mozart
⭐
7
Custom business logic for Search Ads 360
Apache Beam Dataflow For Public
⭐
6
Dataflow
⭐
6
data feeder using tensorpack.dataflow
Code Snippets
⭐
6
The snippets in this repository support the content in this book.
Dataflow Demo
⭐
5
A demo and thoughts on how dataflow could work
Dsdevent1
⭐
5
Data Science Delhi
Protocol Examples
⭐
5
Examples/skeletons for implementing the FBP protocol
Hotel Ads Etl Tool
⭐
5
Tool to extract information from Hotel Ads API to BigQuery.
Pydata_examples
⭐
5
Materials for speech at PyData in Saint-Petersburg 2018
Py Dataflow
⭐
5
[abandoned] a simple dataflow library for python
Dataflow_template
⭐
5
Python dataflow pipeline
Dataflowsme Python
⭐
5
Dataflowkit
⭐
5
Python Data flow tool, DAG schedular, support real time, in-memory
Related Searches
Python Django (28,897)
Python Machine Learning (20,195)
Python Flask (17,643)
Python Dataset (14,792)
Python Docker (14,113)
Python Tensorflow (13,736)
Python Command Line (13,351)
Python Deep Learning (13,092)
Python Jupyter Notebook (12,976)
Python Network (11,495)
1-9 of 9 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.