Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Data Processing Open Source Projects

Open source projects categorized as Data Processing
Awesome Machine Learning ⭐ 62,402
A curated list of awesome Machine Learning frameworks, libraries and software.
most recent commit 3 months ago
Kiba ⭐ 1,684
Data processing & ETL framework for Ruby
dependent packages 9total releases 11most recent commit a year agorubygems kiba} Downloads
Riko ⭐ 1,573
A Python stream processing engine modeled after Yahoo! Pipes
total releases 59most recent commit 2 years ago
Js Word ⭐ 1,212
✒️ Word Processing Document Library
dependent packages 48total releases 9most recent commit 4 years agonpm word} Downloads
Videoflow ⭐ 953
Python framework that facilitates the quick development of complex video analysis applications and other series-processing based applications in a multiprocessing environment.
total releases 18most recent commit 2 years ago
Js_data ⭐ 588
Data manipulation and processing in JavaScript
most recent commit 5 years ago
Ananas Desktop ⭐ 563
A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.
most recent commit a year ago
Awesome Kafka ⭐ 549
A list about Apache Kafka
most recent commit 7 months ago
Hpcc Platform ⭐ 545
HPCC Systems (High Performance Computing Cluster) is an open source, massive parallel-processing computing platform for big data processing and analytics.
most recent commit 3 months ago
Awesome Point Cloud Processing ⭐ 542
A curated list of awesome Point Cloud Processing Resources, Libraries, Software
most recent commit 2 years ago
Bigdata Ecosystem ⭐ 536
BigData Ecosystem Dataset
most recent commit 6 years ago
Pyrosar ⭐ 449
framework for large-scale SAR satellite data processing
total releases 32most recent commit 3 months ago
Tez ⭐ 446
Apache Tez
most recent commit 3 months ago
Stroom ⭐ 417
Stroom is a highly scalable data storage, processing and analysis platform.
most recent commit 3 months ago
Meza ⭐ 401
A Python toolkit for processing tabular data
dependent packages 4total releases 24most recent commit a year agopypi tabutils} Downloads
Redisgears ⭐ 339
Dynamic execution framework for your Redis data
total releases 1most recent commit 3 months ago
Cylon ⭐ 286
Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
most recent commit 4 months ago
Gemgis ⭐ 234
Spatial data processing for geomodeling
dependent packages 1total releases 29most recent commit 4 months agopypi gemgis} Downloads
Etlbox ⭐ 226
A lightweight ETL (extract, transform, load) library and data integration toolbox for .NET.
most recent commit 2 years ago
Mrgeo ⭐ 194
MrGeo is a geospatial toolkit designed to provide raster-based geospatial capabilities that can be performed at scale. MrGeo is built upon Apache Spark and the Hadoop ecosystem to leverage the storage and processing of hundreds of commodity computers. See the wiki for more details.
total releases 3most recent commit 3 years ago
Sepal ⭐ 191
Geographical Data Processing in the Cloud
most recent commit 3 months ago
Grafter ⭐ 183
Linked Data & RDF Manufacturing Tools in Clojure
total releases 60most recent commit 4 months ago
Dataflows ⭐ 182
DataFlows is a simple, intuitive lightweight framework for building data processing flows in python.
dependent packages 11total releases 127most recent commit 6 months agopypi dataflows} Downloads
The 10 Most Depended On Data Processing Open Source Projects
Catmandu ⭐ 170
Catmandu - a data processing toolkit
dependent packages 86total releases 150latest release November 06, 2023most recent commit 5 months ago
Js Word ⭐ 1,212
:black_nib: Word Processing Document Library
dependent packages 48total releases 9latest release July 21, 2020most recent commit 4 years agonpm word} Downloads
Vmware Go Kcl ⭐ 136
KCL Implementation in Go lang by VMware
dependent packages 20total releases 17latest release March 28, 2023most recent commit a year ago
Plum ⭐ 134
Plum is a data processing pipeline for PHP.
dependent packages 17total releases 6latest release February 17, 2016most recent commit 2 years agopackagist plumphp/plum} Downloads
Dataflows ⭐ 182
DataFlows is a simple, intuitive lightweight framework for building data processing flows in python.
dependent packages 11total releases 127latest release October 11, 2023most recent commit 6 months agopypi dataflows} Downloads
Transformer ⭐ 7
An R package for climate data post-processing (part of the climate4R bundle)
dependent packages 10total releases 2latest release May 18, 2022most recent commit 6 months ago
Kiba ⭐ 1,684
Data processing & ETL framework for Ruby
dependent packages 9total releases 11latest release March 24, 2021most recent commit a year agorubygems kiba} Downloads
Pyusid ⭐ 25
Framework for storing, visualizing, and processing Universal Spectroscopic and Imaging Data (USID)
dependent packages 6total releases 15latest release August 24, 2023most recent commit 3 months agopypi pyUSID} Downloads
Datapackage Pipelines ⭐ 115
Framework for processing data packages in pipelines of modular components.
dependent packages 5total releases 102latest release August 03, 2023most recent commit 9 months agopypi datapackage-pipelines} Downloads
Processor ⭐ 26
A simple and lightweight JavaScript data processing tool. Live demo:
dependent packages 5total releases 5latest release September 13, 2021most recent commit 3 years agonpm @processor/core} Downloads
The 10 Latest Releases In Data Processing Open Source Projects
Zimagi ⭐ 26
Zimagi - Modular Data Integration, Distributed Processing, and API Publishing Platform
total releases 80latest release December 01, 2023most recent commit 3 months ago
Pyrosar ⭐ 449
framework for large-scale SAR satellite data processing
total releases 32latest release November 23, 2023most recent commit 3 months ago
Catmandu ⭐ 170
Catmandu - a data processing toolkit
dependent packages 86total releases 150latest release November 06, 2023most recent commit 5 months ago
Dataflows ⭐ 182
DataFlows is a simple, intuitive lightweight framework for building data processing flows in python.
dependent packages 11total releases 127latest release October 11, 2023most recent commit 6 months agopypi dataflows} Downloads
Data_algebra ⭐ 112
Codd method-chained SQL generator and Pandas data processing in Python.
dependent packages 3total releases 91latest release September 29, 2023most recent commit 6 months agopypi data-algebra} Downloads
Rxn Reaction Preprocessing ⭐ 8
Preprocessing of datasets of chemical reactions: standardization, filtering, augmentation, tokenization, etc.
dependent packages 1total releases 6latest release September 18, 2023most recent commit 7 months agopypi rxn-reaction-preprocessing} Downloads
Podpac ⭐ 43
Pipeline for Observational Data Processing Analysis and Collaboration
total releases 15latest release August 25, 2023most recent commit 4 months ago
Pyusid ⭐ 25
Framework for storing, visualizing, and processing Universal Spectroscopic and Imaging Data (USID)
dependent packages 6total releases 15latest release August 24, 2023most recent commit 3 months agopypi pyUSID} Downloads
Gemgis ⭐ 234
Spatial data processing for geomodeling
dependent packages 1total releases 29latest release August 18, 2023most recent commit 4 months agopypi gemgis} Downloads
Popular Data Storage Categories
Database
Mysql
Redis
Mongodb
Postgresql
Firebase
Elasticsearch
Backup
Sqlite
Archive
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.