Awesome Open Source
Awesome Open Source
Combined Topics
data-transformation x

The Top 169 Data Transformation Open Source Projects

Categories > Data Processing > Data Transformation
Glom ⭐ 1,471
☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️
dependent packages 50total releases 21most recent commit 3 months agopypi glom} Downloads
Optimus ⭐ 1,213
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
total releases 26most recent commit 19 days ago
Transformerkit ⭐ 831
A block-based API for NSValueTransformer, with a growing collection of useful examples.
total releases 17most recent commit 2 years ago
Optimus ⭐ 609
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
dependent packages 1total releases 63most recent commit 3 days ago
Porter ⭐ 554
💄 Scalable and durable all-purpose data import abstraction for publishing testable APIs and SDKs.
dependent packages 12total releases 28most recent commit 4 months agopackagist scriptfusion/porter} Downloads
Pglogical ⭐ 543
Logical Replication extension for PostgreSQL 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.
most recent commit 5 months ago
Prose ⭐ 542
Microsoft Program Synthesis using Examples SDK is a framework of technologies for the automatic generation of programs from input-output examples. This repo includes samples and sample data for the Microsoft Program Synthesis using Example SDK.
dependent packages 20total releases 59most recent commit 25 days agonuget Microsoft.ProgramSynthesis.Common} Downloads
Zingg ⭐ 502
Scalable entity resolution, data mastering and deduplication
most recent commit 3 days ago
Collapse ⭐ 363
Advanced and Fast Data Transformation in R
dependent packages 5total releases 23most recent commit 15 hours ago
Sqawk ⭐ 272
Like Awk but with SQL and table joins
most recent commit 9 months ago
Temme ⭐ 258
📄 Concise selector to extract JSON from HTML.
dependent packages 2total releases 20most recent commit a year agonpm temme} Downloads
Graylog Docker ⭐ 256
Official Graylog Docker image
most recent commit 19 days ago
Naas ⭐ 191
⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment
most recent commit 5 days ago
Datagene ⭐ 170
DataGene - Identify How Similar TS Datasets Are to One Another (by @firmai)
total releases 3most recent commit 3 months ago
Sjmisc ⭐ 150
Data transformation and utility functions for R
dependent packages 19total releases 38most recent commit 22 days ago
Scalaml ⭐ 144
Project, source code and data files for 1st edition "Scala for Machine Learning"
most recent commit 6 years ago
Setl ⭐ 136
A simple Spark-powered ETL framework that just works 🍺
total releases 4most recent commit 2 months ago
Big Data Mapreduce Course ⭐ 108
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
most recent commit 3 days ago
Fastverse ⭐ 107
An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R
dependent packages 1total releases 4most recent commit 10 days ago
Cq ⭐ 106
Clojure Command-line Data Processor for JSON, YAML, EDN, XML and more
most recent commit 8 days ago
Dataanim ⭐ 104
R package for visualising data transformation using animations.
most recent commit 3 years ago
Plyranges ⭐ 103
A grammar of genomic data transformation
most recent commit a year ago
Clojure Dsl Resources ⭐ 94
A curated list of Clojure resources for dealing with domain-specific languages.
most recent commit 6 months ago
Allie ⭐ 93
🤖 A machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers).
most recent commit 12 days ago
Maximum Plaid ⭐ 78
Template driven data visualisation for Ember
dependent packages 1total releases 5most recent commit 5 years agonpm maximum-plaid} Downloads
Wrangler ⭐ 61
Wrangler Transform: A DMD system for transforming Big Data
most recent commit 24 days ago
Data Algorithms With Spark ⭐ 60
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
most recent commit 4 days ago
Pycontw2017 ⭐ 59
Files for PyCon TW 2017
most recent commit 2 years ago
Dry Transformer ⭐ 58
Data transformation toolkit
most recent commit a month ago
Transform ⭐ 57
Using io.Reader for data transformation in Go
most recent commit 2 years ago
Aws Dbs Refarch Datalake ⭐ 47
Reference Architectures for Datalakes on AWS
most recent commit 2 years ago
Semantic Bus ⭐ 47
object flow treatment, data transformation
most recent commit 6 days ago
Daany ⭐ 45
Daany - .NET DAta ANalYtics .NET library with the implementation of DataFrame, Time series decompositions and Linear Algebra routines BLASS and LAPACK.
most recent commit 3 months ago
Php Serializer ⭐ 44
Serialize PHP variables, including objects, in any format. Support to unserialize it too.
most recent commit 10 months ago
Foundationsinr ⭐ 44
This repository will contain getting started material with R using the StatsBomb dataset.
most recent commit a year ago
Pipe_envy ⭐ 44
Elixir style pipe operator for Ruby
most recent commit 5 years ago
Gallia Core ⭐ 43
A schema-aware Scala library for data transformation
most recent commit 5 days ago
Typestream ⭐ 39
⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
most recent commit a month ago
Real Time 3d Pose Estimation With Unity3d Public ⭐ 28
most recent commit 3 years ago
Autonomio ⭐ 26
Core functionality for the Autonomio augmented intelligence workbench.
most recent commit 4 years ago
Basic Rotating Machine Vibration Analysis ⭐ 25
These codes realize data transformation and simple data processing for fault diagnosis.
most recent commit 5 years ago
Datapackage M ⭐ 24
Power Query M functions for working with Tabular Data Packages (Frictionless Data) in Power BI and Excel
most recent commit a year ago
Flowman ⭐ 23
Flowman is a Spark based data build tool. By using high level flow specifications with YAML files, Flowman simplifies the development of data pipelines.
most recent commit 4 days ago
Py Responsys ⭐ 23
most recent commit 3 years ago
Serializer ⭐ 21
A PHP serialization component focused on performance
most recent commit 3 years ago
Photon ⭐ 21
Photon is an event store with cold+hot event streaming
most recent commit 5 years ago
Foofah ⭐ 21
Foofah: programming-by-example data transformation program synthesizer
most recent commit 4 years ago
Pycsvw ⭐ 20
A tool to read CSV files with CSVW metadata and transform them into other formats.
most recent commit 3 years ago
Data Lens ⭐ 20
Functional utilities for Common Lisp
most recent commit 2 months ago
Bamboolib_binder_template ⭐ 19
bamboolib - template for creating your own binder notebook
most recent commit 5 months ago
Data Refinery ⭐ 19
Data transformation
most recent commit a year ago
Peer Blender ⭐ 18
Peer assessment-based homework tool
most recent commit 4 years ago
Field_mapper ⭐ 17
Data mapping & transformation
most recent commit 2 years ago
Glide ⭐ 17
Easy ETL
most recent commit 24 days ago
Ldwizard ⭐ 16
A generic framework for simplifying the creation of linked data.
most recent commit a year ago
Object Mapper ⭐ 15
Maps generically data from source to target object via extensible strategies and controls
most recent commit 5 months ago
Serializer Benchmark ⭐ 13
A PHP benchmark application to compare PHP serializer libraries
most recent commit 2 years ago
Tutorials ⭐ 13
Short programming tutorials pertaining to data analysis.
most recent commit 5 years ago
Richflow ⭐ 13
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
most recent commit 5 years ago
Houston ⭐ 12
Houston is a data transformation and synchronization framework that has support baked in for pulling and pushing data to and from other services, a sophisticated job queue for fault tolerance, and a parent child model that make complex data structures easier to work with across systems
most recent commit 10 years ago
Dynamic.yaml ⭐ 12
DEPRECATED: YAML-based data transformations
most recent commit 3 years ago
Pipeline ⭐ 11
support for asynchronous networking and data transformation
most recent commit 7 years ago
Vue Models ⭐ 11
Backbone inspired plugin for handling models in Vue.js with built-in serialization
most recent commit 4 years ago
Python Pipefitter ⭐ 11
The SAS pipefitter package provides a Python API for developing pipelines for data transformation and model fitting as stages of a repeatable machine learning workflow in either SAS v9 or SAS Viya.
most recent commit a year ago
Java8 ⭐ 10
Java 8 features
most recent commit 9 months ago
Hk Atm Locator ⭐ 10
🏧 香港自動櫃員機定位器 🏧 Centralising Automated Teller Machine (ATM) Data in Hong Kong in a well-defined yet standardised format and display in a web portal for public use
most recent commit a year ago
Swallow ⭐ 9
Python framework for data transformation
most recent commit 5 years ago
Scrape ⭐ 9
When you need those jobs hypersonic 🚀 scrape 🔪
most recent commit 2 years ago
Sparqlist ⭐ 9
SPARQList: Repository server for working SPARQL snippets
most recent commit 3 months ago
Svizzle ⭐ 9
Svelte components for data visualisation and utilities for data transformation.
most recent commit a month ago
Purescript Morello ⭐ 9
Cherry-picking 🍒 for your data
most recent commit 8 days ago
Transformer ⭐ 8
A few JavaScript one-liners for rapid data transformation.
most recent commit 2 months ago
Datapipe ⭐ 8
dataPipe is a data processing and data analytics library for JavaScript. Inspired by LINQ (C#) and Pandas (Python)
most recent commit 21 hours ago
Apipage ⭐ 7
API Frontend Page
most recent commit 8 years ago
Index Array By ⭐ 7
A utility function to index arrays by any criteria
most recent commit 3 months ago
Sqltask ⭐ 7
ETL tool for performing mostly SQL-based data transformation
most recent commit 2 years ago
Vscode Atlasmap ⭐ 7
VS Code plugins providing Atlasmap tooling
most recent commit 13 days ago
I2o Transform ⭐ 7
PCORnet Ontology to OMOP - beta!
most recent commit a year ago
Dbingestor ⭐ 6
This library provides wrappers to data ingestion into various DB systems, such as MySQL, SQLite3, and ODBC compatible systems. You can use this C++ library to ingest data in any format (you need to implement the reading routines though). The library provides an ingestion buffer that allows for multiple rows to be ingested at one time. This greatly improves ingestion performance. Further assertion and conversion functions are provided for elementary data transformation and processing. These can e
most recent commit 7 years ago
Geolatte Common ⭐ 6
Basic components for spatial data handling and processing in Java
most recent commit 3 years ago
R_programming_for_research ⭐ 6
R Programming for Research workshop outline and materials
most recent commit 3 years ago
Object Model Transform ⭐ 6
Transforms objects and its object property into model.
most recent commit 4 years ago
Dlpipelines.jl ⭐ 5
Interfaces for deep learning data pipelines.
most recent commit 2 months ago
Select Prism ⭐ 5
Use a Monocle Prism to handle <select> conflict between ADTs and Strings
most recent commit a year ago
Mxt ⭐ 4
Endpoint proxy for data transformation.
most recent commit 3 years ago
Datapackage Connector ⭐ 4
Power BI Custom Connector for loading tables directly from Tabular Data Packages (Frictionless Data) into Power BI
most recent commit 2 years ago
Rds R ⭐ 4
R package to simplify the usage of the RDS REST API and provide convenience in accessing data and metadata.
most recent commit a month ago
Visualizertransformation ⭐ 4
Create a gif animation for data transformation
most recent commit 2 years ago
Dtrans ⭐ 4
Erlang data-transformation and validation micro library
most recent commit 3 years ago
Exchange Rate App Project ⭐ 4
most recent commit 4 years ago
Gson Relationship ⭐ 4
Transform json-data using relational concepts
most recent commit 4 years ago
Pipeline ⭐ 4
Monadic workflow for Clojure apps
most recent commit 5 years ago
Fao Explorer ⭐ 4
Tools to better understand the UN FAO API
most recent commit 8 years ago
Calendar Shaper ⭐ 3
🗓️ iCalendar proxy reshaping the data for your needs
most recent commit 2 years ago
Lib Rest Client Common ⭐ 3
Generic library for RESTful API clients
most recent commit a year ago
Dataremix ⭐ 3
A universal data transformation for optimal inference from gene expression datasets
most recent commit 2 years ago
Cuphic ⭐ 3
Transform or scrape Hiccup with a declarative DSL.
most recent commit 5 months ago
Youtube8m_tools ⭐ 3
Convert feature.pb to yt8m style tfrecord
most recent commit 2 years ago
Rds Js Examples ⭐ 3
TypeScript/JavaScript example code using the RDS API
most recent commit 9 months ago
Net.jgp.books.spark.ch14 ⭐ 3
Spark in Action, 2nd edition - chapter 14 - extending data transformation with UDFs
most recent commit 6 months ago
1-100 of 169 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,048,155)
Python  (795,553)
Java  (385,224)
Php  (284,521)
Typescript  (239,356)
C Plus Plus  (236,046)
Ruby  (221,670)
C  (180,299)
Shell  (169,497)
C Sharp  (161,951)
Golang  (155,958)
Swift  (64,667)
R  (57,207)
Objective C  (57,164)
Rust  (56,024)
Dart  (51,410)
Kotlin  (45,460)
Lua  (33,255)
Matlab  (30,870)
Perl  (30,487)
Language  (30,081)
Scala  (28,602)
Haskell  (20,247)
Clojure  (19,069)
Powershell  (18,797)
Bash  (18,598)
Coffeescript  (17,331)
Elixir  (16,568)
Assembly  (14,523)
Processing  (13,294)
Julia  (12,526)
Basic  (10,765)
Flow  (10,523)
Emacs Lisp  (10,359)
Erlang  (9,059)
Scheme  (8,437)
Groovy  (8,425)
Solidity  (7,589)
Ocaml  (6,662)
Pascal  (6,380)
Hack  (6,361)
Lisp  (6,339)
Fortran  (5,479)
Elm  (5,476)
Common Lisp  (5,280)
Dlang  (4,745)
Shell Script  (4,627)
Python Library  (4,446)
Crystal  (4,375)
Scripting  (4,203)
Top Projects
Freecodecamp ⭐ 346,198
996.icu ⭐ 262,320
Free Programming Books ⭐ 233,248
Coding Interview University ⭐ 219,849
Awesome ⭐ 202,059
Vue ⭐ 196,084
Developer Roadmap ⭐ 195,103
Public Apis ⭐ 192,610
React ⭐ 188,215
System Design Primer ⭐ 180,789
Tensorflow ⭐ 165,032
Bootstrap ⭐ 157,385
You Dont Know Js ⭐ 153,649
Cs Notes ⭐ 150,780
Ohmyzsh ⭐ 145,307
Build Your Own X ⭐ 141,474
Flutter ⭐ 140,820
Javascript Algorithms ⭐ 140,055
Python ⭐ 136,184
Gitignore ⭐ 133,164
Linux ⭐ 132,031
Vscode ⭐ 131,926
Awesome Python ⭐ 127,528
Javascript ⭐ 122,717
Javaguide ⭐ 121,571
Python 100 Days ⭐ 117,585
Computer Science ⭐ 113,544
Youtube Dl ⭐ 110,101
Fucking Algorithm ⭐ 106,048
The Art Of Command Line ⭐ 105,874
React Native ⭐ 102,820
Electron ⭐ 101,768
D3 ⭐ 100,901
Go ⭐ 99,356
30 Seconds Of Code ⭐ 95,528
Create React App ⭐ 95,100
Axios ⭐ 93,451
Awesome Selfhosted ⭐ 88,918
Kubernetes ⭐ 88,595
Free Programming Books Zh_cn ⭐ 88,386
Node ⭐ 87,741
Next.js ⭐ 86,967
Terminal ⭐ 83,189
Deno ⭐ 82,536
Three.js ⭐ 82,109
Angular ⭐ 81,451
Awesome Go ⭐ 80,899
Typescript ⭐ 80,758
Ant Design ⭐ 80,375
Material Ui ⭐ 78,529
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.