Awesome Open Source
Awesome Open Source
Combined Topics
data-management
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 262 Data Management Open Source Projects on Github
Categories
>
Data Processing
>
Data Management
Pimcore
⭐
2,247
Open Source Data & Experience Management Platform (PIM, MDM, CDP, DAM, DXP/CMS & Digital Commerce)
Data Forge Ts
⭐
952
The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.
Terraformer
⭐
644
A geographic toolkit for dealing with geometry, geography, formats, and building geo databases
Lazydata
⭐
612
Lazydata: Scalable data dependencies for Python projects
Geometry Api Java
⭐
583
The Esri Geometry API for Java enables developers to write custom applications for analysis of spatial data. This API is used in the Esri GIS Tools for Hadoop and other 3rd-party data processing solutions.
Pointblank
⭐
538
Data validation and organization of metadata for data frames and database tables
Repatch
⭐
518
Dispatch reducers
Koop
⭐
516
🔮 Transform, query, and download geospatial data on the web.
Ccf Deadlines
⭐
501
⏰ CCF recommendation conference Deadline Countdowns / Please star this project, thanks~
Jekyll
⭐
419
Jekyll-based static site for The Programming Historian
Girder
⭐
365
A data management platform for the web, developed by Kitware
Irods
⭐
347
Open Source Data Management Software
Spatial Framework For Hadoop
⭐
310
The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis.
Arcgis Osm Editor
⭐
259
ArcGIS Editor for OpenStreetMap is a toolset for GIS users to access and contribute to OpenStreetMap through their Desktop or Server environment.
Lasio
⭐
254
Python library for reading and writing well data using Log ASCII Standard (LAS) files
Arcgis Rest Js
⭐
253
compact, modular JavaScript wrappers for the ArcGIS REST API
Developer Support
⭐
235
Proof of concept developer code and samples to help be successful with all ArcGIS developer products (Python, NET, JavaScript, Android…). The repository is designed to be an exchange for sharing coding conventions and wisdom to developers at all skill levels.
Fireadmin
⭐
223
Application for Managing Firebase Applications. Includes support for multiple environments and data migrations
Geoportal Server
⭐
202
Geoportal Server is a standards-based, open source product that enables discovery and use of geospatial resources including data and services.
Welly
⭐
188
Well handling
Rucio
⭐
156
Rucio - Scientific Data Management
Vulnerator
⭐
134
The official distribution of the vulnerability parsing utility.
Lerc
⭐
134
Limited Error Raster Compression
Ago Assistant
⭐
126
A swiss army knife for your ArcGIS Online and Portal for ArcGIS accounts
Public Transit Tools
⭐
117
Tools for working with GTFS public transit data in ArcGIS
Linkeddatahub
⭐
115
Data-driven Knowledge Graph management system. Apache license.
Solutions Geoprocessing Toolbox
⭐
114
Models, scripts, and tools for use in ArcGIS Desktop and Server to support defense and intelligence workflows.
Kamu Cli
⭐
97
New generation decentralized data warehouse and streaming data pipeline
File Geodatabase Api
⭐
97
FileGeodatabaseAPI_1.4 (1.4.0.183) The File Geodatabase C++ API for Windows, MacOS and Linux
Conduit
⭐
96
Simplified Data Exchange for HPC Simulations
Nestedtypes
⭐
94
BackboneJS compatibility layer for Type-R data framework.
Optimizerasters
⭐
91
OptimizeRasters is a set of tools for converting raster data to optimized Tiled TIF or MRF files, moving data to cloud storage, and creating Raster Proxies.
Joint Military Symbology Xml
⭐
80
Joint Military Symbology Markup Language is a data encapsulation of MIL-STD-2525D and APP-6(D).
Osfclient
⭐
79
A python library and command-line client for file storage on OSF
Envo
⭐
78
A community-driven ontology for the representation of environments
Signac
⭐
77
Manage large and heterogeneous data spaces on the file system.
Scr
⭐
72
SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability for MPI codes.
Roadmap
⭐
69
DCC/UC3 collaboration for a data management planning tool
Workforce Scripts
⭐
67
A set of scripts to help administer Workforce projects.
Mago3d Cms
⭐
63
mago3D Project
Magento2 Import Export Sample Files
⭐
60
Default Magento 2 CE import / export CSV files & sample files for Firebear Improved Import / Export extension
Terraformer Wkt Parser
⭐
60
Well-Known Text parser for Terraformer
Geoportal Server Catalog
⭐
59
Geoportal Server next generation search application and metadata catalog, based on elasticsearch.
Local Government Desktop Addins
⭐
56
A series of ArcGIS Desktop Add-ins used in the ArcGIS for Local Government editing maps.
Bigquery Data Lineage
⭐
54
Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Syncfast
⭐
53
A clone of rsync in Rust
Collector Tools
⭐
53
A set of python scripts and geoprocessing tools to automate common tasks and workflows in conjunction with Collector for ArcGIS
Crema
⭐
53
Meta data server & client tools for game development
Dswarm
⭐
51
an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
Mdsplus
⭐
48
The MDSplus data management system
Beetle.js
⭐
48
🐞 Javascript ORM, manage your data easily.
Cultivar
⭐
45
Multidimensional data explorer and visualization tool.
Portalpy
⭐
45
A module that allows you to administer Portal for ArcGIS and ArcGIS Online.
Meteor
⭐
44
Meteor is a scalable, easy-to-use, extensible metadata collection framework from the different cloud providers and on-prem sources.
Seek
⭐
40
For finding, sharing and exchanging Data, Models, Simulations and Processes in Science.
Api
⭐
39
Repository for version control of the BrAPI specifications
Mdcs Py
⭐
39
MDCS is an acronym for Mosaic Dataset Configuration Script and is the entry point to a collection of Python classes/libraries that could be consumed by a Python client application to complete a given workflow for creating a mosaic dataset, populating it with data, and setting all required/desired parameters.
Deordie Meetups
⭐
38
DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
Godata
⭐
37
Repository and community of practice for sharing technical resources for Go.Data users and contributors.
Terraformer
⭐
37
A geographic toolkit for dealing with geometry, geography, formats, and building geodatabases
Copernic
⭐
35
Versioned structured data, with change-request mechanic, at scale.
Isacreator
⭐
34
ISAcreator is a Java desktop application which allows for the creation and editing of ISA-Tab files. Originally developed by Eamonn Maguire, with further contributions by Alejandra Gonzalez-Beltran, David Johnson and Philippe Rocca-Serra (Uni. of Oxford).
Solutions Geoevent Java
⭐
33
Custom processors, adapters and transports for geoevent server.
Military Features Data
⭐
30
Source data for Esri defense and intelligence feature templates. This data is used to create features and derived data products using military symbology.
Terraformer Arcgis Parser
⭐
29
Heurist
⭐
28
Core development repository. gitHub: Vsn 6 (2020 - ), Vsn 5 (2018 - 2020), Vsn 4 (2014-2017). Sourceforge: Vsn 3 (2009-2013), Vsn 1 & 2 (2005-2009)
Lc Open Refine
⭐
28
Library Carpentry: OpenRefine
Isa Api
⭐
27
ISA tools API
Geoportal Server Harvester
⭐
27
Next generation harvester for Geoportal Server.
Rdmkit
⭐
25
ELIXIR Data Management Toolkit - Find the answers to your research data management questions here.
Forge Bim360reports
⭐
24
BIM360 project dashboard example: Demonstrates how to extract properties from BIM360 elements and generate a project dashboard
Raster Tiles Compactcache
⭐
24
Compact Cache V2 is used by ArcGIS to store raster tiles. The bundle file structure is very simple and optimized for quick access, resulting in improved performance over alternative formats.
Solution.js
⭐
24
TypeScript wrappers running in Node.js and modern browsers for transferring ArcGIS Online items from one organization to another.
Better Science Code
⭐
23
A presentation on best coding/data management practices based on my own experiences of scientific computing and data analysis and heavily borrowing from the recommendations of many others. View presentation at: https://edeno.github.io/Better-Science-Code
Clowder
⭐
22
This is being migrated to a new github organization to help enable grouping clowder and all related repositories.
Geotrigger Editor
⭐
22
Visual editor for Esri's Geotrigger Service.
Regular
⭐
22
Open-source data management plugin for Autodesk Revit.
Spreadsheet Ecology Lesson
⭐
22
Data Organization in Spreadsheets for Ecologists
Atrocore
⭐
20
AtroCore is an open-source Master Data Management (MDM) software and a platform for Rapid Application Development (RAD). AtroPIM and AtroDAM are based on it.
Tilepackagekreator
⭐
19
Tile Package Kreator
Neurotic
⭐
19
Curate, visualize, annotate, and share your behavioral ephys data using Python
Organization Geospatial
⭐
19
Introduction to Geospatial Concepts
Eav Manager
⭐
19
Blazing fast data modeling and enrichment
Nexus Forge
⭐
17
Building and Using Knowledge Graphs made easy
Openrefine Ecology Lesson
⭐
17
Data Cleaning with OpenRefine for Ecologists
Lc Data Intro
⭐
16
Library Carpentry: Introduction to Working with Data (Regular Expressions)
Datasphere Service
⭐
16
an open source dataworks platform
Gellish
⭐
15
Development of the Gellish Communicator reference application and tools for universal data exchange and data integration supporting Formal English and other Gellish formalized natural languages.
Deordie Digest
⭐
15
Data Engineering Digest
Data Assistant
⭐
14
ArcGIS Pro Add-in that assists in emergency management, local government and state government data aggregation workflows.
Lc Spreadsheets
⭐
13
Tidy data for librarians
Maritime Charting Sample Scripts
⭐
13
Sample scripts and models to automate work in ArcGIS for Maritime: Charting
Design.automation.inventor Csharp Basics
⭐
12
This sample is .NET console app and demostrates how one can process Inventor Assemblies or Parts on Design Automation.
Datadepsgenerators.jl
⭐
12
Utility for developers to help define DataDeps registration blocks, for reusing existing Data with DataDeps.jl
Kun Scheduler
⭐
12
A workflow scheduler understands both your data and metadata.
Raster2gpkg
⭐
11
Python based Geoprocessing tool that loads jpeg or png images to a GeoPackage
Qualmap
⭐
11
R package for working with semi-structured qualitative GIS data
Ago Clone Items
⭐
11
Tools used to clone items between ArcGIS Online and ArcGIS Enterprise organizations.
Catanie
⭐
11
SciCat open data catalogue web client
Bdmi 2019s
⭐
11
Big Data and Machine Intelligence Course in Summer 2019.
1-100 of 262 projects
Next >
Related Projects
Python Data Management Projects (72)
Javascript Data Management Projects (42)
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
