Awesome Open Source
Awesome Open Source
Combined Topics
data-management
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 271 Data Management Open Source Projects on Github
Categories
>
Data Processing
>
Data Management
Pimcore
⭐
2,393
Open Source Data & Experience Management Platform (PIM, MDM, CDP, DAM, DXP/CMS & Digital Commerce)
Ccf Deadlines
⭐
1,108
⏰ CCF recommendation conference Deadline Countdowns / Please star this project, thanks~
Data Forge Ts
⭐
1,057
The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.
Terraformer
⭐
644
A geographic toolkit for dealing with geometry, geography, formats, and building geo databases
Lazydata
⭐
612
Lazydata: Scalable data dependencies for Python projects
Pointblank
⭐
586
Data quality assessment and metadata reporting for data frames and database tables
Geometry Api Java
⭐
583
The Esri Geometry API for Java enables developers to write custom applications for analysis of spatial data. This API is used in the Esri GIS Tools for Hadoop and other 3rd-party data processing solutions.
Koop
⭐
525
🔮 Transform, query, and download geospatial data on the web.
Repatch
⭐
518
Dispatch reducers
Jekyll
⭐
443
Jekyll-based static site for The Programming Historian
Girder
⭐
378
A data management platform for the web, developed by Kitware
Irods
⭐
363
Open Source Data Management Software
Spatial Framework For Hadoop
⭐
326
The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis.
Lasio
⭐
268
Python library for reading and writing well data using Log ASCII Standard (LAS) files
Arcgis Rest Js
⭐
262
compact, modular JavaScript wrappers for the ArcGIS REST API
Arcgis Osm Editor
⭐
259
ArcGIS Editor for OpenStreetMap is a toolset for GIS users to access and contribute to OpenStreetMap through their Desktop or Server environment.
Developer Support
⭐
235
Proof of concept developer code and samples to help be successful with all ArcGIS developer products (Python, NET, JavaScript, Android…). The repository is designed to be an exchange for sharing coding conventions and wisdom to developers at all skill levels.
Fireadmin
⭐
233
Application for Managing Firebase Applications. Includes support for multiple environments and data migrations
Geoportal Server
⭐
221
Geoportal Server is a standards-based, open source product that enables discovery and use of geospatial resources including data and services.
Welly
⭐
211
Well handling
Rucio
⭐
164
Rucio - Scientific Data Management
Vulnerator
⭐
163
The official distribution of the vulnerability parsing utility.
Lerc
⭐
149
Limited Error Raster Compression
Kamu Cli
⭐
140
New generation decentralized data warehouse and streaming data pipeline
Linkeddatahub
⭐
139
Data-driven Knowledge Graph management system. Apache license.
Ago Assistant
⭐
126
A swiss army knife for your ArcGIS Online and Portal for ArcGIS accounts
Public Transit Tools
⭐
120
Tools for working with GTFS public transit data in ArcGIS
Solutions Geoprocessing Toolbox
⭐
114
Models, scripts, and tools for use in ArcGIS Desktop and Server to support defense and intelligence workflows.
Conduit
⭐
107
Simplified Data Exchange for HPC Simulations
File Geodatabase Api
⭐
97
FileGeodatabaseAPI_1.4 (1.4.0.183) The File Geodatabase C++ API for Windows, MacOS and Linux
Optimizerasters
⭐
94
OptimizeRasters is a set of tools for converting raster data to optimized Tiled TIF or MRF files, moving data to cloud storage, and creating Raster Proxies.
Nestedtypes
⭐
94
BackboneJS compatibility layer for Type-R data framework.
Envo
⭐
88
A community-driven ontology for the representation of environments
Signac
⭐
84
Manage large and heterogeneous data spaces on the file system.
Joint Military Symbology Xml
⭐
80
Joint Military Symbology Markup Language is a data encapsulation of MIL-STD-2525D and APP-6(D).
Osfclient
⭐
79
A python library and command-line client for file storage on OSF
Magento2 Import Export Sample Files
⭐
78
Default Magento 2 CE import / export CSV files & sample files for Firebear Improved Import / Export extension
Bigquery Data Lineage
⭐
74
Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Scr
⭐
73
SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability for MPI codes.
Roadmap
⭐
69
DCC/UC3 collaboration for a data management planning tool
Workforce Scripts
⭐
68
A set of scripts to help administer Workforce projects.
Meteor
⭐
64
Meteor is an easy-to-use, plugin-driven metadata collection framework to extract data from different sources and sink to any data catalog.
Mago3d Cms
⭐
63
mago3D Project
Geoportal Server Catalog
⭐
62
Geoportal Server next generation search application and metadata catalog, based on elasticsearch.
Terraformer Wkt Parser
⭐
60
Well-Known Text parser for Terraformer
Syncfast
⭐
57
A clone of rsync in Rust
Local Government Desktop Addins
⭐
56
A series of ArcGIS Desktop Add-ins used in the ArcGIS for Local Government editing maps.
Crema
⭐
53
Meta data server & client tools for game development
Collector Tools
⭐
53
A set of python scripts and geoprocessing tools to automate common tasks and workflows in conjunction with Collector for ArcGIS
Dswarm
⭐
51
an open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
Mdsplus
⭐
50
The MDSplus data management system
Terraformer
⭐
48
A geographic toolkit for dealing with geometry, geography, formats, and building geodatabases
Beetle.js
⭐
48
🐞 Javascript ORM, manage your data easily.
Seek
⭐
46
For finding, sharing and exchanging Data, Models, Simulations and Processes in Science.
Cultivar
⭐
45
Multidimensional data explorer and visualization tool.
Dgp
⭐
45
ML Dataset Governance Policy for Autonomous Vehicle Datasets
Mdcs Py
⭐
45
MDCS is an acronym for Mosaic Dataset Configuration Script and is the entry point to a collection of Python classes/libraries that could be consumed by a Python client application to complete a given workflow for creating a mosaic dataset, populating it with data, and setting all required/desired parameters.
Portalpy
⭐
45
A module that allows you to administer Portal for ArcGIS and ArcGIS Online.
Rdmkit
⭐
44
ELIXIR Data Management Toolkit - Find the answers to your research data management questions here.
Godata
⭐
43
Repository and community of practice for sharing technical resources for Go.Data users and contributors.
Deordie Meetups
⭐
42
DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
Brapi
⭐
40
Repository for version control of the BrAPI specifications
Isacreator
⭐
34
ISAcreator is a Java desktop application which allows for the creation and editing of ISA-Tab files. Originally developed by Eamonn Maguire, with further contributions by Alejandra Gonzalez-Beltran, David Johnson and Philippe Rocca-Serra (Uni. of Oxford).
Lc Open Refine
⭐
33
Library Carpentry: OpenRefine
Solutions Geoevent Java
⭐
33
Custom processors, adapters and transports for geoevent server.
Heurist
⭐
31
Core development repository. gitHub: Vsn 6 (2020 - ), Vsn 5 (2018 - 2020), Vsn 4 (2014-2017). Sourceforge: Vsn 3 (2009-2013), Vsn 1 & 2 (2005-2009)
Military Features Data
⭐
30
Source data for Esri defense and intelligence feature templates. This data is used to create features and derived data products using military symbology.
Atrocore
⭐
29
AtroCore is an open-source Data Platform, Data Management and Master Data Management (MDM) software, which can be used to quickly create any business application.
Terraformer Arcgis Parser
⭐
29
Isa Api
⭐
28
ISA tools API
Geoportal Server Harvester
⭐
27
Next generation harvester for Geoportal Server.
Solution.js
⭐
26
TypeScript wrappers running in Node.js and modern browsers for transferring ArcGIS Online items from one organization to another.
Spreadsheet Ecology Lesson
⭐
25
Data Organization in Spreadsheets for Ecologists
Raster Tiles Compactcache
⭐
24
Compact Cache V2 is used by ArcGIS to store raster tiles. The bundle file structure is very simple and optimized for quick access, resulting in improved performance over alternative formats.
Forge Bim360reports
⭐
24
BIM360 project dashboard example: Demonstrates how to extract properties from BIM360 elements and generate a project dashboard
Data Importer
⭐
23
The Firefly III Data Importer can import data into Firefly III
Better Science Code
⭐
23
A presentation on best coding/data management practices based on my own experiences of scientific computing and data analysis and heavily borrowing from the recommendations of many others. View presentation at: https://edeno.github.io/Better-Science-Code
Organization Geospatial
⭐
23
Introduction to Geospatial Concepts
Vba Csv Interface
⭐
23
The most powerful and comprehensive CSV/TSV/DSV data management library for VBA, providing parsing/writing capabilities compliant with RFC-4180 specifications and a complete set of tools for manipulating records and fields.
Geotrigger Editor
⭐
22
Visual editor for Esri's Geotrigger Service.
Regular
⭐
22
Open-source data management plugin for Autodesk Revit.
Tilepackagekreator
⭐
21
Tile Package Kreator
Kun Scheduler
⭐
21
A workflow scheduler understands both your data and metadata.
Nexus Forge
⭐
20
Building and Using Knowledge Graphs made easy
Neurotic
⭐
19
Curate, visualize, annotate, and share your behavioral ephys data using Python
Openrefine Ecology Lesson
⭐
19
Data Cleaning with OpenRefine for Ecologists
Eav Manager
⭐
19
Blazing fast data modeling and enrichment
Datasphere Service
⭐
16
an open source dataworks platform
Lc Data Intro
⭐
16
Library Carpentry: Introduction to Working with Data (Regular Expressions)
Gellish
⭐
15
Development of the Gellish Communicator reference application and tools for universal data exchange and data integration supporting Formal English and other Gellish formalized natural languages.
Fate Flow
⭐
15
Solution for deploying and managing end-to-end federated learning workflows
Whyqd
⭐
15
data wrangling simplicity, complete audit transparency, and at speed
Deordie Digest
⭐
15
Data Engineering Digest
Data Assistant
⭐
14
ArcGIS Pro Add-in that assists in emergency management, local government and state government data aggregation workflows.
Maritime Charting Sample Scripts
⭐
13
Sample scripts and models to automate work in ArcGIS for Maritime: Charting
Lc Spreadsheets
⭐
13
Tidy data for librarians
Design.automation.inventor Csharp Basics
⭐
12
This sample is .NET console app and demostrates how one can process Inventor Assemblies or Parts on Design Automation.
Datadepsgenerators.jl
⭐
12
Utility for developers to help define DataDeps registration blocks, for reusing existing Data with DataDeps.jl
Spreadsheets Socialsci
⭐
12
Data Organization in Spreadsheets for Social Scientists
Organization Genomics
⭐
12
Project Organization and Management for Genomics
1-100 of 271 projects
Next >
Related Projects
Python Data Management Projects (77)
Javascript Data Management Projects (43)
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
