Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Sheetjs | 33,584 | 4,379 | 3,816 | 2 months ago | 170 | March 24, 2022 | 129 | apache-2.0 | JavaScript | |
📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs | ||||||||||
Yq | 9,407 | 70 | 4 days ago | 126 | July 12, 2023 | 96 | mit | Go | ||
yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor | ||||||||||
Fq | 8,886 | 2 days ago | 104 | July 07, 2023 | 45 | other | Go | |||
jq for binary formats - tool, language and decoders for working with binary and text formats | ||||||||||
Refit | 7,518 | 178 | 730 | a day ago | 72 | June 29, 2023 | 168 | mit | C# | |
The automatic type-safe REST library for .NET Core, Xamarin and .NET. Heavily inspired by Square's Retrofit library, Refit turns your REST API into a live interface. | ||||||||||
Poco | 7,343 | 1 | 5 days ago | 8 | November 02, 2022 | 281 | other | C | ||
The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems. | ||||||||||
Structured Text Tools | 6,757 | 3 days ago | 3 | |||||||
A list of command line tools for manipulating structured text data | ||||||||||
Rest Assured | 6,515 | 7,364 | 481 | 6 days ago | 32 | June 16, 2023 | 527 | apache-2.0 | Java | |
Java DSL for easy testing of REST services | ||||||||||
Countries | 5,795 | 399 | 100 | 4 days ago | 21 | April 04, 2020 | 18 | odbl-1.0 | PHP | |
World countries in JSON, CSV, XML and Yaml. Any help is welcome! | ||||||||||
Wiremock | 5,738 | 1,626 | 794 | 15 hours ago | 114 | June 15, 2023 | 337 | apache-2.0 | Java | |
A tool for mocking HTTP services | ||||||||||
Countries States Cities Database | 5,483 | 3 days ago | 68 | odbl-1.0 | PHP | |||||
🌍 Discover our global repository of countries, states, and cities! 🏙️ Get comprehensive data in JSON, SQL, XML, YAML, and CSV formats. Access ISO2, ISO3 codes, country code, capital, native language, timezones (for countries), and more. #countries #states #cities |
Omniparser is a native Golang ETL parser that ingests input data of various formats (CSV, txt, fixed length/width, XML, EDI/X12/EDIFACT, JSON, and custom formats) in streaming fashion and transforms data into desired JSON output based on a schema written in JSON.
Min Golang Version: 1.14
Omniparser is publicly available under MIT License. Individual and corporate sponsorships are welcome and gratefully appreciated, and will be listed in the SPONSORS page. Company-level sponsors get additional benefits and supports granted in the COMPANY LICENSE.
Docs:
transform_declarations
.custom_func
, Specially javascript
: An in depth look of how custom_func
is used, specially the all mighty javascript
(and javascript_with_context
).References:
Examples:
In the example folders above you will find pairs of input files and their schema files. Then in the
.snapshots
sub directory, you'll find their corresponding output files.
Use The Playground (may need to wait for a few seconds for instance to wake up)
for trying out schemas and inputs, yours or existing samples, to see how ingestion and transform work.
As for now (2023/03/14), all of our previous free docker hosting solutions went away and we haven't found another one yet. For now please clone the repo and use ./cli.sh
as described in the Getting Started page.
csv2
file format that supersedes the original csv
format with support of hierarchical and nested records.fixedlength2
file format that supersedes the original fixed-length
format with support of hierarchical and nested envelopes.Transform.RawRecord()
for caller of omniparser to access the raw ingested record.custom_parse
in favor of custom_func
(custom_parse
is still usable for
back-compatibility, it is just removed from all public docs and samples).NonValidatingReader
EDI segment reader.omni.2.1
due a number of incompatible schema changes:
'result_type'
-> 'type'
'ignore_error_and_return_empty_str
-> 'ignore_error'
'keep_leading_trailing_space'
-> 'no_trim'
times.SmartParse
.transform
cmd or long-running http server
mode).javascript
engine integration as a custom_func.