softweardevelopment / large-yaml2json-json2yaml Goto Github PK

View Code? Open in Web Editor NEW

4.0 4.0 1.0 18 KB

yaml2json and json2yaml for very large files, requiring <10MB of memory regardless of the size of the input file

Makefile 6.29% C++ 93.71%

large-yaml2json-json2yaml's People

Contributors

Stargazers

Watchers

Forkers

koraa

large-yaml2json-json2yaml's Issues

Add dbase/foxpro import backend

Improve yaml error messages

At the moment we do not extract any error messages from libyaml

Optimize literal number conversion

At the moment those need to be converted to real numbers and decoded again; it might be possible to just copy the test without decoding them

Test performance with one-line yamls and jsons

Switch to a modular design

We should use a intermediate format to convert between different modules and specifiy the arguments for them like $ convert inputModule args... -- outputModule args...

Very large number support

At the moment only 64 bit ints and doubles that do not overflow are supported. Support bignum?

Support multiple values in yaml stream

Please, yaml stream and e.g. ndjson (on JSON side). It should consume input and generating output in the same time.

Currently, it yields "Multiple values not supported" when invoking yaml2json on a YAML stream. It would be also useful for the opposite json2yaml could consume new line separated JSONs and generates YAML stream.

Evaluate YamlIO for yaml support

http://llvm.org/docs/YamlIO.html

Patch yaml-cpp to preserve types

Make it possible to use separate threads for encoding and decoding

We can use a queue to communicate between threads.

yaml2json is leaking memory

I suspect yaml-cpp