masterxilo / exporttable Goto Github PK

Use the %g form to produce equivalent output which is not quite as large.

<<ExportTable`

Export;
Unprotect@Export;

DownValues@Export =
    DownValues@Export~Prepend~(
    HoldPattern@Export[f_String, data_, "Table"] :> ExportTable[f, data]
    );

Protect@Export;

seems to work

This, together with the Export[] wrapper will make using this package completely implicit.

This can still be parallelized by writing to memory first. We can assume enough memory and allocate too much space.

• larger arrays
• edge cases: very large/small (denormal) numbers, integers, complex numbers (wrong types), Inf, NAN

Even for non-uniform files: Each thread jumps to a random position in the file and starts parsing from there.

Does not work in MMA 11.2 (Win 7 X64) as of this moment. Don't know why. Keep getting LibraryFunction::libload: The function ExportTableG was not loaded from the file ExportTable.dll. LibraryFunction::libload: The function ExportTableFixedE was not loaded from the file ExportTable.dll. and ExportTable::initfail: Failed to initialize. – Chen Stats Yu 

TODO Verify

E.g. failed to write file

Currently ExportTable rewrite the file when called, is it possible to open a file and use ExportTable to append data to the end of a file?

use ApplicationMaker