calamari-eval: unknown arguments about calamari

[bertsky]

Also: calamari-eval does not exit with non-zero in case of such errors.

[andbue]

This is really weird. Maybe the number of files in hsbfraktur.val is too large for the shell? Could you please try
calamari-eval --checkpoint hsbfraktur.cala/best.ckpt.json --gt.preload false --n_worst_lines 10 --gt.texts "/dev/shm/hsbfraktur.val/*.gt.txt" --evaluator.progress_bar false to see if resolving the wildcard in python helps?

[bertsky]

Sry, I should have quoted properly. Yes, the file paths after expanding the glob expression would never fit into a memory page. So I always pass it as a glob to Calamari.

It turns out that --n_worst_lines 10 was the culprit.

Also in Calamari 1.0.5 BTW.

[bertsky]

Other options that are reported by --help but do not seem to work:
--gt.xml_files and --pred.xml_files.

I get:

Unknown Arguments --gt.xml_files ...
Possible alternatives:
	--gt.xml_files ==> --gt.channels, --gt.texts, --n_worst_lines

[andbue]

Are you sure about that? calamari-eval --help on current master should not show the --gt.xml_files, only calamari-eval --gt PageXML --help shows the options relevant for PAGE.

[bertsky]

Other options that are reported by --help but do not seem to work:
--gt.xml_files and --pred.xml_files.

Are you sure about that? calamari-eval --help on current master should not show the --gt.xml_files, only calamari-eval --gt PageXML --help shows the options relevant for PAGE.

Oh, I see! I had no idea these were nested, dependent options. It's a great way to encapsulate complexity in a CLI. Fantastic!