uniwue-zpd / pagetools

Small collection of PAGE XML related scripts used at the ZPD Würzburg

---

Small collection of PAGE XML related Python scripts used at the Centre for Philology and Digitality (ZPD), University of Würzburg.

Documentation

To check out docs, visit https://uniwue-zpd.github.io/PAGETools

License

MIT

Copyright (c) 2019-present, Zentrum für Philologie und Digitalität "Kallimachos"

pagetools's Issues

incoroporate automatic GT "correction" based on OCR confusions and rules

cf. https://github.com/chaddy314/fraktur_confusions
has to be (partly) rewritten

Add tests

Some (basic) tests should get added for every processor.

incorporate line2page

cf. https://github.com/chaddy314/line2page
probably has to be (partly) rewritten

Diff based culling

Use case

When correcting ground truth in big datasets it's often useful to check the diff between a very good prediction and the ground truth in LAREX and correct it if necessary. Culling the correction data set of all files which don't contain any diff between prediction and ground truth makes this a lot easier.

Implementation

The CLI should accept:

• a list of PAGE XML files and two indices (for TextEquiv/@index) with denominate prediction and ground truth
• two lists of files with one index each in case GT and Pred are stored in two different XML files
• whether to apply Unicode normalization / regularization
• An output directory

Collect and serialize information about certain operations

It would be useful to collect and serialize information about certain operations like e.g. how many substitutions were done during regularization and which files were affected.