I have 2 desktop shortcuts to factorio. One uses a different mod-directory switch for when I want to play factorio in creative mode. The other shortcut uses the 'vanilla' mod-directory, which contains this mod.
If I start up factorio in 'creative' mod-directory it seems to have forgotten all this mod's achievements and begins adding them back when I achieve them. Then when I start factorio using the vanilla mod-directory, they again seem to be reset.
To be clear, the .exe, .\saves etc. are the same in each case, it's just the mod-directory that changes.