Unable to load a pickled object about anylogic-pypeline

[t-wolfeadam]

@t-wolfeadam I just figured this out. I did exactly what you put here. I didn't know that pickle saved the path to the module used.

There's that, but still the issue of a discrepancy between loading from the active environment in an interactive shell (which works) versus when called via Pypeline (which does not) when the idea is that they should behave the same.

After looking into it more, the way Pypeline creates the Python environment causes __name__ to be set to "builtins" (vs "__main__" in an interactive shell). The same thing happens to PyCharm's shell (SO ref) - something for me to look into at some point

[t-wolfeadam]

Interesting use case!

Is there a limitation with "where" on my computer pypeline actually runs?

I thought the answer was "no": before this problem, I would've touted that it runs the same way as if you execute a script or use in an interactive terminal relative to the model's directory. Turns out pickling is an exception!

To test this, I started by creating a setup (assumingly) similar to yours (see here) and generated the pkl object from running the shown script directly.

I then added a 'helper' script in the model directory for streamlining the python code needed in AL and for testing outside of AL (see here) - as you can see, running that directly does work. However, if I try importing the helper from a separate interactive terminal, it fails for a similar reason it does in AL (see here). Double however, the successful "direct loading" seen in the screenshot fails when using Pypeline -- that, I don't know why.

I did find a workaround though: you just need a custom unpickler that redirects the class lookup to the correct module. Updating the 'helper.py' script to look like the following allows it to work from anywhere.

class MyCustomUnpickler(pickle.Unpickler):
    def find_class(self, module, name):
        if module == "__main__":
            module = "pickler"  # script name that generated the file
        return super().find_class(module, name)

def get_obj():
    with open("python_files/pickling_test/pickled_object.pkl", "rb") as f:
        unpickler = MyCustomUnpickler(f)
        obj = unpickler.load()
    return obj

In case you want to explore yourself: Model323.zip

[luke-leiter]

@t-wolfeadam I just figured this out. I did exactly what you put here. I didn't know that pickle saved the path to the module used.