Yaml emitter error while executing scans concurrently about soda-core

[tools-soda]

SAS-3303

[bastienboutonnet]

I think the best at this stage would be to follow your intuition and see if indeed you can make it work, then we'll gladly welcome a PR. At this point, using the package in a fastAPI app hasn't really been a use-case we've tested or given much thought about so if you think you're on to something we're open to support you through that PR.

Otherwise, I'll be more than happy to log-in a feature request for you and understand a bit more the use-case and so on.

[Electrogenic]

Gotchya! Good to know that about FastAPI as a use case. We've only just started the integration. So nothing in prod yet. But happy to say it's been pretty smooth sailing thus far. Save for this one thorny issue.

I'd be happy to take a crack at it though, and see if I can't figure out what's going on here.

[m1n0]

Hmm I have seen this before with parallel scan executions - we were trying to parallelize partitioned scans, where we loaded config and checks from files and then passed those into multiple parallel scans. I did not find a quick root-cause fix but I found a way to make it work - I started adding config and checks as strings to scans (i.e. separate object instances) instead of one file stream object. This solved the issue for me, but it seems like you are already doing that. Did you by any chance get the error when you used files instead of yaml strings?