qsvdp musl builds crash since 0.120.0 about qsv

[jqnatividad]

Thanks for the bug report @Zharktas .

What exact version of qsvdp are you using?
qsvdp --version

Also, what OS? Is it running on a VM or a container?

[Zharktas]

Dockerfile definition available here https://github.com/vrk-kpa/opendata/blob/master/docker/datapusher-plus/Dockerfile, except with older version as i'm in the process of upgrading it.

with 0.119.0 qsvdp --version outputs:

/srv/app/src $ qsvdp --version
qsvdp 0.119.0-mimalloc-self_update-4-4;12.50 GiB-3.98 GiB-15.49 GiB-15.62 GiB (x86_64-unknown-linux-musl compiled with Rust 1.74.0) prebuilt

With anything newer it just crasher even with the version parameter and doesn't output the actual version:

/srv/app/src $ qsvdp --version

thread 'flexi_logger-flusher' has overflowed its stack
fatal runtime error: stack overflow
Aborted

[Zharktas]

I've pushed failing dockerfile here https://github.com/vrk-kpa/opendata/blob/AV-2031_upgrade_datapusher_and_qsv/docker/datapusher-plus/Dockerfile

[jqnatividad]

The musl builds have been a bit problematic and I just depend on the CI tests to check if they're running.

Have you tried using the gnu prebuilt instead? It's the one we deploy in production with DP+.

[Zharktas]

Yeah gnu prebuilt seems to work, so this issue is only with musl builds. But as we have a more or less mandatory requirement to run on alpine, we can stay on 0.119.0 for now.

[jqnatividad]

OK. Will try to see if we can build the musl prebuilts using Alpine with this GH action - https://github.com/jirutka/setup-alpine

You can also install and compile it locally in your Dockerfile with the added advantage that you can turn on target-cpu=native for optimal CPU optimization.

export CARGO_BUILD_RUSTFLAGS='-C target-cpu=native'
cargo install qsv --locked --bin qsvdp -F datapusher_plus,luau

[jqnatividad]

Hi @Zharktas , now that qsv 0.123.0 is out, I'll be making several updates to Datapusher+ so we can do quick auto-aggregations.

https://dathere.com/2024/03/the-speed-of-insight/

Just wanted to give you a heads-up as I'm adding another binary variant called qsvdp-polars which will have the Polars-powered sqlp and joinpcommands.

Would be interested to find out if you've tried compiling qsv with the polars feature enabled in your target environment...