databricks-sql-connector 2.2.0 stopped working on arm64 (Mac M1) without gcc installed about databricks-sql-python

[susodapop]

This isn't a bug with databricks-sql-connector. The reason you need gcc is because there isn't a pre-built ARM wheel for lz4 (see here). Therefore your workstation needs to build the wheel to install it. Building the wheel requires gcc to be installed.

The reason this just started with v2.2.0 is that in this version we introduced lz4 compression, which offers a significant performance boost during network calls. v2.1.0 did not have the lz4 dependency which is why you haven't needed to build the lz4 wheel before.

[Casper321]

Thank you for the explaining!

[jonathanunderwood]

Starting with release 4.3.0, Arm 64 bit wheels for python-lz4 are published on pypi.org.

[susodapop]

@jonathanunderwood do you suggest that we bump our lz4 dependency to 4.3.0?

[jonathanunderwood]

@jonathanunderwood do you suggest that we bump our lz4 dependency to 4.3.0?

Yep, if you want to avoid your users having to install gcc etc if they are on an Arm machine, requiring lz4 4.3.2 or later will make the wheels available.