Support Large Object Files (.whl, egg) greater than 1Gib with postgres about devpi

[fschulze]

There will be big changes to the backend for the next major devpi-server release anyway, so that would be a good opportunity to add this as well.

[fschulze]

I was looking into this again. Besides the size limitation, streaming/chunking should already be used, see https://github.com/devpi/devpi/blob/main/postgresql/devpi_postgresql/main.py#L184-L191 where it selects variants based on use_copy.

I'm not sure if pg8000 supports it, the example seems to use bytea and lo_get etc. I can't find anything related to lo_create, lo_open etc in connection to pg8000.

It is likely that the next major version will support using postgresql for metadata only and store files on the filesystem. Possibly other backends like object storages compatible with S3 will also be possible, but would need funding.