Handle unavailable products about ukis-pysat

[mhelleis]

I have just downloaded a bunch of scenes from the archive using the new Sentinelsat version and the download_all() method: everything worked smoothly.

[BoehnkeC]

To clarify this: It would be nice not to end our script with an HTTP error 403 raised by senstinelsat. If the error occured we could log as follows:
Scenes S1, S2, S3, S4, S5 were requested. The requested scene count exceeds the supported number of requests. S1, S2 and S3 are offline and LTA retrieval was triggered. S4 and S5 will be triggered when the request has been resolved.

[fwfichtner]

How much does sentinelsat.download_all() already cover everything you need? This should work even when we focus on single scenes for now.

[mhelleis]

as of today sentinelsat.download_all() doesn't work for me and at least for some others, since it triggers an user quota exceeded error if data has to be retrieved from the LTA. Furthermore, currently there is a general problem with LTA data retrieval. Sentinel-1 and Sentinel-2 data seems to be broken (i.e. the files are only a few MB in size), although this is no Sentinelsat problem but lies with Copernicus Scihub.

I've not tested the workaround for download_all() `that is mentioned in the linked issue, since the data I want is currently broken anyway.

I'll check again when I'm back after next week and report here if anything has changed.

[fwfichtner]

Okay, that's annoying. We should monitor this and think about it again once it is fixed.

[fwfichtner]

@mhelleis you could try again with sentinelsat/sentinelsat#532 once it has been released.

[mhelleis]

@fwfichtner will do. However, we should discuss if we should switch to using eodag, or at least implement it as an alternative way. Even after Scihub tried to fix the LTA issues, there are missing scenes (which can be found on ONDA using eodag though). Furthermore, the LTA retrieval is much faster on ONDA.

[fwfichtner]

eodag can replace a lot of parts of ukis-pysat, so it would not make sense to include it here. You can switch to eodag in your projects though.