csiro-easi / eocsi-hackathon-2022 Goto Github PK

• Use odc-stac
• Use dc.load()

Create a WOfS demo notebook based on our previous work around Lake Tempe. The WOfS algorithm are pulled from GA's repositories and the DEM from lpdaac data. An installation script is required to install dependencies and should be made as seamless to use as possible for the Hackathon participants. An HTML version should also be provided, as usual.

Test permissions during branching and PR-ing.
Lint the main readme as a sample task.

FrontierSI updated notebooks for hackathon:

• test welcome notebook
• mangroves notebook (use geoserver for vector: https://geoserver.asia.easi-eo.solutions/geoserver/web/)
• water quality notebook
• change detection notebook

Add most common Python extensions/dirs to .gitignore.

Write a TSS case-studies notebook to demonstrate measuring TSS from remote sensing data over Lake Tempe.

When creating a Dask cluster and client using existing EASI code, I don't get the behaviour I would typically expect based on my experience in DE Africa. The code I am using is

from dask.distributed import Client, LocalCluster

# Connect to an existing LocalCluster if available
# The default port is 8786
try:
    client = Client(f'localhost:8786', timeout='2s')
    cluster = client.cluster  # None
except:
    cluster = LocalCluster(scheduler_port=8786)
    client = Client(cluster)

display(cluster if cluster else client)

This returns the dashboard url as http://127.0.0.1:8787/status but when I follow this link, I find that the site can't be reached, and the dashboard does not display.

If I use the following, I get the behavoiur I expect, with the dashboard url being listed as https://hub.asia.easi-eo.solutions/user/<username>/proxy/<port>/status which I can view.

from datacube.utils.dask import start_local_dask

client = start_local_dask()

display(client)

What's the correct practice for starting a Dask Cluster on EASI and getting access to the Dashboard?