quentinf00 / oceanbench-data-registry

Data registry for the ocean bench project

oceanbench-data-registry

Data registry for the ocean bench project

Conda installation:

conda create -n data-registry
conda activate data-registry
conda install -c conda-forge funcy=1.18 fsspec=2022.11.0 dvc-s3=2.21.0

Usage

The data is stored using dvc (check documentation for more info):

To download a file:

dvc get https://github.com/quentinf00/oceanbench-data-registry.git osse_natl60/grid/gf_obs_nadir.nc

Shield:

This work is licensed under a Creative Commons Attribution 4.0 International License.

Or download the data registry (very light) and pull the necessary files:

git clone https://github.com/quentinf00/oceanbench-data-registry.git
cd oceanbench-data-registry
dvc pull osse_natl60/grid/gf_obs_nadir.nc

oceanbench-data-registry's Issues

Mega Table of Datasets

Name	Parent Dataset	Region	Data Structure	Origin	Data Type	AlongTrack Type	Data Path	Variables	Spatial Resolution	Temporal Resolution	Period	Domain	Notes	Filenames	Altimetry Sensors
NATL20_ref_grid_1d_1200	nan	North Atlantic	Gridded	NEMO	Simulation	nan	NATL60/NATL/ref	ssh, sst	1/20°	1 Day	2013	nan	Frequency - Snapshot @12:00:00	nan	nan
NATL20_ref_grid_1d_avg	nan	North Atlantic	Gridded	NEMO	Simulation	nan	NATL60/NATL/ref_new	mld, ssh, sst	1/20°	1 Day	2013	nan	Frequency - Daily Avg	nan	nan
NATL20_obs_grid_1d_1200	NATL60_ref_grid_1d_1200	North Atlantic	Gridded	NEMO, SWOT-Sim	Psuedo-Observations	NADIR, SWOT	NATL60/NATL/data	ssh	1/20°	nan	2013	nan	Frequency - Daily Avg	ssh_NATL60_4nadir.nc	nan
NATL20_obs_grid_1d_avg	NATL60_ref_grid_1d_avg	North Atlantic	nan	NEMO, SWOT-Sim	Psuedo-Observations	NADIR, SWOT	NATL60/NATL/data_new	ssh	1/20°	nan	2013	nan	Frequency - Daily Avg	nan	nan
NATL4_interp_grid_1d	nan	North Atlantic	Gridded	DUACS	Interpolation	nan	NATL60/NATL/oi	ssh	1/4°	1 Day	2013	nan	nan	nan	nan
GULFSTREAM60_ref_grid_1d_1200	nan	Gulfstream	Gridded	nan	Simulation	nan	NATL60/GULFSTREAM/ref	mld, ssh, sst, u, v, vv	nan	nan	2013	nan	nan	nan	nan
GULFSTREAM60_obs_grid_1d_1200	GULFSTREAM60_ref_grid_1d_1200	Gulfstream	Gridded	SWOT-Sim	nan	NADIR, SWOT	NATL60/GULFSTREAM/data	ssh	1/20°	nan	2013	nan	nan	nan	nan
GULFSTREAM60_obs_grid_1d_avg	NATL60_ref_grid_1d_avg	Gulfstream	Gridded	SWOT-Sim	nan	NADIR, SWOT	NATL60/GULFSTREAM/data_new	ssh	1/20°	nan	2013	nan	nan	nan	nan
NATL60_obs_alongtrack_nadir	nan	North Atlantic	AlongTrack	SWOT-Sim	Psuedo-Observations	NADIR	sensor_zarr/zarr/nadir	ssh	nan	nan	2013	nan	nan	nan	en, g2, j1, swot, tpn
NATL60_obs_alongtrack_swot	nan	North Atlantic	AlongTrack	SWOT-Sim	Psuedo-Observations	SWOT	sensor_zarr/zarr/swot	ssh	nan	nan	2013	nan	nan	nan	nan
NATL60_obs_alongtrack_swot_noise	nan	North Atlantic	AlongTrack	SWOT-Sim	Psuedo-Observations	SWOT	sensor_zarr/zarr/new_swot	ssh	nan	nan	2013	nan	nan	nan	nan
NATL60_obs_alongtrack_swot_noise_parm	nan	North Atlantic	AlongTrack	SWOT-Sim	Psuedo-Observations	SWOT	sensor_zarr/zarr/new_swot_with_1d	ssh	nan	nan	2013	nan	nan	nan	nan
NATL60_ref_grid_1d_1200	nan	North Atlantic	Gridded	NEMO	Simulation	nan	NATL60/NATL/ref	ssh, sst	1/10°	1 Hour	2013	nan	Frequency - Snapshot @12:00:00	nan	nan

Add License

In connection with issue #4, we can add a global license for this registry.

Licensing For Hosted Datasets

A megathread of the associated licensing for the datasets hosted on this server.

---

"Raw" Data

Sea Surface Height

• OSSE Gulfstream Data Challenge (NADIR, SWOT) - MIT License - DOI:10.5281/zenodo.4045400
• OSE Gulfstream Data Challenge - MIT License - DOI:10.5281/zenodo.5511905

Sea Surface Temperature

• Global SSH | MUR - Link | DOI:10.5067/GHGMR-4FJ04

Note: we have to cite aviso in some moment...not sure...

---

Resulting Maps

• 4DVarNet - ?
• NerFs - MIT License
• BFQG - MIT License
• MIOST - ...
• ConvLSTM - DOI: 10.5281/zenodo.7730739
• MultiModal - Citation | MIT License