Question: does `h5netcdf` bring in the entire data from a netCDF file on a remote disk (like S3)? about h5netcdf

[shoyer]

Generally h5netcdf/h5py only load minimum required data, which in principle should be using something like a range-get for S3FileSytem.

That said, HDF5 was designed for local filesystems, so sometimes reading metadata can be more expensive than one would think. But it certainly should not be loading the entire thing...

[bnlawrence]

Or to put it another way, is h5netcdf loading the object into memory, or is it using range-get when you do something like this?

ds.title

(for ds as defined above). I am hoping only a few bytes get transferred. Is that correct?

[valeriupredoi]

many thanks for your input here, guys! 🍺

[valeriupredoi]

@shoyer brilliant, cheers very much! That's music to our ears then 🎵 🍺

[valeriupredoi]

Ih @bnlawrence doesn't have other q's, I can close this - great timely communication, cheers, guys!