Comments (2)
There is a similar issue with H5PYD having trouble with metadata attribute values being strings. Using H5PY, HDF5 files with metadata attribute values containing strings were created and then sent to the HSDS with H5PYD. However, when the files containing metadata string values were retrieved from the HSDS with hsget, the metadata attributes with the string values were completely stripped off of the HDF5 file. The hsget left the dataset and metadata attributes with non-string values intact.
To fix the issue with string metadata attribute values being stripped off of an HDF5 file using hsget:
In the utillib.py file under h5pyd/_apps, change lines 277-278 from this:
srcarr = np.asarray(data, order='C', dtype=src_dt)
tgtarr = copy_array(srcarr, ctx)
to this:
if isinstance(data, str):
tgtarr = np.string_(data)
else:
srcarr = np.asarray(data, order='C', dtype=src_dt)
tgtarr = copy_array(srcarr, ctx)
from h5pyd.
Somewhere along the line, the issue @MRossol reported has been fixed (with h5pyd version 0.10.3 or higher).
@jbhatch - I'm not sure if the issue you saw had the same root cause or not. If you are still seeing this could you open up a new issue with a repo case? I'll promise to respond with more alacrity this time. :)
from h5pyd.
Related Issues (20)
- `hsload` fails when an attribute has type `Reference` HOT 4
- hsload fails with datasets using scale offset filter HOT 1
- apply source compression filter in hsload HOT 1
- Show filters applied to any datasets in hsls HOT 1
- h5pyd not evaluating environment variables HOT 1
- An error related to hsrm HOT 12
- Error with 1D chunk sizes HOT 2
- `logging.info` call forces downstream package loggers to emit messages twice
- Recursive Domain Deletion Flag for `hsrm`
- git tags missing HOT 1
- hsload doesn't allow linkpath and fastlink options to be used together
- Update build process to use toml HOT 1
- CI Testing in Github HOT 1
- Support numpy-style broadcasting
- Support field selection from compound types HOT 1
- Support ordering links/attribute by creation index/name HOT 1
- Attributes in root group not displayed by hsls --showattrs HOT 1
- Support for H5Dread_multi/H5Dwrite_multi
- Missing v0.18.0 tag HOT 2
- PEP 632: Python 3.12 Incompatible with Distutils HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h5pyd.