Comments (6)
What does: h5dump -p -H tell you?
from h5pyd.
Here's a subset of the header. 1997 - Created using h5py ; 2015 - Created using h5pyd
HDF5 "GFED_Annual.h5" {
GROUP "/" {
GROUP "1997" {
DATASET "C_AGRI" {
DATATYPE H5T_IEEE_F64LE
DATASPACE SIMPLE { ( 720, 1440 ) / ( 720, 1440 ) }
STORAGE_LAYOUT {
CHUNKED ( 45, 90 )
SIZE 714077 (11.616:1 COMPRESSION)
}
FILTERS {
COMPRESSION DEFLATE { LEVEL 4 }
}
FILLVALUE {
FILL_TIME H5D_FILL_TIME_ALLOC
VALUE 0
}
ALLOCATION_TIME {
H5D_ALLOC_TIME_INCR
}
ATTRIBUTE "long_name" {
DATATYPE H5T_STRING {
STRSIZE 48;
STRPAD H5T_STR_NULLPAD;
CSET H5T_CSET_ASCII;
CTYPE H5T_C_S1;
}
DATASPACE SCALAR
}
ATTRIBUTE "units" {
DATATYPE H5T_STRING {
STRSIZE 3;
STRPAD H5T_STR_NULLPAD;
CSET H5T_CSET_ASCII;
CTYPE H5T_C_S1;
}
DATASPACE SCALAR
}
}
}
GROUP "2015" {
DATASET "C_AGRI" {
DATATYPE H5T_IEEE_F64LE
DATASPACE SIMPLE { ( 720, 1440 ) / ( 720, 1440 ) }
STORAGE_LAYOUT {
CONTIGUOUS
SIZE 8294400
OFFSET 63466808
}
FILTERS {
NONE
}
FILLVALUE {
FILL_TIME H5D_FILL_TIME_IFSET
VALUE 0
}
ALLOCATION_TIME {
H5D_ALLOC_TIME_LATE
}
ATTRIBUTE "long_name" {
DATATYPE H5T_STRING {
STRSIZE 48;
STRPAD H5T_STR_NULLPAD;
CSET H5T_CSET_ASCII;
CTYPE H5T_C_S1;
}
DATASPACE SCALAR
}
ATTRIBUTE "units" {
DATATYPE H5T_STRING {
STRSIZE 3;
STRPAD H5T_STR_NULLPAD;
CSET H5T_CSET_ASCII;
CTYPE H5T_C_S1;
}
DATASPACE SCALAR
}
}
}
}
from h5pyd.
That looks compressed. Can you compare it with a file generated by your original h5py code?
from h5pyd.
The first piece, 1997, looks compressed, and is from my h5py code.
But 2015 looks different, does that still count as compressed? That was the part I created with h5pyd
from h5pyd.
Ok, got it. Seems like a bug, I'll look into it.
from h5pyd.
This should be working now (at least gzip, haven't setup test cases for other compression formats).
from h5pyd.
Related Issues (20)
- `hsload` fails when an attribute has type `Reference` HOT 4
- hsload fails with datasets using scale offset filter HOT 1
- apply source compression filter in hsload HOT 1
- Show filters applied to any datasets in hsls HOT 1
- h5pyd not evaluating environment variables HOT 1
- An error related to hsrm HOT 12
- Error with 1D chunk sizes HOT 2
- `logging.info` call forces downstream package loggers to emit messages twice
- Recursive Domain Deletion Flag for `hsrm`
- git tags missing HOT 1
- hsload doesn't allow linkpath and fastlink options to be used together
- Update build process to use toml HOT 1
- CI Testing in Github HOT 1
- Support numpy-style broadcasting
- Support field selection from compound types HOT 1
- Support ordering links/attribute by creation index/name HOT 1
- Attributes in root group not displayed by hsls --showattrs HOT 1
- Support for H5Dread_multi/H5Dwrite_multi
- Missing v0.18.0 tag HOT 2
- PEP 632: Python 3.12 Incompatible with Distutils HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h5pyd.