Comments (4)
Thanks for the detailed bug report. I'll try to push out a fix right away.
from tensorstore.
Here's my environment:
$ mamba list
# packages in environment at /home/mkitti/review_temp/conda/3/x86_64/envs/tensorstore_test:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 2_gnu conda-forge
asttokens 2.4.1 pyhd8ed1ab_0 conda-forge
bzip2 1.0.8 hd590300_5 conda-forge
ca-certificates 2024.2.2 hbcca054_0 conda-forge
crc32c 2.4 py312h98912ed_0 conda-forge
decorator 5.1.1 pyhd8ed1ab_0 conda-forge
exceptiongroup 1.2.0 pyhd8ed1ab_2 conda-forge
executing 2.0.1 pyhd8ed1ab_0 conda-forge
ipython 8.22.2 pyh707e725_0 conda-forge
jedi 0.19.1 pyhd8ed1ab_0 conda-forge
ld_impl_linux-64 2.40 h55db66e_0 conda-forge
libexpat 2.6.2 h59595ed_0 conda-forge
libffi 3.4.2 h7f98852_5 conda-forge
libgcc-ng 13.2.0 hc881cc4_6 conda-forge
libgomp 13.2.0 hc881cc4_6 conda-forge
libnsl 2.0.1 hd590300_0 conda-forge
libsqlite 3.45.3 h2797004_0 conda-forge
libuuid 2.38.1 h0b41bf4_0 conda-forge
libxcrypt 4.4.36 hd590300_1 conda-forge
libzlib 1.2.13 hd590300_5 conda-forge
matplotlib-inline 0.1.7 pyhd8ed1ab_0 conda-forge
ml-dtypes 0.4.0 pypi_0 pypi
ncurses 6.4.20240210 h59595ed_0 conda-forge
numpy 1.26.4 pypi_0 pypi
openssl 3.2.1 hd590300_1 conda-forge
parso 0.8.4 pyhd8ed1ab_0 conda-forge
pexpect 4.9.0 pyhd8ed1ab_0 conda-forge
pickleshare 0.7.5 py_1003 conda-forge
pip 24.0 pyhd8ed1ab_0 conda-forge
prompt-toolkit 3.0.42 pyha770c72_0 conda-forge
ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge
pure_eval 0.2.2 pyhd8ed1ab_0 conda-forge
pygments 2.17.2 pyhd8ed1ab_0 conda-forge
python 3.12.3 hab00c5b_0_cpython conda-forge
python_abi 3.12 4_cp312 conda-forge
readline 8.2 h8228510_1 conda-forge
setuptools 69.5.1 pyhd8ed1ab_0 conda-forge
six 1.16.0 pyh6c4a22f_0 conda-forge
stack_data 0.6.2 pyhd8ed1ab_0 conda-forge
tensorstore 0.1.57 pypi_0 pypi
tk 8.6.13 noxft_h4845f30_101 conda-forge
traitlets 5.14.3 pyhd8ed1ab_0 conda-forge
typing_extensions 4.11.0 pyha770c72_0 conda-forge
tzdata 2024a h0c530f3_0 conda-forge
wcwidth 0.2.13 pyhd8ed1ab_0 conda-forge
wheel 0.43.0 pyhd8ed1ab_1 conda-forge
xz 5.2.6 h166bdaf_0 conda-forge
neuroglancer can load the data just fine.
from tensorstore.
$ curl -i -H "Range: bytes=-6084" http://keller-s13.hhmi.org/2024-03-15_GFAP_PaSyn_Iba1/zarr_test/c/0/0
HTTP/1.1 206 Partial Content
Content-Type: application/octet-stream
Last-Modified: Thu, 25 Apr 2024 07:12:09 GMT
Accept-Ranges: bytes
ETag: "986c5ee3df96da1:0"
Server: Microsoft-IIS/10.0
Date: Fri, 26 Apr 2024 10:27:30 GMT
Content-Length: 6084
Content-Range: bytes 3187687438-3187693521/3187693522
from tensorstore.
Error reading shard index in http://keller-s13.hhmi.org/2024-03-15_GFAP_PaSyn_Iba1/zarr_test/c/0/0: Requested byte range [-6084, ?) was not satisfied by response with byte range [3187687438, 3187693522) and total size 3187693522
My guess is that the error is here since byte_range.exclusive_max == 3187693522
and total_size == 3187693522
tensorstore/tensorstore/kvstore/http/byte_range_util.cc
Lines 64 to 65 in d327714
Although we get Content-Range: bytes 3187687438-3187693521/3187693522
, the exclusive max is increased by one.
from tensorstore.
Related Issues (20)
- consider looking in `/etc/pki/ca-trust/extracted` for CA certificates? HOT 3
- question about writing parallel and group handling HOT 39
- Slow random read performance HOT 8
- Segfault/Mutex Error HOT 13
- Does zarr_sharding_indexed exist? HOT 1
- Incorrect writes using int array indexing, affected by chunk layout HOT 1
- Zstd compression does not encode content size in header HOT 2
- Falied to acquire lock on file HOT 1
- Metric suggestions HOT 6
- Parallel write handling in Zarr HOT 1
- zarr3 shard user block / offset
- Windows: NotImplementedError: CopyRange not supported #1048 HOT 5
- Please allow compile-time evaluation of `DataType::id()` (constexpr), platform-independently HOT 1
- Support installation to enable reuse/packaging HOT 5
- Tensorstore C++ Integration: How to Avoid Driver Registry Conflict HOT 6
- Segmentation fault when using tensorstore with multiple workers in pytorch dataloader HOT 1
- Tensorstore key value store driver not Retrying on 429 Responses with S3 API HOT 8
- Read speeds decrease 2x when reading with fewer processes HOT 7
- Writing Neuroglancer Precomputed data with png compression not working correctly
- Build issues with latest version (73da2a2) HOT 15
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tensorstore.