Problem
The current variable shaped chunk grids use rectilinear as their chunk grid metadata
|
return { |
|
"name": "rectilinear", |
|
"configuration": { |
|
"kind": "inline", |
|
"chunk_shapes": tuple(serialized_dims), |
|
}, |
|
} |
however the ZEP https://zarr.dev/zeps/draft/ZEP0003.html#detailed-description
proposes
{
"type": "rectangular",
"chunk_shape": [[5, 5, 5, 15, 15, 20, 35], 10],
"separator":"/"
}
there are other differences as well - type vs name, chunk_shape vs chunk_shapes where the metadata is flat vs nested.
This makes it confusing to support downstream (icechunk).
Solution
one of zarr-python or the ZEP should be updated. I would suggest updating the ZEP to match the lessons learned from actual implementation.
Problem
The current variable shaped chunk grids use
rectilinearas their chunk grid metadatazarr-python/src/zarr/core/metadata/v3.py
Lines 315 to 321 in 0ea15fd
however the ZEP https://zarr.dev/zeps/draft/ZEP0003.html#detailed-description
proposes
{ "type": "rectangular", "chunk_shape": [[5, 5, 5, 15, 15, 20, 35], 10], "separator":"/" }there are other differences as well -
typevsname,chunk_shapevschunk_shapeswhere the metadata is flat vs nested.This makes it confusing to support downstream (icechunk).
Solution
one of zarr-python or the ZEP should be updated. I would suggest updating the ZEP to match the lessons learned from actual implementation.