icechunk.virtual#
Virtual chunk containers and specs for referencing external data.
icechunk.virtual #
Classes:
| Name | Description |
|---|---|
VirtualChunkContainer | A virtual chunk container is a configuration that allows Icechunk to read virtual references from a storage backend. |
VirtualChunkSpec | The specification for a virtual chunk reference. |
VirtualChunkContainer #
A virtual chunk container is a configuration that allows Icechunk to read virtual references from a storage backend.
Attributes:
| Name | Type | Description |
|---|---|---|
name | str | None | Optional name for this container. When set, chunks can use relative |
url_prefix | str | The prefix of urls that will use this containers configuration for reading virtual references. |
store | ObjectStoreConfig | The storage backend to use for the virtual chunk container. |
Methods:
| Name | Description |
|---|---|
__new__ | Create a new |
Source code in icechunk-python/python/icechunk/_icechunk_python.pyi
__new__ #
Create a new VirtualChunkContainer object
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
url_prefix | str | The prefix of urls that will use this containers configuration for reading virtual references. | required |
store | _AnyObjectStoreConfig | The storage backend to use for the virtual chunk container. | required |
name | str | None | Optional name for this container. When set, chunks can use relative | None |
Source code in icechunk-python/python/icechunk/_icechunk_python.pyi
VirtualChunkSpec #
The specification for a virtual chunk reference.
Attributes:
| Name | Type | Description |
|---|---|---|
etag_checksum | str | None | Optional object store e-tag for the containing object. |
index | list[int] | The chunk index, in chunk coordinates space |
last_updated_at_checksum | datetime | None | Optional timestamp for the containing object. |
length | int | The length of the chunk in bytes |
location | str | The URL to the virtual chunk data, something like 's3://bucket/foo.nc' |
offset | int | The chunk offset within the pointed object, in bytes |
Source code in icechunk-python/python/icechunk/_icechunk_python.pyi
etag_checksum property #
Optional object store e-tag for the containing object.
Icechunk will refuse to serve data from this chunk if the etag has changed.
last_updated_at_checksum property #
Optional timestamp for the containing object.
Icechunk will refuse to serve data from this chunk if it has been modified in object store after this time.