plaid.storage.registry

Backend registry for plaid.storage.

This module centralizes backend wiring so reader/writer code can use a single source of truth for backend capabilities.

Attributes

BACKENDS

Classes

BackendSpec

Backend wiring for storage operations.

Functions

available_backends(→ list[str])	Return available backend names in stable order.
get_backend(→ BackendSpec)	Return the backend spec for a given name.

Module Contents

class BackendSpec

Backend wiring for storage operations.

name: str

init_from_disk: Callable[[str | pathlib.Path], plaid.storage.cgns.reader.CGNSDatasetDict | plaid.storage.hf_datasets.reader.HFDatasetDict | plaid.storage.zarr.reader.ZarrDatasetDict]

download_from_hub: Callable[Ellipsis, str]

init_streaming_from_hub: Callable[Ellipsis, dict[str, datasets.IterableDataset] | datasets.IterableDatasetDict]

generate_to_disk: Callable[Ellipsis, None]

push_local_to_hub: Callable[Ellipsis, None]

configure_dataset_card: Callable[Ellipsis, None]

to_var_sample_dict: Callable[Ellipsis, dict[str, Any]] | None

sample_to_var_sample_dict: Callable[Ellipsis, dict[str, Any]] | None

BACKENDS

available_backends() → list[str]

Return available backend names in stable order.

get_backend(name: str) → BackendSpec

Return the backend spec for a given name.