allow zarr writer to do incremental writes of single timepoints #91
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Link to Relevant Issue
Chantelle had a use case where she wanted to write out a time series zarr but could only prepare the source array sequentially, one timestep at a time. She wanted to use the writer to write sub-arrays incrementally.
Description of Changes
So I am adding a toffset parameter to the zarr writer. The writer will then attempt to write the given time series starting at the given t offset.
In this way you can call write_t_batches_from_array more than once, in a loop, passing in smaller amounts of t at a time.
A unit test is added to show how this should be used. You can just call write_t_batches_array in a loop now.
A future generalization of this could be to pass in even smaller parts of the array and give the writer a tczyx offset of where to start writing the input data.