Icechunk atomic commit consistency study: fault-injection across storage backends (explore)

Icechunk atomic commit consistency study: fault-injection across storage backends

https://w3id.org/sciencelive/np/RAZ0vOtKCde72HBMNvLh99XPyurv0h2IYiXGpChRWNTKE

Status: Loading...

Searching for classes... Loading...

📌 Nanopublication

Icechunk atomic commit consistency study: fault-injection across storage backends FORRT-Replication-Study Replication-Study comment... approve/disapprove... edit as derived nanopublication... create new with same template...

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/1999/02/22-rdf-syntax-ns#type is a https://w3id.org/sciencelive/o/terms/FORRT-Replication-Study FORRT Replication Study .

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2000/01/rdf-schema#label has the label (this is a literal)

"Icechunk atomic commit consistency study: fault-injection across storage backends"

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/1999/02/22-rdf-syntax-ns#type is a https://w3id.org/sciencelive/o/terms/Replication-Study

Replication Study

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

https://w3id.org/sciencelive/o/terms/targetsClaim targets the claim https://w3id.org/sciencelive/n.../icechunk-atomicity-claim-2026

icechunk-atomicity-claim-2026

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

https://w3id.org/sciencelive/o/terms/hasScopeDescription has the scope (this is a literal)

"The consistency sub-claim only: that an Icechunk-backed transactional store produces no observable metadata–data inconsistency when an update is interrupted mid-write, when a reader accesses the store concurrently with an in-progress write, or when two writers compete. Tested across three storage backends (local filesystem, MinIO, real S3) to determine whether the guarantee is conditional on the object store's support for atomic conditional writes. The study also tests two baseline configurations of a disconnected STAC metadata index (naive and best-effort with reconciliation) to characterise the inconsistency window and orchestration cost of current practice. Out of scope: DataFusion query-performance, storage durability against object-store corruption, multi-region distributed stress testing, and performance tuning of either system."

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

https://w3id.org/sciencelive/o/terms/hasMethodologyDescription has the methodology (this is a literal)

"A fault-injection harness (harness/, Python 3.12) generates synthetic Zarr arrays of 256 float32 values per trial (no manual data preparation). Each array is stored with a deterministic metadata attribute — a SHA-256 checksum of the array data — that allows mechanical detection of inconsistency: a consistency checker reads the stored attribute, recomputes the checksum from the current data, and flags any mismatch as one observed inconsistency. Faults are injected by raising a SimulatedCrash exception at a specific point in the write sequence, then abandoning the in-progress state. For Icechunk, an uncommitted session is abandoned (equivalent to a process crash before commit). For the STAC baseline, the zarr write or STAC JSON write is interrupted at the chosen fault point. Three core fault scenarios are run: (F1) crash after the zarr array write but before the STAC metadata update; (F2) crash after the STAC metadata update but before the zarr array write (reverse write order); (F3) the consistency invariant is sampled between the two STAC writes, simulating a concurrent reader arriving during the update window. F2 is not applicable to Icechunk (single-session atomicity prevents it by construction). Each scenario is applied to three configurations: Icechunk-backed Zarr store, STAC B0 (naive: write-then-index, no transaction), and STAC B1 (best-effort: write-ordering discipline plus an explicit reconciliation sweeper). The matrix runs 1000 independent trials per scenario per configuration on the local filesystem backend. Results are written to Parquet (data/results/results.parquet)."

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

https://w3id.org/sciencelive/o/terms/hasDeviationDescription has the deviation (this is a literal)

"Not applicable — this is a question-rooted chain with no prior published experimental methodology to deviate from. The study design is original."

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2004/02/skos/core#related is related to http://www.wikidata.org/entity/Q1348989

Q1348989

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2004/02/skos/core#related is related to http://www.wikidata.org/entity/Q180160

Q180160

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2004/02/skos/core#related is related to http://www.wikidata.org/entity/Q2041312

Q2041312

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2004/02/skos/core#related is related to http://www.wikidata.org/entity/Q5163219

Q5163219

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

http://www.w3.org/2004/02/skos/core#related is related to http://www.wikidata.org/entity/Q872685

Q872685

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

https://w3id.org/sciencelive/o/terms/hasDiscipline has the discipline http://www.wikidata.org/entity/Q1149776

Q1149776

This is the identifier for the assertion of this nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-8763-1643

Jean Iaquinta

https://orcid.org/0000-0002-8763-1643

Jean Iaquinta

http://xmlns.com/foaf/0.1/name has the name (this is a literal)

"Jean Iaquinta"

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... This nanopublication http://www.w3.org/2000/01/rdf-schema#label has the label (this is a literal)

"Icechunk atomic commit consistency study: fault-injection across storage backends"

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... This nanopublication date and time when the nanopublication was created http://purl.org/dc/terms/created was created on (this is a literal)

"2026-06-08T12:22:32.559Z"

(xsd:dateTime) .

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... This nanopublication links to the assertion template that was used to create this nanopublication https://w3id.org/np/o/ntemplate/wasCreatedFromTemplate was created from the assertion template https://w3id.org/np/RAuLEjPp-4...

RAuLEjPp-4

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... This nanopublication the nanopublication consists of an introduction of the given resource http://purl.org/nanopub/x/introduces introduces This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/n.../icechunk-atomicity-study-2026

icechunk-atomicity-study-2026

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../sig

sig

http://purl.org/nanopub/x/hasSignatureTarget has as target This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... this nanopublication .

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../sig

sig

http://purl.org/nanopub/x/hasAlgorithm has the algorithm (this is a literal)

"RSA"

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../sig

sig

http://purl.org/nanopub/x/hasPublicKey has the public key (this is a literal)

"MIICIjANBgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAzHC00ZumAokw0N4gvAIpWZTTOilFCcmYB4ZhKAcVdxLnRsy0YYniEpexCCD0WEcNc/x9bDUTsrFlz2mkxzvCBpUaFdGKl5E+xZ5zHsuzAZlmBM48+jEbB/bn9kTXnQHJL0KDus2wTdW0QJhaBa7fNZjar7AkoSQSyFzg7+BPDS726I7imAbkQwgAMPop4CkazqiU0ynyUQOLwZR9TCkaR/HlzSVdKwbNXiLnpXMPIiEFUNa/S7c5Iu+PeMYY2ApA/7vvyDqSIG2eFHf7uSaVV8W+5vYzwaTnTiWJ9AXMa28WU5N1EtRNkJhifHUFgh5Y/ch0WgGL1c8ASBxO1HpGrqQkbMTSG3krLspkRS+ms2AFsV0zv7RtG4jw0BnVyjG3L3ZBmYClfSGvLJ05YLFf9Z0CZ+yvei3MudrinJTF9XmzwiyVp4DR/QKCjb3qInO3H9c0GHdZqgQ3OM3fxRpla89PSWVyY0ukq9Rw0KH0G/NtXEr5n1CVavut0UrQmRJweQTvRTAiQdKIoy1Mbr60RwQXoIN8RhbfAd4jtqb+CWm637gU8sX+iv5J0XqEw4C2OJc2mKI0ClvO9NuGMfZG9QV7qZGXhmlYSqifOLKnnPDb54laFg6h+g1X4MyU5yrXe3tYhrNX9NFJrb74YOtKv6CnjU81uPpi0yJOTsfCTS0CAwEAAQ=="

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../sig

sig

http://purl.org/nanopub/x/hasSignature has the signature (this is a literal)

"iqTECn4GWRVxAbHhlVWraZcqHuEKjdTYS2q1f4bVA3y8VRekKKrRhcgEdCz9+PeIvcFJ9KyEfywoVQ3OeG8eGl20p2UTd2tMZEtDH/dKoIt7VuQEZ4QKdNtiYhlpL/8iaIgQJEyvW/Oj1b7wwVCuPTRMKDzNIfZqAfcrINKHlnGcmPmcU2uhkz2lEJc1TSmRh4tTMYVLIwLkeNElJC41LFO+fXCv6JmdYSjLHd/b7gXUz2SAhKZDZMm2mGsfhR4+5fzrY2CFGSAXIbQqQEtx0bYPQt4DMMrA+XcFZQet3AElaPfoci7+7+k6hOCbiw2xvumc2+Mu51g39pRm9PGiwFLwQTT9PzuLtDjplAbPIK5PVFX3tUC5DiJsjhd9G9OjCamiXi1GTrulZrpYvEAPth+zAeM7MFQir/x/Ztn/rLh0EGXW83/bM+sv6hp76NCNicW6W2FICvP37555zT2exYTnpg308IzXIH8Tm4EJw1hq/KdpIoSXnSYBWbmfPSA/D+PV6dpmtc6XAlu4MvZT4mHmt6I5iQMNWu6s3ui4051JSlGIDRKX7NVt3KB8hLe7Q8fVfdq2fm4035N5VqPRLJOkzflfEq2dqCJa+kH5ntUHnteTodO/tCmIsq6e5wfxdKTt0mF+F6I8oXUzzmlwgmLafPHEtYfIO+yIP0udqvg="

This is a local identifier minted within the nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd.../sig

sig

http://purl.org/nanopub/x/signedBy is signed by https://orcid.org/0000-0002-8763-1643

Jean Iaquinta

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd... This nanopublication http://purl.org/nanopub/x/wasCreatedAt was created at https://platform.sciencelive4all.org

platform.sciencelive4all.org

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd...

this nanopublication

http://purl.org/dc/terms/creator

creator

https://orcid.org/0000-0002-8763-1643

Jean Iaquinta

This is the identifier for this whole nanopublication. https://w3id.org/sciencelive/np/RAZ0vOtKCd...

this nanopublication

http://purl.org/dc/terms/license

license

https://creativecommons.org/licenses/by/4.0/

4.0

Jean Iaquinta, 8 Jun 2026, 12:22:32 UTC

Raw formats

Full nanopublication: TriG(txt), JSON-LD(txt), N-Quads(txt), XML(txt)

Assertions only: Turtle(txt), JSON-LD(txt), N-Triples(txt), RDF/XML(txt)