Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
f7d264f
Import Zarr contracts from biomero-schema and own the workflow color
TorecLuik Nov 12, 2026
3f97647
Detached runs: own launcher registration, resume decisions and cancel…
TorecLuik Nov 12, 2026
b0effc8
Address review: legible core version error, colour constants placement
TorecLuik Nov 12, 2026
e2c6b4c
Cancel passes through every stage; admin script to request a cancel; …
TorecLuik Nov 12, 2026
e79cf92
Round 2: WorkflowInterrupted passthrough, explicit stop_check, Pipeli…
TorecLuik Nov 12, 2026
f1e3425
Resume: use core's SlurmJob.ended_without_success
TorecLuik Nov 12, 2026
5dcc347
Round 3: claim checks before owner-only writes, scancel failure named…
TorecLuik Nov 12, 2026
2fbab71
Migration: move canonical sidecars through the importer helpers
TorecLuik Nov 13, 2026
419e559
Remove the input marker from results after import on every path
TorecLuik Nov 13, 2026
cad2f63
Import TRANSFER_INPUT_MARKER from biomero-schema
TorecLuik Nov 13, 2026
805ec94
Import CanonicalInput and TRANSFER_INPUT_MARKER from biomero-schema t…
TorecLuik Nov 13, 2026
03ad824
Keep CanonicalInput import for biomero-scripts#88 to move
TorecLuik Nov 13, 2026
70e9c46
Migration and trust upgrade: per-directory sidecars, unwritable folders
TorecLuik Nov 13, 2026
fe3170f
Harden the input marker cleanup after review
TorecLuik Nov 13, 2026
4bff087
Merge remote-tracking branch 'origin/master' into detached-ownership
TorecLuik Nov 13, 2026
6dfd15d
Batched launcher registration as a function (register_detached_batches)
TorecLuik Nov 13, 2026
8d6ed48
Read the Results_Path output name from biomero.constants.results
TorecLuik Nov 13, 2026
7975d7e
Use the core script-output constants
TorecLuik Nov 13, 2026
d19218f
Sidecar problems never fail a transfer; roll back a failed sidecar move
TorecLuik Nov 13, 2026
9c4344c
Merge #97 and master; require biomero>=2.9.0b26
TorecLuik Nov 13, 2026
c706411
Merge #88 (with #97) into detached-ownership
TorecLuik Nov 13, 2026
7444505
Merge #90 (with #88 and #97) and master into use-core-output-constants
TorecLuik Nov 13, 2026
e2fbaa5
Review fixes: remove dead commented outputs, reflow touched lines
TorecLuik Nov 13, 2026
6506c07
Merge branch 'scripts-b26-90' into scripts-b26-95
TorecLuik Nov 13, 2026
63ef12d
Merge #90 (with #88, #97) into the sidecar PR; require biomero-import…
TorecLuik Nov 13, 2026
9def6e0
Merge #95 (with #90, #88, #97) into use-core-output-constants
TorecLuik Nov 13, 2026
dfc2243
Take the result folder name from core and stop the marker sweep at th…
TorecLuik Nov 16, 2026
8425807
Merge #97 into provenance-views-cleanup; state no minimum core version
TorecLuik Nov 16, 2026
50cfa08
Merge #88 into detached-ownership
TorecLuik Nov 16, 2026
a19f4d7
Merge #90 into feat/canonical-sidecar-in-biomero-folders
TorecLuik Nov 16, 2026
ec6b1a9
Merge #95 into use-core-output-constants
TorecLuik Nov 16, 2026
866958e
Wrap a docstring line
TorecLuik Nov 16, 2026
5714bb4
Merge fix/remove-input-marker-after-import into provenance-views-cleanup
TorecLuik Nov 16, 2026
c7674dc
Merge provenance-views-cleanup into detached-ownership
TorecLuik Nov 16, 2026
160938c
Merge detached-ownership into feat/canonical-sidecar-in-biomero-folders
TorecLuik Nov 16, 2026
d34083c
Merge feat/canonical-sidecar-in-biomero-folders into use-core-output-…
TorecLuik Nov 16, 2026
1133f5b
Make the result folder a module constant; check the workflow id, not …
TorecLuik Nov 16, 2026
329487a
Merge #97 (fixed result folder constant) into provenance-views-cleanup
TorecLuik Nov 16, 2026
0207f8a
Merge #88 into detached-ownership
TorecLuik Nov 16, 2026
6b106bc
Merge detached-ownership into feat/canonical-sidecar-in-biomero-folders
TorecLuik Nov 16, 2026
708e3da
Merge feat/canonical-sidecar-in-biomero-folders into use-core-output-…
TorecLuik Nov 16, 2026
d0499b5
Use core's Canonical_Inputs output name, the shallow-storage flag, an…
TorecLuik Nov 16, 2026
34d9fa5
Merge fix/remove-input-marker-after-import into provenance-views-cleanup
TorecLuik Nov 16, 2026
f4ecc98
Merge provenance-views-cleanup into detached-ownership
TorecLuik Nov 16, 2026
9573c42
Merge detached-ownership into feat/canonical-sidecar-in-biomero-folders
TorecLuik Nov 16, 2026
963101f
Merge feat/canonical-sidecar-in-biomero-folders into use-core-output-…
TorecLuik Nov 16, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 8 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ scripts follow. Deployment and administration are documented in NL-BIOMERO.
| `__workflows/` | `SLURM_Run_Workflow.py`, `SLURM_Run_Workflow_Batched.py` | Run an analysis and retrieve results; optionally split inputs into batches. |
| `_data/` | Image/File Transfer, Remote Conversion, Get Update | Export inputs, convert formats and monitor jobs. |
| `_data/` | `SLURM_Get_Results.py`, `SLURM_Import_Results.py` | Upload results through OMERO or import in place with BIOMERO.importer. |
| `admin/` | Slurm Init, Check Setup, Shallow Storage Migration, Cownary, Tail Logs | Initialize and inspect the cluster, migrate managed storage metadata, maintain workflow metadata and diagnose execution. |
| `admin/` | Slurm Init, Check Setup, Shallow Storage Migration, Cownary, Cancel Workflow, Tail Logs | Initialize and inspect the cluster, migrate managed storage metadata, maintain workflow metadata and diagnose execution. |

CellPose Segmentation and Example Minimal Slurm Script are examples, not the
standard workflow entry points; NL-BIOMERO does not install them by default.
Expand All @@ -42,7 +42,8 @@ custom deployment, follow the [scripts installation guide](https://nl-bioimaging
and install the scripts on the OMERO server and detached worker.

Deploy matching core and scripts releases together. This release requires core's
`biomero.provenance` and `biomero.maintenance` APIs even when optional features
`biomero.metadata_views` (renamed from `biomero.provenance`) and
`biomero.maintenance` APIs even when optional features
are disabled. Prerelease tag counters can differ between repositories; use the
component references supplied by the NL-BIOMERO release.

Expand Down Expand Up @@ -219,8 +220,11 @@ Historical imports are inspected only when explicitly retried.
This protects image registration; it does not make optional ROI creation and
attachment postprocessing exactly-once operations.

Use an importer release that checks database write acknowledgement and recovers
interrupted shallow transactions before reading a store. These recovery changes
Use `biomero-importer>=1.5.0b14`: it keeps the canonical-source sidecars under
BIOMERO's own `.processed` folders, which the image transfer and the shallow
storage migration read through the importer's helpers. It also checks database
write acknowledgement and recovers interrupted shallow transactions before
reading a store. These recovery changes
support v2 and v3 and do not change canonical-store format or identity policy.

## Development
Expand Down
6 changes: 3 additions & 3 deletions __workflows/SLURM_CellPose_Segmentation.py
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ def runScript():
f"Error running CellPose job: {cp_result.stderr}")
slurmClient.workflowTracker.fail_workflow(
wf_id, "CellPose job submission failed")
client.setOutput("Message", rstring(
client.setOutput(constants.results.MESSAGE_OUTPUT, rstring(
f"Failed to submit job: {cp_result.stderr}"))
else:
print_result = f"Submitted to Slurm as batch job {slurm_job_id}."
Expand All @@ -229,12 +229,12 @@ def runScript():
logger.warning(print_result)
slurmClient.workflowTracker.fail_workflow(
wf_id, "Error checking job status")
client.setOutput("Message", rstring(print_result))
client.setOutput(constants.results.MESSAGE_OUTPUT, rstring(print_result))

# 7. Script output
logger.info(print_result)
if not 'ERROR' in print_result:
client.setOutput("Message", rstring(print_result))
client.setOutput(constants.results.MESSAGE_OUTPUT, rstring(print_result))
slurmClient.workflowTracker.complete_workflow(wf_id)
finally:
client.closeSession()
Expand Down
Loading
Loading