Skip to content

Lustre locking the remaining ingest workflows to be consistent

Daniel Nemergut requested to merge ingest_workflows_lustre_lock into 2.8.2.1-DEVELOMENT

We decided to make all the ingest workflows operate the same way. This modifies the ingest_cal, ingest_image, and ingest_seci workflows all in the same manner:

ingest_*.condor

  1. Set should_transfer_files = NO
  2. Remove the SBIN_PATH and SPOOL_DIR variables
  3. Remove the transfer_input_files line
  4. Set requirements = HasLustre == True

ingest_*.sh

  1. Set SBIN_PATH = /lustre/aoc/cluster/pipeline/$ENV(CAPO_PROFILE)/workspaces/sbin
  2. Call scripts from the SBIN_PATH

Also verified that requires_lustre = true in the workflows table for each.

Merge request reports