Skip to content

WS-2227 Reusing rawdata directory

Daniel Nemergut requested to merge ws2227-recycle_raw_data into main

This updates the fetch templates to move the rawdata/ directory from the previous execution rather than running the productfetcher in capabilities that support multiple versions. This only included std_calibration, restore_cms, and std_restore_imaging. I determined this list by searching for what templates called the productfetcher and which of those were capabilities with multiple versions.

The capability versions now track the previous execution's spool directory in the prev_spool_dir workflow variable. This might be useful down the road. The fetch templates only use the basename of this full path to avoid moving rawdata from other environments (let's not steal from prod, yeah?)

There is also a change to conveyor to stop it from moving rawdata/ into the QA area and symlinking that in the spool.

Edited by Daniel Nemergut

Merge request reports