Skip to content

Disable NGAS ingest via a capo setting

Daniel Nemergut requested to merge disable_ngas_ingest into main

This sets ngas_ingest in the ingestion-manifest.json to the capo property archive-ingestion.ingestNGAS.

With this parameter set to false in the manifest, NGAS ingestion will be skipped by this line in manifestpersist.py:

    if ngas_ingest and len(ngas_files_to_ingest) > 0:
        ngas_archive(ngas_files_to_ingest, ingestion_path, fileset)

Example manifest when the capo setting archive-ingestion.ingestNGAS is true:

{
    "parameters": {
        "telescope": "VLBA",
        "reingest": "false",
        "ngas_ingest": "true",
        "ingestion_path": "/lustre/aoc/cluster/pipeline/docker/workspaces/staging/UG004M.ug004m"
    },
    "output_group": {
        "science_products": [
            ...
        ],
        "ancillary_products": [
            ...
        ]
    }
}

Example manifest when the capo setting archive-ingestion.ingestNGAS is false:

{
    "parameters": {
        "telescope": "VLBA",
        "reingest": "false",
        "ngas_ingest": "false",
        "ingestion_path": "/lustre/aoc/cluster/pipeline/docker/workspaces/staging/UG004M.ug004m"
    },
    "output_group": {
        "science_products": [
            ...
        ],
        "ancillary_products": [
            ...
        ]
    }
}
Edited by Daniel Nemergut

Merge request reports

Loading