WS-528: Fix HTCondor environment for `ingest`
ingest_cal
submit file:
-
Added environment variables that link external libraries for MySQL and Oracle -
Added 1GB memory request to avoid an out-of-memory error I was getting
ingest
PEX:
-
Rebuilt ingest
PEX on RHEL 7 machine and pushed it up to the devsbin
area -
Temporarily changed hard-coded ingestion manifest file name fromChanged back and redeployed.ingestion-manifest.json
->ingestion_manifest.json
(will change back after a manifest generator fix uses the former naming scheme; it currently uses the latter naming scheme)
ingest-request.sh
:
-
Changed capo
call to usepycapo
-
Added apt install curl
to workflow container Dockerfiles (ingest-request.sh
uses it)
ingest_cal
workflow testing:
-
Ran an ingest workflow on dev and got past the MySQL/Oracle library issues -
Ran a fully successful ingest_cal
workflow
Miscellaneous:
-
Removed dependency on db
container forschema-dev
docker-compose
service -
Added a few gripes
Completes ticket WS-571
Edited by Nathan Hertz