Portal forecast pipeline issues

[henrykironde]

Issue Report: Portal Forecasts Script Failure

Description:
It seems that the Portal Forecasts script is encountering failures midway but proceeds to the next command.

Observation:
The current suspicion is that the failure is related to memory issues. An updated version exists with increased memory allocation, but the local script hasn't been updated accordingly. The Cron job needs to handle the script updates before execution.

Point of Action:

• Cron Job Update:

  • Add a Cron job to execute before running either of the mentioned scripts: portal_weekly_forecast and portal_dryrun_forecast.

• Pipeline Integrity:

  • Implement a mechanism to force the entire pipeline to fail if any steps prior to archiving encounter failures.

Commands:

echo "INFO [$(date "+%Y-%m-%d %H:%M:%S")] Running Portal Forecasts"
singularity run ../portalcasting_latest.sif Rscript PortalForecasts.R