[FEA] Use environment variables to set thresholds in static yaml configurations #1387
Labels
cicd
feature request
New feature or request
user_tools
Scope the wrapper module running CSP, QualX, and reports (python)
Is your feature request related to a problem? Please describe.
Currently, we have some thresholds hardcoded in the yaml configurations of the qualification/profiling tool.
Recently, the daily QA tests are failing because the
totalCoreSecThreshold
defined in qualification-conf.yaml is too strict which causes all the eventlogs to be filtered out.In general, we should be able:
Describe the solution you'd like
Modify the tools to parse the yaml file after resolving the environment variables. The variable will use the default if no env_variable is defined.
This will be done for both
spillThresholdBytes
, andtotalCoreSecThreshold
For example:
The ENV_VAR names follow the same pattern commonly used "RAPIDS_USER_TOOLS_*". If we want that shorter, I like to change all other env_variables.
CC: @mattahrens @tgravescs
The text was updated successfully, but these errors were encountered: