3.9.0.17

[PalNilsson]

• Time-out in url open function now configurable
  • Before, a time out of 30 s was used, but it was seen in Rubin that it might not be enough
  • The time-out is now 120 s, but can be changed in the pilot config file
  • Requested by W.Guan
• Update to main command execution function which now uses threads to handle stdout/stderr from command
  • It is suspected that too much output can cause buffer overflow, which theoretically could hang the pilot python process
• Using a stack instead of recursion in function for finding processes that belong to a group
  • Problem seen on UNI-SIEGEN-HEP with a large number of processes, leading to max recursion depth
• OIDC tokens on HPCs
  • Pilot can now skip token renewal if keyword NO_TOKEN_RENEWAL is present in PQ.catchall
  • Renewal mechanism on HPCs is done in Harvester
• Bug fixes
  • Prevented threaded heartbeat function to send anything but “running” state
    • This fixes a rare case when the “finished” state was sent before the log transfer had finished
    • Reported by Z. Yang (Rubin)
  • Now sending ddmendpoint info with field ‘endpoint’ instead of ‘ddmendpoint’
    • See discussion in JIRA ticket about alternative stage-out: ATLASPANDA-994
  • Harmless problem in server update function when debug mode is switched on by the pilot
    • Unexpected server response; “Succeeded” instead of “StatusCode=0”, where the former could not be parsed by parse_qs() urllib function)