Code

Refactor Job manager routes#296

Code

Merged

aldbr merged 37 commits intoDIRACGrid:mainDIRACGrid/diracx:mainfrom ryuwd:roneil-jobmgrryuwd/diracx:roneil-jobmgrCopy head branch name to clipboardDec 18, 2024

+3,194-4,764

Commits

Commits on Dec 16, 2024

• job_manager --> jobs

  ryuwd

  committed
  673769d

  Copy full SHA for 673769d

• split jobs router into multiple jobs router modules; simplify status routes for jobs router

  ryuwd

  committed
  6b4895d

  Copy full SHA for 6b4895d

• Get result correctly from tasks

  Show description for 5b26ffa
  

  ryuwd

  and

  chrisburr

  committed
  5b26ffa

  Copy full SHA for 5b26ffa

• Moved to avoid clashing wrong route being matched

  ryuwd

  committed
  305b3bc

  Copy full SHA for 305b3bc

• Fixed some tests

  Show description for 3f8f8fe
  ryuwd

  committed
  3f8f8fe

  Copy full SHA for 3f8f8fe

• Update doc for remove bulk

  Show description for f959cdc
  ryuwd

  committed
  f959cdc

  Copy full SHA for f959cdc

• Rescheduling including TODO regarding job state machine bug (check the comment)

  ryuwd

  committed
  030fdf1

  Copy full SHA for 030fdf1

• Major refactoring of job rescheduling

  Show description for 420c138
  ryuwd

  committed
  420c138

  Copy full SHA for 420c138

• Make reset_jobs optional

  ryuwd

  committed
  e99b3d1

  Copy full SHA for e99b3d1

• Improved job rescheduling and the test

  ryuwd

  committed
  e278df3

  Copy full SHA for e278df3

• Add missing MaxRescheduling to with_config_repo

  Show description for 1071b7e
  ryuwd

  committed
  1071b7e

  Copy full SHA for 1071b7e

• Start refactoring things to use generally less queries (start with reschedule_job, eventually will extend to set_job_statuses)

  ryuwd

  committed
  8286072

  Copy full SHA for 8286072

• Evolve set_job_status to do bulk operations

  ryuwd

  committed
  37adf07

  Copy full SHA for 37adf07

• refactored job submission to reduce the number of statements executed where possible

  Show description for e3b82cb
  ryuwd

  committed
  e3b82cb

  Copy full SHA for e3b82cb

• use _bulk function

  ryuwd

  committed
  09dbdb8

  Copy full SHA for 09dbdb8

• Fixing tests

  Show description for a53ba2c
  ryuwd

  committed
  a53ba2c

  Copy full SHA for a53ba2c

• assume check_permissions does the right thing

  Show description for 465b238
  ryuwd

  committed
  465b238

  Copy full SHA for 465b238

• JobException-->JobError

  ryuwd

  committed
  59d087f

  Copy full SHA for 59d087f

• remove dependencies from DiracxRouter inst

  ryuwd

  committed
  0a15146

  Copy full SHA for 0a15146

• more fun with tests

  Show description for e790989
  ryuwd

  committed
  e790989

  Copy full SHA for e790989

• update cs for test and new MaxRescheduling location under JobScheduling config

  Show description for 5871b2e
  ryuwd

  committed
  5871b2e

  Copy full SHA for 5871b2e

• Cleanup insert_bulk - use taskgroups, and single row inserts for job ID generation.

  ryuwd

  committed
  ad7e5e8

  Copy full SHA for ad7e5e8

• overwrite the correct method ...

  Show description for 1fb0f3a
  ryuwd

  committed
  1fb0f3a

  Copy full SHA for 1fb0f3a

• Fixed date truncation to avoid escaping issues in datetime formatting

  ryuwd

  committed
  97d37c3

  Copy full SHA for 97d37c3

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 76e0fc3
  pre-commit-ci[bot]

  committed
  76e0fc3

  Copy full SHA for 76e0fc3

• Remove stray comment

  ryuwd

  committed
  83dad27

  Copy full SHA for 83dad27

• Regenerate diracx client

  ryuwd

  committed
  4c0346d

  Copy full SHA for 4c0346d

Commits on Dec 17, 2024

• Moved non-DB related job submission logic out of diracx-db to diracx-routers.

  ryuwd

  committed
  80388dc

  Copy full SHA for 80388dc

• Move job status functions from diracx-db to diracx-routers

  ryuwd

  committed
  f0291b0

  Copy full SHA for f0291b0

• This is less than ideal

  ryuwd

  committed
  9b273c9

  Copy full SHA for 9b273c9

• Skip tests.

  ryuwd

  committed
  1625a40

  Copy full SHA for 1625a40

• refix tests

  ryuwd

  committed
  4df7c99

  Copy full SHA for 4df7c99

• We agreed to move these functions back into diracx-db utils module

  ryuwd

  committed
  8016b6c

  Copy full SHA for 8016b6c

• Gubbins hiccups

  ryuwd

  committed
  828e8c2

  Copy full SHA for 828e8c2

• cast to list

  ryuwd

  committed
  da1b717

  Copy full SHA for da1b717

• nearly..

  ryuwd

  committed
  f34c957

  Copy full SHA for f34c957

• I affirm that the tests will pass

  ryuwd

  committed
  57e610c

  Copy full SHA for 57e610c