Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

PAI logging pipeline enhance #4992

Closed
7 of 8 tasks
Binyang2014 opened this issue Oct 20, 2020 · 0 comments
Closed
7 of 8 tasks

PAI logging pipeline enhance #4992

Binyang2014 opened this issue Oct 20, 2020 · 0 comments
Assignees
Labels

Comments

@Binyang2014
Copy link
Contributor

Binyang2014 commented Oct 20, 2020

There are many logging system related issue: #4865, #4694, #4615, #4468
Will try to solve these issue by this enhance:

Our goal:

  1. Unified log design
  2. Consider about log retrieve permission
  3. Resolve log lose when node crash and disk-pressure issue

Work Item:

resp:
{
   locations: [
      {name: stdout. uri: https://nodeIP/podUid/stdout.0?token=string}
      {name: stderr, uri: https://rest/v1/string……id/token?string}
   ]
}

Use this API: GET /jobs/{job-name}/pods/{podUid}/logs?tail_mode=true to retrieve the tail log

---------------backlog---------------------

  • Upload user log to Azure Blob P1
  • Change res-server to auth with Azure and return the log uri P1
@Binyang2014 Binyang2014 changed the title PAI log pipeline enhance PAI logging pipeline enhance Oct 20, 2020
@Binyang2014 Binyang2014 self-assigned this Oct 20, 2020
@suiguoxin suiguoxin mentioned this issue Nov 16, 2020
39 tasks
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants