Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: X-Pack EPM API Integration Tests.x-pack/test/fleet_api_integration/apis/epm/install_integration_in_multiple_spaces·ts - EPM Endpoints When installing system integration in multiple spaces should install kibana assets #161624

Closed
kibanamachine opened this issue Jul 11, 2023 · 14 comments · Fixed by #162113, #165237 or #172218
Assignees
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jul 11, 2023

A test failed on a tracked branch

[AxiosError: Request failed with status code 404] {
  code: 'ERR_BAD_REQUEST',
  config: {
    transitional: {
      silentJSONParsing: true,
      forcedJSONParsing: true,
      clarifyTimeoutError: false
    },
    adapter: [Function: httpAdapter],
    transformRequest: [ [Function: transformRequest] ],
    transformResponse: [ [Function: transformResponse] ],
    timeout: 0,
    xsrfCookieName: 'XSRF-TOKEN',
    xsrfHeaderName: 'X-XSRF-TOKEN',
    maxContentLength: 30000000,
    maxBodyLength: 30000000,
    env: { FormData: [Function] },
    validateStatus: [Function: validateStatus],
    headers: {
      Accept: 'application/json, text/plain, */*',
      'kbn-xsrf': 'kbn-client',
      'User-Agent': 'axios/0.27.2'
    },
    method: 'get',
    url: 'http://elastic:changeme@localhost:5620/internal/ftr/kbn_client_so/index-pattern/logs-*',
    httpsAgent: null,
    paramsSerializer: [Function: paramsSerializer],
    data: undefined
  },
  request: <ref *1> ClientRequest {
    _events: [Object: null prototype] {
      abort: [Function (anonymous)],
      aborted: [Function (anonymous)],
      connect: [Function (anonymous)],
      error: [Function (anonymous)],
      socket: [Function (anonymous)],
      timeout: [Function (anonymous)],
      finish: [Function: requestOnFinish]
    },
    _eventsCount: 7,
    _maxListeners: undefined,
    outputData: [],
    outputSize: 0,
    writable: true,
    destroyed: true,
    _last: true,
    chunkedEncoding: false,
    shouldKeepAlive: false,
    maxRequestsOnConnectionReached: false,
    _defaultKeepAlive: true,
    useChunkedEncodingByDefault: false,
    sendDate: false,
    _removedConnection: false,
    _removedContLen: false,
    _removedTE: false,
    strictContentLength: false,
    _contentLength: 0,
    _hasBody: true,
    _trailer: '',
    finished: true,
    _headerSent: true,
    _closed: true,
    socket: Socket {
      connecting: false,
      _hadError: false,
      _parent: null,
      _host: 'localhost',
      _closeAfterHandlingError: false,
      _readableState: [ReadableState],
      _events: [Object: null prototype],
      _eventsCount: 6,
      _maxListeners: undefined,
      _writableState: [WritableState],
      allowHalfOpen: false,
      _sockname: null,
      _pendingData: null,
      _pendingEncoding: '',
      server: null,
      _server: null,
      parser: null,
      _httpMessage: [Circular *1],
      write: [Function: writeAfterFIN],
      [Symbol(async_id_symbol)]: 116482,
      [Symbol(kHandle)]: null,
      [Symbol(lastWriteQueueSize)]: 0,
      [Symbol(timeout)]: null,
      [Symbol(kBuffer)]: null,
      [Symbol(kBufferCb)]: null,
      [Symbol(kBufferGen)]: null,
      [Symbol(kCapture)]: false,
      [Symbol(kSetNoDelay)]: false,
      [Symbol(kSetKeepAlive)]: true,
      [Symbol(kSetKeepAliveInitialDelay)]: 60,
      [Symbol(kBytesRead)]: 767,
      [Symbol(kBytesWritten)]: 244,
      [Symbol(RequestTimeout)]: undefined
    },
    _header: 'GET /internal/ftr/kbn_client_so/index-pattern/logs-* HTTP/1.1\r\n' +
      'Accept: application/json, text/plain, */*\r\n' +
      'kbn-xsrf: kbn-client\r\n' +
      'User-Agent: axios/0.27.2\r\n' +
      'Host: localhost:5620\r\n' +
      'Authorization: Basic ZWxhc3RpYzpjaGFuZ2VtZQ==\r\n' +
      'Connection: close\r\n' +
      '\r\n',
    _keepAliveTimeout: 0,
    _onPendingData: [Function: nop],
    agent: Agent {
      _events: [Object: null prototype],
      _eventsCount: 2,
      _maxListeners: undefined,
      defaultPort: 80,
      protocol: 'http:',
      options: [Object: null prototype],
      requests: [Object: null prototype] {},
      sockets: [Object: null prototype] {},
      freeSockets: [Object: null prototype] {},
      keepAliveMsecs: 1000,
      keepAlive: false,
      maxSockets: Infinity,
      maxFreeSockets: 256,
      scheduling: 'lifo',
      maxTotalSockets: Infinity,
      totalSocketCount: 0,
      [Symbol(kCapture)]: false
    },
    socketPath: undefined,
    method: 'GET',
    maxHeaderSize: undefined,
    insecureHTTPParser: undefined,
    path: '/internal/ftr/kbn_client_so/index-pattern/logs-*',
    _ended: true,
    res: IncomingMessage {
      _readableState: [ReadableState],
      _events: [Object: null prototype],
      _eventsCount: 4,
      _maxListeners: undefined,
      socket: [Socket],
      httpVersionMajor: 1,
      httpVersionMinor: 1,
      httpVersion: '1.1',
      complete: true,
      rawHeaders: [Array],
      rawTrailers: [],
      aborted: false,
      upgrade: false,
      url: '',
      method: null,
      statusCode: 404,
      statusMessage: 'Not Found',
      client: [Socket],
      _consuming: false,
      _dumped: false,
      req: [Circular *1],
      responseUrl: 'http://elastic:changeme@localhost:5620/internal/ftr/kbn_client_so/index-pattern/logs-*',
      redirects: [],
      [Symbol(kCapture)]: false,
      [Symbol(kHeaders)]: [Object],
      [Symbol(kHeadersCount)]: 24,
      [Symbol(kTrailers)]: null,
      [Symbol(kTrailersCount)]: 0,
      [Symbol(RequestTimeout)]: undefined
    },
    aborted: false,
    timeoutCb: null,
    upgradeOrConnect: false,
    parser: null,
    maxHeadersCount: null,
    reusedSocket: false,
    host: 'localhost',
    protocol: 'http:',
    _redirectable: Writable {
      _writableState: [WritableState],
      _events: [Object: null prototype],
      _eventsCount: 3,
      _maxListeners: undefined,
      _options: [Object],
      _ended: true,
      _ending: true,
      _redirectCount: 0,
      _redirects: [],
      _requestBodyLength: 0,
      _requestBodyBuffers: [],
      _onNativeResponse: [Function (anonymous)],
      _currentRequest: [Circular *1],
      _currentUrl: 'http://elastic:changeme@localhost:5620/internal/ftr/kbn_client_so/index-pattern/logs-*',
      [Symbol(kCapture)]: false
    },
    [Symbol(kCapture)]: false,
    [Symbol(kBytesWritten)]: 0,
    [Symbol(kEndCalled)]: true,
    [Symbol(kNeedDrain)]: false,
    [Symbol(corked)]: 0,
    [Symbol(kOutHeaders)]: [Object: null prototype] {
      accept: [Array],
      'kbn-xsrf': [Array],
      'user-agent': [Array],
      host: [Array],
      authorization: [Array]
    },
    [Symbol(kUniqueHeaders)]: null
  },
  response: {
    status: 404,
    statusText: 'Not Found',
    headers: {
      'x-content-type-options': 'nosniff',
      'referrer-policy': 'no-referrer-when-downgrade',
      'permissions-policy': 'camera=(), display-capture=(), fullscreen=(self), geolocation=(), microphone=(), web-share=()',
      'cross-origin-opener-policy': 'same-origin',
      'content-security-policy': "script-src 'self'; worker-src blob: 'self'; style-src 'unsafe-inline' 'self'",
      'kbn-name': 'kb-n2-4-spot-55882b3929661394',
      'kbn-license-sig': 'd89a2394674a1ef2a2dd8acf01a97364c5423c108e84ba051234e710ba78aeb5',
      'content-type': 'application/json; charset=utf-8',
      'cache-control': 'private, no-cache, no-store, must-revalidate',
      'content-length': '96',
      date: 'Tue, 11 Jul 2023 08:37:09 GMT',
      connection: 'close'
    },
    config: {
      transitional: [Object],
      adapter: [Function: httpAdapter],
      transformRequest: [Array],
      transformResponse: [Array],
      timeout: 0,
      xsrfCookieName: 'XSRF-TOKEN',
      xsrfHeaderName: 'X-XSRF-TOKEN',
      maxContentLength: 30000000,
      maxBodyLength: 30000000,
      env: [Object],
      validateStatus: [Function: validateStatus],
      headers: [Object],
      method: 'get',
      url: 'http://elastic:changeme@localhost:5620/internal/ftr/kbn_client_so/index-pattern/logs-*',
      httpsAgent: null,
      paramsSerializer: [Function: paramsSerializer],
      data: undefined
    },
    request: <ref *1> ClientRequest {
      _events: [Object: null prototype],
      _eventsCount: 7,
      _maxListeners: undefined,
      outputData: [],
      outputSize: 0,
      writable: true,
      destroyed: true,
      _last: true,
      chunkedEncoding: false,
      shouldKeepAlive: false,
      maxRequestsOnConnectionReached: false,
      _defaultKeepAlive: true,
      useChunkedEncodingByDefault: false,
      sendDate: false,
      _removedConnection: false,
      _removedContLen: false,
    
[report_failure] output truncated to 8192 characters

First failure: CI Build - main

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jul 11, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 11, 2023
@mistic mistic added the Team:Fleet Team label for Observability Data Collection Fleet team label Jul 11, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 11, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@juliaElastic juliaElastic self-assigned this Jul 18, 2023
juliaElastic added a commit that referenced this issue Jul 18, 2023
## Summary

Fixes #161624

Test failed due to an unrelated endpoint installation error, loading
empty ES to make sure endpoint doesn't cause trouble, as the test
installs system integration.
ThomThomson pushed a commit to ThomThomson/kibana that referenced this issue Aug 1, 2023
## Summary

Fixes elastic#161624

Test failed due to an unrelated endpoint installation error, loading
empty ES to make sure endpoint doesn't cause trouble, as the test
installs system integration.
@kibanamachine kibanamachine reopened this Aug 2, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@dmlemeshko
Copy link
Member

[00:08:34]         │ proc [kibana] [2023-08-02T10:21:23.449+00:00][WARN ][plugins.fleet] Failed installing package [endpoint] due to error: [ResponseError: resource_not_found_exception
[00:08:34]         │ proc [kibana] 	Root causes:
[00:08:34]         │ proc [kibana] 		resource_not_found_exception: Transform with id [endpoint.metadata_united-default-8.9.1] could not be found]

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@mistic
Copy link
Member

mistic commented Aug 15, 2023

Skipped.

main: 1857f73

bryce-b pushed a commit that referenced this issue Aug 22, 2023
@jlind23
Copy link
Contributor

jlind23 commented Aug 25, 2023

@juliaElastic Looks like this was a problem with endpoint, should we reenable the test?

@juliaElastic
Copy link
Contributor

I don't really understand why endpoint failed this test, it shouldn't after this fix, which should use an empty ES before the test. This needs some investigation.

juliaElastic added a commit that referenced this issue Aug 30, 2023
Re-enable flaky tests

Closes #161624
Closes #156941
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Aug 30, 2023
Re-enable flaky tests

Closes elastic#161624
Closes elastic#156941

(cherry picked from commit 77f1a11)
kibanamachine referenced this issue Aug 30, 2023
# Backport

This will backport the following commits from `main` to `8.10`:
- [enable flaky
(#165237)](#165237)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Julia
Bardi","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-08-30T15:59:19Z","message":"enable
flaky (#165237)\n\nRe-enable flaky tests\r\n\r\nCloses
https://github.com/elastic/kibana/issues/161624\r\nCloses
https://github.com/elastic/kibana/issues/156941","sha":"77f1a11f11a443667e78c1afbbebee4d901b5431","branchLabelMapping":{"^v8.11.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Fleet","v8.10.0","v8.11.0"],"number":165237,"url":"https://github.com/elastic/kibana/pull/165237","mergeCommit":{"message":"enable
flaky (#165237)\n\nRe-enable flaky tests\r\n\r\nCloses
https://github.com/elastic/kibana/issues/161624\r\nCloses
https://github.com/elastic/kibana/issues/156941","sha":"77f1a11f11a443667e78c1afbbebee4d901b5431"}},"sourceBranch":"main","suggestedTargetBranches":["8.10"],"targetPullRequestStates":[{"branch":"8.10","label":"v8.10.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.11.0","labelRegex":"^v8.11.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/165237","number":165237,"mergeCommit":{"message":"enable
flaky (#165237)\n\nRe-enable flaky tests\r\n\r\nCloses
https://github.com/elastic/kibana/issues/161624\r\nCloses
https://github.com/elastic/kibana/issues/156941","sha":"77f1a11f11a443667e78c1afbbebee4d901b5431"}}]}]
BACKPORT-->

Co-authored-by: Julia Bardi <[email protected]>
eokoneyo pushed a commit to eokoneyo/kibana that referenced this issue Aug 31, 2023
@kibanamachine kibanamachine reopened this Oct 3, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@mistic mistic closed this as completed Oct 3, 2023
@kibanamachine kibanamachine reopened this Oct 4, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@mistic
Copy link
Member

mistic commented Oct 4, 2023

Skipped.

main: 0d6a3cf

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

kpollich added a commit that referenced this issue Dec 5, 2023
## Summary

Adds additional retries, unskips a bunch of suites, mocks out some
network dependencies for product versions.

Will kick off some flaky test runner jobs for this PR.

Closes #162545
Ref #138905
Closes #161624
Closes #171160
Closes #171536
Closes #171541
Closes #172114
Closes #171052
Closes #172129
Closes #172128
Closes #172127

---------

Co-authored-by: Kibana Machine <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
6 participants