more tests in experimental conformance profile report

[arkodg]

No description provided.

[codecov]

Codecov Report

Merging #2056 (ab8ebc8) into main (fdcd9e4) will decrease coverage by 0.12%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #2056      +/-   ##
==========================================
- Coverage   65.32%   65.20%   -0.12%     
==========================================
  Files          99       99              
  Lines       14640    14640              
==========================================
- Hits         9563     9546      -17     
- Misses       4493     4508      +15     
- Partials      584      586       +2     

see 2 files with indirect coverage changes

[arkodg]

something is broken in the conformance framework, ive disabled the mesh feature, but the tests still run
cc @Xunzhuo

[Xunzhuo]

This is sn upstream bug. I manually remove them before. The current way is already included all tests except skip tests.

[arkodg]

blocked on kubernetes-sigs/gateway-api#2515

[arkodg]

hey @Xunzhuo where's the report artifact :) ?

[Xunzhuo]

https://github.com/envoyproxy/gateway/actions/runs/6648815440?pr=2056

@arkodg

[arkodg]

thanks
looks like we should work on enabling the skipped tests before v0.6

apiVersion: gateway.networking.k8s.io/v1alpha1
date: "2023-10-26T02:53:47Z"
gatewayAPIVersion: TODO
implementation:
  contact:
  - https://github.com/envoyproxy/gateway/blob/main/GOVERNANCE.md
  organization: envoyproxy
  project: envoy-gateway
  url: https://github.com/envoyproxy/gateway
  version: latest
kind: ConformanceReport
profiles:
- core:
    result: partial
    skippedTests:
    - GatewaySecretInvalidReferenceGrant
    statistics:
      Failed: 0
      Passed: 9
      Skipped: 1
    summary: ""
  name: TLS
- core:
    result: partial
    skippedTests:
    - GatewaySecretInvalidReferenceGrant
    - GatewayWithAttachedRoutes
    statistics:
      Failed: 0
      Passed: 27
      Skipped: 2
    summary: ""
  extended:
    result: partial
    skippedTests:
    - HTTPRouteRewritePath
    statistics:
      Failed: 0
      Passed: 11
      Skipped: 1
    summary: ""
    supportedFeatures:
    - HTTPRoutePortRedirect
    - HTTPRoutePathRedirect
    - HTTPRouteRequestTimeout
    - HTTPRouteQueryParamMatching
    - HTTPRouteRequestMultipleMirrors
    - HTTPRoutePathRewrite
    - HTTPRouteBackendTimeout
    - HTTPRouteSchemeRedirect
    - HTTPRouteHostRewrite
    - HTTPRouteRequestMirror
    - HTTPRouteMethodMatching
    - HTTPRouteResponseHeaderModification
  name: HTTP