Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

E2E Tests (Release 24.08) #150

Closed
74 tasks done
drcgjung opened this issue Jul 24, 2024 · 4 comments
Closed
74 tasks done

E2E Tests (Release 24.08) #150

drcgjung opened this issue Jul 24, 2024 · 4 comments
Assignees
Labels
documentation Improvements or additions to documentation

Comments

@drcgjung
Copy link
Contributor

drcgjung commented Jul 24, 2024

Please open and fill in this issue in your product repository to document the status of E2E tests.

**Show success/failure ** by attaching screenshots and/or result documents/failure messages.

Close this issue once the status of the E2E tests has been documented

Testers(s) and Role(s):

  • Oghuzan Balandi (T-Systems, CONSUMER, SUPPLIER)
  • Christoph Jung (T-Systems, OEM, PROVIDER, PRODUCER)

Deployment/Umbrella Chart Coordinates:

Tested Sub-Charts/Versions:

  • tractusx-connector-azure-vault:0.7.3
  • agent-plane-azure-vault:1.13.21-SNAPSHOT
  • conforming-agent:1.13.21-SNAPSHOT
  • matchmaking-agent:1.13.21-SNAPSHOT
  • remoting-agent:1.13.21-SNAPSHOT
  • provisioning-agent:1.13.21-SNAPSHOT
  • aas-bridge:1.13.7-SNAPSHOT

Retest with:

  • agent-plane-azure-vault:1.13.22-SNAPSHOT
  • matchmaking-agent:1.13.22-SNAPSHOT

Release Management Reference Issue:

eclipse-tractusx/sig-release#823

Preconditions / Integration Tests

  • For Release 2408 Integration Test various scenarios need to be performed by the testing parties depending on their role (CONSUMER, OEM, PROVIDER, PRODUCER, SUPPLIER).
  • Example performances of the integration steps can be found in the postman collection

CONSUMER of a sample OEM and PROVIDER:

  • Deploy Agent-Enabled Connector
  • Perform Remote Catalogue Request (OEM and PROVIDER)
  • Check Federated Catalogue (need to list OEM and PROVIDER assets)

OEM for a sample SUPPLIER, access Provisioning Agents and register a graph

  • Deploy Agent-Enabled Connector
  • Perform Remote Catalogue Request (against SUPPLIER)
  • Check Federated Catalogue (needs to see SUPPLIER and PROVIDER assets)
  • Deploy Provisioning Agent
  • Access Provisioning Agent (Reliability)
  • Access Provisioning Agent (Supply Chain)
  • Register Graph Asset(s)
  • Register Graph Policy
  • Register Graph Contract

SUPPLIER for a sample PRODUCER and OEM, access Remoting Agent and register a graph

  • Deploy Agent-Enabled Connector
  • Perform Remote Catalogue Request (against PRODUCER and OEM)
  • Check Federated Catalogue (of PRODUCER and OEM)
  • Deploy Remoting Agent with RUL binding
  • Access Remoting Agent (Remaining Useful Life)
  • Register Graph Asset
  • Upload Graph Asset (Supply Chain)
  • Register Graph Policy
  • Register Graph Contract

PRODUCER for a sample SUPPLIER and register a graph

  • Deploy Agent-Enabled Connector
  • Perform Remote Catalogue Request
  • Check Federated Catalogue (needs to see SUPPLIER and PROVIDER)
  • Upload Graph Asset (Supply Chain)
  • Register Graph Policy
  • Register Graph Contract

PROVIDER for sample OEM, SUPPLIER and PRODUCER and register a Skill

  • Deploy Agent-Enabled Connector
  • Perform Remote Catalogue Request (against OEM, SUPPLIER and PRODUCER)
  • Register Skill Asset
  • Register Skill Policy
  • Register Skill Contract

Test Plan

  • The Test Steps are documented as API interactions in this postman collection.
  • The concrete Test environment is referred in this postman environment. The necessary secrets will be communicated by the test management in private.

PROVIDER Test

CONSUMER Test

Hints

Information Sharing

@drcgjung drcgjung added the documentation Improvements or additions to documentation label Jul 24, 2024
@drcgjung drcgjung moved this from 🆕 New to 🏗 In progress in Knowledge Agent Kanban Board Jul 24, 2024
@drcgjung
Copy link
Contributor Author

drcgjung commented Jul 24, 2024

PROVIDER Test Execution (3 Tests Failed)

Bildschirmfoto 2024-07-24 um 12 52 43

Bildschirmfoto 2024-07-24 um 12 55 09

Bildschirmfoto 2024-07-24 um 12 56 00

Bildschirmfoto 2024-07-24 um 12 56 53

Bildschirmfoto 2024-07-24 um 12 57 32

Bildschirmfoto 2024-07-24 um 12 58 20

Bildschirmfoto 2024-07-24 um 12 59 01

Bildschirmfoto 2024-07-24 um 12 59 40

Bildschirmfoto 2024-07-24 um 13 00 15

Bildschirmfoto 2024-07-24 um 13 01 36

Bildschirmfoto 2024-07-24 um 13 02 22

Bildschirmfoto 2024-07-24 um 13 02 56

Bildschirmfoto 2024-07-24 um 13 04 30

Bildschirmfoto 2024-07-24 um 13 05 46

Bildschirmfoto 2024-07-24 um 13 06 33

Bildschirmfoto 2024-07-24 um 13 07 15

Bildschirmfoto 2024-07-24 um 13 08 56

Bildschirmfoto 2024-07-24 um 14 31 24

Bildschirmfoto 2024-07-24 um 14 31 53

Bildschirmfoto 2024-07-24 um 14 32 16

Bildschirmfoto 2024-07-24 um 14 32 30

Bildschirmfoto 2024-07-24 um 14 33 13

Bildschirmfoto 2024-07-24 um 14 35 32

Bildschirmfoto 2024-07-24 um 14 35 53

Bildschirmfoto 2024-07-24 um 14 36 08

Bildschirmfoto 2024-07-24 um 14 36 21

Bildschirmfoto 2024-07-24 um 14 36 41

Bildschirmfoto 2024-07-24 um 14 36 55

Bildschirmfoto 2024-07-24 um 14 37 10

Bildschirmfoto 2024-07-24 um 14 37 30

@drcgjung
Copy link
Contributor Author

CONSUMER Test Execution (1 Test failed)

Bildschirmfoto 2024-07-24 um 14 41 29

Bildschirmfoto 2024-07-24 um 14 43 34

Bildschirmfoto 2024-07-24 um 14 43 55

Bildschirmfoto 2024-07-24 um 14 44 14

Bildschirmfoto 2024-07-24 um 14 45 05

Bildschirmfoto 2024-07-24 um 14 45 28

Bildschirmfoto 2024-07-24 um 14 45 45

Bildschirmfoto 2024-07-24 um 14 46 19

Bildschirmfoto 2024-07-24 um 14 46 38

Bildschirmfoto 2024-07-24 um 14 47 03

Bildschirmfoto 2024-07-24 um 14 50 15

Bildschirmfoto 2024-07-24 um 14 51 18

@drcgjung
Copy link
Contributor Author

PROVIDER Retest

Bildschirmfoto 2024-07-26 um 07 25 12

Bildschirmfoto 2024-07-26 um 07 25 27

Bildschirmfoto 2024-07-26 um 07 26 16

@drcgjung
Copy link
Contributor Author

CONSUMER Retest

Bildschirmfoto 2024-07-26 um 07 38 30

Bildschirmfoto 2024-07-26 um 07 36 53

Bildschirmfoto 2024-07-26 um 07 37 20

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
Status: ✅ Done
Development

No branches or pull requests

2 participants