[APM] 7.11 Test plan

[sorenlouv]

The 7.11 test plan consists of:

• PRs created before FF (DONE)
• 3 road map goals (DONE)
• PRs create after FF (DONE)

Road map goals

These should be tested extra carefully. Instead of testing individual PRs one person should test the entirety of the road map feature. The PRs are only listed to help the tester remember what went into the feature.

1. Every item in the "Pay special attention to" section should be taken into account.
2. Find an item with untested tag. Add your @username. When done add Tested prefix

Road map goals

• Tested Service Overview Page
  • Errors Table
  • Dependencies table
  • Transactions table
  • Transaction Type logic ([APM] Service overview: Ensure transactionType is used for by every component #85665, [APM] Service overview: Display transaction type in search bar #86143)
  • Instance Table
  • Make default landing page
• Tested Trace Logs Integration ([APM] Adds "Logs" tab to transaction details for related trace logs #85859)
• Tested Alert Preview (APM Alerts Preview charts #85868)

---

Important PRs

• Open the list of important PRs in the test plan
• Assign yourself to a PR as you start testing it to avoid duplicate work
• After testing apply apm:test-plan-done label. If a problem is found during testing a new issue should be opened and labelled apm:test-plan-regression and moved to "7.11" column.

---

Pay special attention to

• License issues (bugs affecting users with certain licenses)
• Permissions (bugs affecting users with specific privileges)
• No data states (bugs caused when no APM data was ingested, no ML jobs existed, no alerts existed etc)
• Integration with other teams in general

If you haven't already please read the common theme of bugs

Creating users locally

node ./x-pack/plugins/apm/scripts/setup-kibana-security.js --role-suffix <your username> --username elastic --password changeme --kibana-url http://localhost:5601

creates the following users (username / password):

• apm_read_user / changeme
• kibana_read_user / changeme
• kibana_write_user / changeme

Notes:

• Some bugs are hard to spot
  • Example [APM] Service overview: Bug? Transactions and service instances Traffic (tpm) show incorrect values #88268. Throughput was calculated incorrectly and not spotted because the values arbitrary at a glance.