Integration Tests

[farmaazon]

Pull Request Description

A stub for integration tests to be run locally; part of #8487

To run tests, you need to:

1. Build IDE package: ./run ide build
2. set ENSO_TEST_USER and ENSO_TEST_USER_PASSWORD to some working credentials (I used my personal account, but there will be also test user soon)
3. run corepack pnpm -r --filter enso exec playwright test

The tests are run with a separate projects directory set up in tmpdir, so any local workspace dir is not affected.

The only test so far just checks if it's possible to log in and create a new project.

Important Notes

Checklist

Please ensure that the following checklist has been satisfied before submitting the PR:

• The documentation has been updated, if necessary.
• [ ] Screenshots/screencasts have been attached, if there are any visual changes. For interactive or animated visual changes, a screencast is preferred.
• All code follows the
  Scala,
  Java,
  TypeScript,
  and
  Rust
  style guides. In case you are using a language not listed above, follow the Rust style guide.
• [ ] Unit tests have been written where possible.

[somebody1234]

optional: consider using a regex instead

[somebody1234]

nit: personal preference but i like it when code (ENSO_TEST_USER) is surrounded by backticks

[somebody1234]

i suppose this is sufficient for now. but we will probably want to extract dashboard and/or GUI actions to a shared package

[somebody1234]

nit re: file name - for test files named after actions, i name them like methods - so present (present simple) tense instead of continuous tense (createNewProject)

[somebody1234]

nit: consider inspect\b and port\b. not perfect but might as well

[JaroslavTulach]

I am at 96fa2ee and I tried:

enso$ ./run ide build
enso$ corepack pnpm -r --filter enso exec playwright test
Running 1 test using 1 worker

  ✘  1 electronTest.ts:13:3 › Create new project (287ms)


  1) electronTest.ts:13:3 › Create new project ─────────────────────────────────────────────────────

    Error: Process failed to launch!

  1 failed
    electronTest.ts:13:3 › Create new project ──────────────────────────────────────────────────────
/enso/app/ide-desktop/client:
 ERR_PNPM_RECURSIVE_EXEC_FIRST_FAIL  Command failed with exit code 1: playwright test

I guess either the ./run command or the instructions need to be updated to make sure playwright is installed on my computer.

[somebody1234]

maybe you're missing pnpm i?

[farmaazon]

I guess either the ./run command or the instructions need to be updated to make sure playwright is installed on my computer.

No, playwright is installed by pnpm (in this case: as part of ./run ide build.

The issue is very strange, could you run it with DEBUG="pw:browser log:"?

[JaroslavTulach]

./run ide build

With 73abe90 I can:

enso$ export DEBUG="pw:browser log:"
enso$ ./run ide build
...
INFO main_internal: enso_build_cli: close
INFO enso_build_cli: Successfully ending.

and then corepack pnpm -r --filter enso exec playwright test really opens browser and tries to log in. That fails, but things seem to be on right track.