integrate XS into SES-shim ci build / test

[dckc]

briefly...

Agoric/agoric-sdk#1649 https://github.com/Agoric/agoric-sdk/blob/master/packages/xs-vat-worker/Makefile and see the submodule in https://github.com/Agoric/agoric-sdk/tree/master/packages/xs-vat-worker

@kriskowal had a less than enthusiastic reply to the submodule approach

there's also the issue of doing this on macos, possibly using docker...

cc @warner @erights

[dckc]

The xsnap package opens up other approaches to this.

ref Agoric/agoric-sdk#2194 , Agoric/agoric-sdk#2225

see also #535

[dckc]

I got a pass over the SES test suite running...

83 tests passed
16 tests failed

48 test scripts SKIPped for various reasons

details:
https://gist.github.com/dckc/75663ff47b714f4dbf10ecf6dd1f602c

cc @erights @kriskowal @warner @michaelfig

[dckc]

current status: 82bc8eb

91 tests passed
58 tests failed

22 scripts skipped:

• 7: babel
• 1: import.meta.url
• 14: boring errors/ dir

details: https://gist.github.com/dckc/83bdc1a4febf4f5eed4b7f9f08097f61

[dckc]

115 tests pass; 0 fail; 40 scripts SKIPped as of c61a2e9

I'm starting to feel pretty good about SES tests on XS. SKIPs are due to:

• 1: test-global-object-mutability.js SIGSEGV SIGSEGV in fxRunID in xsnap when running ses test-global-object-mutability.js test Moddable-OpenSource/moddable#627
• 1: test/test-break-function-eval.js Function constructor bug Function constructor subject to injection; can have global side-effects Moddable-OpenSource/moddable#623
• 1: test/error/test-assert-log.js Symbol toString Symbol.for('bar').toString() missing 'bar' (missing [[Description]] value) Moddable-OpenSource/moddable#621
• 4: v8 tests: e.stack is undefined; no captureStackTrace on XS
• 1: test/test-package.js import.meta.url requires enabling the parser plugin: 'importMeta'",
• 5: ava-xs console isn't like ava console
• 3: SES_IMPORT_REJECTED
• 2: SES_HTML_COMMENT_REJECTED
• 22: SES_EVAL_REJECTED and only the lockdown layer is running in XS; no babel

In some cases, several tests in a script should work on XS but the mechanism for excluding is at the whole script level.

details: https://gist.github.com/dckc/ecdcc72e0537ad069033b4f37ba1e90b
https://github.com/endojs/endo/tree/535-ava-xs

[rowgraus]

@dckc to check with @erights on the timeline for this. Is it required prior to the Stress Test phase in 3 weeks?

[dckc]

@kriskowal @warner finishing this involves making some decision on how to organize xsnap #681 ; ideally, producing something usable both for endo / ses testing and for agoric-sdk.

I sure don't want to destabilize the xsnap in agoric-sdk just now... so the question of when is tricky.

[kriskowal]

I’m closing this as a duplicate of #812 to be addressed by #1847

[kriskowal]

Reöpening because #1847 doesn’t address XS installation in CI. Tracking that here.

[kriskowal]

Endo has CI for SES that verifies that Lockdown runs to completion on XS #2465, #2259, and more to come in #2259 persuant to #400