anacrophobia error in restart with wallet UI

[warner]

As mentioned in Agoric/cosmic-swingset#124, we're seeing a replay failure when we bounce the scenario2 solo node after hitting it with the wallet UI.

STR:

• scenario2-setup
• scenario2-run-chain (remains running)
• scenario2-run-client
• start wallet-frontend, open web page, hit "Connect" (sends a few messages to the solo node)
• hit "Disconnect", close web page, stop wallet-frontend
• stop the scenario2-run-client
• restart the scenario2-run-client, get error during replay of vat-http:

Replaying transcript of vatID v3
subscribing to canvasStatePublisher
vat-http.inbound (from browser) 0 Object <[Object: null prototype] {}> { type: 'walletGetPurses' }
vat-http.inbound (from browser) 1 Object <[Object: null prototype] {}> { type: 'walletGetInbox' }
vat-http.inbound (from browser) 1 Object <[Object: null prototype] {}> { type: 'walletGetInbox' }
anachrophobia strikes vat v3
expected: {"0":"send","1":"o-67","2":"processInbound","3":{"body":"[{\"type\":\"walletGetInbox\"},{\"gallery\":{\"@qclass\":\"slot\",\"index\":0},\"purse\":{\"@qclass\":\"slot\",\"index\":1},\"canvasStatePublisher\":{\"@qclass\":\"slot\",\"index\":2},\"chainTimerService\":{\"@qclass\":\"slot\",\"index\":3},\"sharingService\":{\"@qclass\":\"slot\",\"index\":4},\"contractHost\":{\"@qclass\":\"slot\",\"index\":5},\"registrar\":{\"@qclass\":\"slot\",\"index\":6},\"zoe\":{\"@qclass\":\"slot\",\"index\":7},\"localTimerService\":{\"@qclass\":\"slot\",\"index\":8},\"uploads\":{\"@qclass\":\"slot\",\"index\":9},\"spawner\":{\"@qclass\":\"slot\",\"index\":10},\"wallet\":{\"@qclass\":\"slot\",\"index\":11},\"exchange\":{\"@qclass\":\"slot\",\"index\":12},\"http\":{\"@qclass\":\"slot\",\"index\":13}}]","slots":{"0":"o-52","1":"o-53","2":"o-54","3":"o-55","4":"o-56","5":"o-57","6":"o-58","7":"o-59","8":"o-60","9":"p-62","10":"p-63","11":"p-64","12":"o-61","13":"o-62","length":14}},"4":"p+9","length":5}
got     : {"0":"send","1":"o-67","2":"processInbound","3":{"body":"[{\"type\":\"walletGetInbox\"},{\"gallery\":{\"@qclass\":\"slot\",\"index\":0},\"purse\":{\"@qclass\":\"slot\",\"index\":1},\"canvasStatePublisher\":{\"@qclass\":\"slot\",\"index\":2},\"chainTimerService\":{\"@qclass\":\"slot\",\"index\":3},\"sharingService\":{\"@qclass\":\"slot\",\"index\":4},\"contractHost\":{\"@qclass\":\"slot\",\"index\":5},\"registrar\":{\"@qclass\":\"slot\",\"index\":6},\"zoe\":{\"@qclass\":\"slot\",\"index\":7},\"localTimerService\":{\"@qclass\":\"slot\",\"index\":8},\"uploads\":{\"@qclass\":\"slot\",\"index\":9},\"spawner\":{\"@qclass\":\"slot\",\"index\":10},\"wallet\":{\"@qclass\":\"slot\",\"index\":11},\"exchange\":{\"@qclass\":\"slot\",\"index\":12},\"http\":{\"@qclass\":\"slot\",\"index\":13}}]","slots":{"0":"o-52","1":"o-53","2":"o-54","3":"o-55","4":"o-56","5":"o-57","6":"o-58","7":"o-59","8":"o-60","9":"p-62","10":"p-63","11":"p-64","12":"o-61","13":"o-62","length":14}},"4":"p+10","length":5}
anachrophobia strikes vat v3
expected: {"0":"subscribe","1":"p+9","length":2}
got     : {"0":"callNow","1":"d-70","2":"sendResponse","3":{"body":"[1,true,{\"@qclass\":\"error\",\"name\":\"Error\",\"message\":\"historical inaccuracy in replay-send\"}]","slots":{"length":0}},"length":4}
doProcess: Replay failed: [deliver, o+0, inbound, {"body":"[1,{\"type\":\"walletGetInbox\"}]","slots":[]}]: Error: historical inaccuracy in replay-callNow Error <Object <[Object: null prototype] {}>>: historical inaccuracy in replay-callNow
    at replay (eval at <anonymous> (eval at createScopedEvaluatorFactory (/home/warner/bindmounts/trees/cosmic-swingset/node_modules/ses/dist/ses.cjs.js:1308:10)), <anonymous>:2138:15)
    at Object.callNow (eval at <anonymous> (eval at createScopedEvaluatorFactory (/home/warner/bindmounts/trees/cosmic-swingset/node_modules/ses/dist/ses.cjs.js:1308:10)), <anonymous>:2171:32)
    at Proxy.eval (eval at <anonymous> (eval at createScopedEvaluatorFactory (/home/warner/bindmounts/trees/cosmic-swingset/node_modules/ses/dist/ses.cjs.js:1308:10)), <anonymous>:1411:33)
    at Object.inbound (/home/warner/bindmounts/trees/cosmic-swingset/t1/8000/vats/vat-http.js:1840:28)
(node:5988) UnhandledPromiseRejectionWarning: historical inaccuracy in replay-send

[michaelfig]

What is the relative order of the subscribing to walletInboxState and subscribing to walletPurseState messages in each run?

It looks like there was one more promise made before walletGetInbox on replay (p+10) vs expected (p+9), and then it all falls apart.

[warner]

in the old repo. this was cosmic-swingset issue 127