Statemint-v6.0.1 Release Checklist

[github-actions]

Release Checklist

Release checklist for the initial Statemint release based on the Statemine 6.0.1 release.

Runtime Releases

These checks should be performed on the codebase.

• Verify spec_version has been incremented since the
  last release for any native runtimes from any existing use on public
  (non-private/test) networks.
• Verify previously completed migrations are
  removed for any public (non-private/test) networks.
• Verify pallet and extrinsic ordering as well as SignedExtensions have stayed
  the same. Bump transaction_version if not.
• Verify new extrinsics have been correctly whitelisted/blacklisted for
  proxy filters.
• Verify benchmarks have been updated for any modified
  runtime logic.
  • Verify the weights are up-to-date.
• Verify that the various pieces of XCM config are sane.

The following checks can be performed after we have forked off to the release-
candidate branch or started an additional release candidate branch (rc-2, rc-3, etc)

• Verify new migrations complete successfully, and the
  runtime state is correctly updated for any public (non-private/test)
  networks.
• Do integration tests.
• Push runtime upgrade to Westmint and verify network stability.

All Releases

• Check that the new polkadot-collator versions have run on the network
  without issue.
• Check that a draft release has been created at
  https://github.com/paritytech/cumulus/releases with relevant release
  notes.
• Check that build artifacts have been added to the
  draft-release.
  • runtimes
  • collator binary

Initial Statemint Release

On top of the regular runtime release process, this release will also need to cover the following points:

• genesis configuration for Statemint @apopiak
• determine setStorage call for governance to set the initial state Statemint should have after the upgrade (replacing the usual genesis process, but making use of the genesis config) @apopiak
• create adusted chain spec that will be used for syncing Statemint @apopiak
• test the upgrade process (including setStorage calls) @apopiak

---

Notes

Burn In

Ensure that Parity DevOps has run the new release on Westmint and Statemine collators for 12h prior to publishing the release.

Build Artifacts

Add any necessary assets to the release. They should include:

• Linux binary
• GPG signature of the Linux binary
• SHA256 of binary
• Source code
• Wasm binaries of any runtimes

Release notes

The release notes should list:

• The priority of the release (i.e., how quickly users should upgrade) - this is
  based on the max priority of any client changes.
• Which native runtimes and their versions are included
• The proposal hashes of the runtimes as built with
  srtool
• Any changes in this release that are still awaiting audit

The release notes may also list:

• Free text at the beginning of the notes mentioning anything important
  regarding this release
• Notable changes separated into sections.

Spec Version

A runtime upgrade must bump the spec number. This may follow a pattern with the
client release (e.g. runtime v12 corresponds to v0.8.12, even if the current
runtime is not v11).

Runtime version bump between RCs

The clients need to be aware of runtime changes. However, we do not want to bump the
spec_version for every single release candidate. Instead, we can bump the impl field of the version
to signal the change to the client.

Old Migrations Removed

Previous on_runtime_upgrade functions from old upgrades should be removed.

New Migrations

Ensure that any migrations that are required due to storage or logic changes
are included in the on_runtime_upgrade function of the appropriate pallets.

Extrinsic Ordering & Storage

Offline signing libraries depend on a consistent ordering of call indices and
functions. Compare the metadata of the current and new runtimes and ensure that
the module index, call index tuples map to the same set of functions. It also checks if there have been any changes in storage. In case of a breaking change, increase transaction_version.

To verify the order has not changed, manually start the following Github Action. It takes around a minute to run and will produce the report as artifact you need to manually check.

To run it, in the Run Workflow dropdown:

1. Use workflow from: to ignore, leave master as default
2. The WebSocket url of the reference node:
   • Statemine: wss://kusama-statemine-rpc.paritytech.net
   • Westmint: wss://westmint-rpc.polkadot.io
3. A url to a Linux binary for the node containing the runtime to test: Paste the URL of the latest release-candidate binary from the draft-release on Github. The binary has to previously be uploaded to S3 (Github url link to the binary is constantly changing)
   • https://releases.parity.io/cumulus/statemine-v6.0.0-rc1/polkadot-collator
4. The name of the chain under test. Usually, you would pass a local chain:
   • Statemine: statemine-local
   • Westmint: westmint-local
5. Click Run workflow

When the workflow is done, click on it and download the zip artifact, inside you'll find an output.txt file. The things to look for in the output are lines like:

• [Identity] idx 28 -> 25 (calls 15) - indicates the index for Identity has changed
• [+] Society, Recovery - indicates the new version includes 2 additional modules/pallets.
• If no indices have changed, every modules line should look something like [Identity] idx 25 (calls 15)

Note: Adding new functions to the runtime does not constitute a breaking change
as long as the indexes did not change.

Note: Extrinsic function signatures changes (adding/removing & ordering arguments) are not caught by the job, so those changes should be reviewed "manually"

Proxy Filtering

The runtime contains proxy filters that map proxy types to allowable calls. If
the new runtime contains any new calls, verify that the proxy filters are up to
date to include them.

Benchmarks

Until paritytech/polkadot#631 is done, running the benchmarks is a manual process:

1. Connect to the bechmarking machine
2. Make sure no one else is using the machine with htop check
3. Pull in the branch of Cumulus that has the version of Statemine you want to release
4. Recompile cargo build --release --features runtime-benchmarks
5. From the root directory run nohup ./scripts/benchmarks.sh & (it will take quite a few hours)
6. Checkout in your local machine to the branch of cumulus that has the version of Statemine you want to release
7. scp from the host to your local machine the weights for Statemine, Westmint and Statemint you'll find in:
   • /polkadot-parachains/statemine/src/weights
   • /polkadot-parachains/westmint/src/weights
   • /polkadot-parachains/statemint/src/weights
8. Commit the changes in your local and create a PR

[apopiak]

Marking some things as done already and adding a note for context:

• Verify spec_version has been incremented since the
  last release for any native runtimes from any existing use on public
  (non-private/test) networks.

  • Initial release and based on 601 Statemine release --> already bumped.

• Verify previously completed migrations are
  removed for any public (non-private/test) networks.

  • Initial release --> no migrations to remove.

• Verify pallet and extrinsic ordering as well as SignedExtensions have stayed
  the same. Bump transaction_version if not.

  • Takes on the same transaction_version as Statemine.

• Verify new extrinsics have been correctly whitelisted/blacklisted for
  proxy filters.

  • Permissionless creation was removed in Kusama Batch Transactions Eventually become "Invalid" polkadot#669

• Check that a draft release has been created at
  https://github.com/paritytech/cumulus/releases with relevant release
  notes.

  • Run as part of automation.

• Genesis Config

  • genesis configuration for Statemint @apopiak
  • determine setStorage call for governance to set the initial state Statemint should have after the upgrade (replacing the usual genesis process, but making use of the genesis config) @apopiak
  • create adusted chain spec that will be used for syncing Statemint @apopiak
  • done in CLI refactoring, fixes polkadot#817

[apopiak]

• Verify benchmarks have been updated for any modified
  runtime logic.
  • Verify the weights are up-to-date.
• Benchmarking was run in UI bug: Kusama CC3 title is cropped (Safari) polkadot#754 and updated in Double-vote Fishing polkadot#762

[apopiak]

Test Report RC1

Post Upgrade Checks

• ✔️ polkadotXCM -> safeXcmVersion : Expected 2
• ✔️ parachainInfo -> parachainId : Expected 1000

Integration Testing Report

• ✔️ system.remarkWithEvent succeeds
• ✔️ balances.transferKeepAlive (after teleport from Polkadot relay)

Assets

• ✔️ Permissionless asset creation fails
• ✔️ Polkadot -> xcmPallet -> send ( assets.forceCreate )
• ✔️ assets.mint
• ✔️ assets.setMetadata

Uniques

• ✔️ Permissionless asset creation fails
• ✔️ Polkadot -> xcmPallet -> send ( uniques.forceCreate )
• ✔️ uniques.mint

Teleports

• ✔️ Teleport Polkadot -> Statemint
• ❌ Teleport Statemint -> Polkadot failed due to Configure UmpSink to allow Parachains to execute messages on Polkadot polkadot-sdk#899

Asset Tx Payment

• ✔️ assets.transfer paying via sufficient asset (script can be found here https://gist.github.com/apopiak/d9fa3952b5cd520943e12d689824391c)

[apopiak]

Test Report RC4

For tag statemint-v6.0.1-rc4 at commit 4292ce5b87d708d9d664bc157816f808ea7c9d2c.

Setup

• polkadot-collator

  • sha256: 92adf1d1a7ecd3e028be4a9623eac817dadba26271c44afd2311eb5e4e976303

• polkadot-collator-504 (from Statemine 504 release)

• statemint_runtime-v601.compact.compressed.wasm

  • blake2_256: 0xaf49687b93d91fc08c1fcea1001d724a95c533a949019645d3e4179beedbf67e

• config.json: https://gist.github.com/apopiak/a6ec043588b10e55ccdb4c0b626e0f30

• shell-statemint.json (local version, slightly adjusted from the release): https://gist.github.com/apopiak/0f26a3c7672907e1622c01631ff6bcae

• statemint.json (local version, slightly adjusted from the release): https://gist.github.com/apopiak/5530f7b34a70903a5e9be19946e44342

• statemint_dev_values.json and statemint_dev_values.scale: https://gist.github.com/apopiak/6bc16360cd26d1de208bb77a6f15bf71

  • ran the following in the cumulus repo:

polkadot-collator build-spec --chain statemint-dev --raw > polkadot-parachains/res/statemint_dev.json
./scripts/generate_genesis_value.sh statemint_dev

Tests

Genesis

• ✔️ Genesis values are still the same (compared to previous RC)
  • ran the following in the cumulus repo:

polkadot-collator  build-spec --chain statemint-genesis --raw > polkadot-parachains/res/statemint_genesis.json
./scripts/generate_genesis_value.sh statemint_genesis

Post Upgrade Checks

• ✔️ producing blocks
• ✔️ polkadotXCM -> safeXcmVersion : Expected 2
• ✔️ parachainInfo -> parachainId : Expected 1000

Integration Testing Report

Teleports

• ✔️ Teleport Polkadot -> Statemint succeeds
  • Note, though, that Polkadot 0.9.14 will not allow teleports, this is just to allow for other tests on Statemint.
• ✔️ Teleport Statemint -> Polkadot should fail (polkadotXcm.Filtered)

General Chain

• ✔️ system.remarkWithEvent succeeds (after teleport of funds for fees from Polkadot relay)
• ✔️ balances.transferKeepAlive (after teleport from Polkadot relay)

Assets

• ✔️ Permissionless asset creation should fail (BadOrigin)

Uniques

• ✔️ Permissionless asset creation should fail (BadOrigin)

Other Remarks

It does not make sense to test the functionality in-depth as it will be disabled/inaccessible (and has been tested in the previous RC1 test).

[apopiak]

released Statemint 🎉 https://github.com/paritytech/cumulus/releases/tag/statemint-v6.0.1