zombienet-bridges-0001-asset-transfer-works failures

[serban300]

zombienet-bridges-0001-asset-transfer-works fails sometimes when trying to transfer ROC from AHR to AHW.
Example failure: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/5796275

This seems to be the error at Rococo BridgeHub:

2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::process_instruction: [Parachain] === WithdrawAsset(Assets([Asset { id: AssetId(Location { parents: 1, interior: Here }), fun: Fungible(1700933258556) }]))    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::ensure_can_subsume_assets: [Parachain] worst_case_holding_len: 1, holding_limit: 64    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::fungible_adapter: [Parachain] withdraw_asset what: Asset { id: AssetId(Location { parents: 1, interior: Here }), fun: Fungible(1700933258556) }, who: Location { parents: 1, interior: X1([Parachain(1000)]) }  
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::execute: [Parachain] !!! ERROR: FailedToTransactAsset("Funds are unavailable")    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::execute: [Parachain] result: Err(ExecutorError { index: 0, xcm_error: FailedToTransactAsset("Funds are unavailable"), weight: Weight { ref_time: 589578553, proof_size: 9723 } })    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::refund_surplus: [Parachain] total_surplus: Weight { ref_time: 589578553, proof_size: 9723 }, total_refunded: Weight { ref_time: 0, proof_size: 0 }, current_surplus: Weight { ref_time: 589578553, proof_size: 9723 }    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::weight: [Parachain] UsingComponents::refund_weight weight: Weight { ref_time: 589578553, proof_size: 9723 }, context: XcmContext { origin: Some(Location { parents: 1, interior: X1([Parachain(1000)]) }), message_id: [229, 91, 46, 91, 68, 213, 251, 163, 117, 27, 192, 140, 155, 185, 214, 133, 134, 20, 70, 102, 177, 204, 211, 180, 220, 25, 22, 195, 8, 232, 132, 147], topic: None }, available weight: Weight { ref_time: 0, proof_size: 0 }, available amount: 0    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::weight: [Parachain] UsingComponents::refund_weight amount to refund: 0    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::refund_surplus: [Parachain] total_refunded: Weight { ref_time: 0, proof_size: 0 }    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::post_process: [Parachain] Execution errored at 0: FailedToTransactAsset("Funds are unavailable") (original_origin: Location { parents: 1, interior: X1([Parachain(1000)]) })    
2024-04-05 11:55:12.042 TRACE tokio-runtime-worker xcm::process-message: [Parachain] XCM message execution incomplete, used weight: Weight(ref_time: 144980000, proof_size: 3593), error: FailedToTransactAsset("Funds are unavailable")  

[serban300]

Still fails sometimes: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/5922528

Reopening

[serban300]

Looking at the logs, I think that sometimes the transfer_allow_death tx for funding the SA of AHR at BHR actually fails:

  calling transfer_balance:
      runtime_para_endpoint: ws://127.0.0.1:8943
      seed: //Alice
      target_account: 5Eg2fntNprdN3FgH4sfEaaZhYtddZQSQUqvYJ1f2mLtinVhV
      amount: 100000000000000
--------------------------------------------------
2024-04-14 22:19:01        REGISTRY: Unknown signed extensions BridgeRejectObsoleteHeadersAndMessages, OnBridgeHubRococoRefundBridgeHubWestendMessages, OnBridgeHubRococoRefundRococoBulletinMessages, StorageWeightReclaim found, treating them as no-effect
2024-04-14 22:19:01        API/INIT: bridge-hub-rococo/1010000: Not decorating unknown runtime apis: 0xd7bdd8a272ca0d65/1, 0x3ed67502c56fbb7c/1, 0x0ae972bc9baccc81/1, 0x15566834f0a8b169/1, 0xec5372fdb1645189/1, 0xee271bd2dfe3f753/1, 0x17b1e7eadee78096/1, 0x0c7dfd595d10ee14/1, 0x76ee5cebb2fa8fff/1
{
  "transferAllowDeath": {
    "events": [],
    "status": {
      "ready": null
    },
    "txHash": "0x1b8be4d71bede2b2e7e33859a3e6fa5e84b71fe673f2d46820f8249bf32cdf41"
  }
}
{
  "transferAllowDeath": {
    "events": [],
    "status": {
      "broadcast": [
        "12D3KooWRD8Ph3ASuiKH4UdwQRMgCvyfD1RApE9xM4TCAV5gTs5y"
      ]
    },
    "txHash": "0x1b8be4d71bede2b2e7e33859a3e6fa5e84b71fe673f2d46820f8249bf32cdf41"
  }
}
{
  "transferAllowDeath": {
    "events": [],
    "status": {
      "invalid": null
    },
    "txHash": "0x1b8be4d71bede2b2e7e33859a3e6fa5e84b71fe673f2d46820f8249bf32cdf41"
  }
}

Not sure why yet

[serban300]

I haven't seen it failing on my latest PRs and on the latest PRs in the repos in general. So I think it's fixed actually. I will close it for the moment.