fix: Fixed memoization is unchecked after mutex synchronization. Fixes #11219

[shmruin]

Fixes #11219 (cherry-pick of #11456)

Motivation

This is cherry-pick of #11456, which is already merged in master branch.

Modifications

Same as before but two things changed to resolve conflicts.

1. woc.wf.Status.Nodes.Set to woc.wf.Status.Nodes[...] because Set is not applied.
2. In executeTemplate, woc.markNodeWaitingForLock(node.Name, lockName.EncodeName()) to woc.markNodeWaitingForLock(node.Name, lockName.EncodeName()), nil which is also not applied factor in this release.

Verification

Verify with same test code as below in UI, and with test code in operator_concurrency_test.go

apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: example-steps-simple
spec:
  entrypoint: main

  templates:
    - name: main
      steps:
        - - name: job-1
            template: sleep
            arguments:
              parameters:
                - name: sleep_duration
                  value: 30
          - name: job-2
            template: sleep
            arguments:
              parameters:
                - name: sleep_duration
                  value: 15

    - name: sleep
      synchronization:
        mutex:
          name: mutex-example-steps-simple
      inputs:
        parameters:
          - name: sleep_duration
      script:
        image: alpine:latest
        command: [/bin/sh]
        source: |
          echo "Sleeping for {{ inputs.parameters.sleep_duration }}"
          sleep {{ inputs.parameters.sleep_duration }}
      memoize:
        key: "memo-key-1"
        cache:
          configMap:
            name: cache-example-steps-simple