feat: Added subscription cleanup option & resourceId list input to removal function #1607
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ts.ps1 Co-authored-by: Erika Gressi <[email protected]>
…ts.ps1 Co-authored-by: Erika Gressi <[email protected]>
microsoft-github-policy-service
bot
added
Needs: Triage 🔍
|
Note The "Type: AVM |
AlexanderSehr
changed the title
segraef
pushed a commit
to segraef/bicep-registry-modules
that referenced
this pull request
Apr 9, 2024
…moval function (Azure#1607) ## Description - Added ResourceId list input to removal function - Added option to fetch any resource & resourceGroup with `dep-` in its name to be removed using the default removal logic <details> <summary>Initial execution</summary> ``` PS C:\dev\bicep-registry-modules> Initialize-DeploymentRemoval -RemoveAllDepResources VERBOSE: Total number of deployment target resources after fetching deployments [79] VERBOSE: Total number of deployment target resources after pre-filtering (duplicates) & ordering items [79] VERBOSE: Total number of deployment target resources after formatting items [79] VERBOSE: Total number of deployments after filtering all dependency resources [79] VERBOSE: Total number of deployments after final ordering of resources [79] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressRouteGateway-nergmin-rg/providers/Microsoft.Network/virtualWans/dep-<namePrefix>-vwan-nergmin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/privateDnsZones/privatelink.vaultcore.azure.net/virtualNetworkLinks/dep-<namePrefix>-vnet-kvvwaf-vnetlink] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001/inboundEndpoints/<namePrefix>ndrwaf-az-pdnsin-x-001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001/outboundEndpoints/<namePrefix>ndrwaf-az-pdnsout-x-001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanvnwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/routeTables/dep-<namePrefix>-rt-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-nvnpeer] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnpeer001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnpeer] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanvnmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/routeTables/dep-<namePrefix>-rt-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Automation/automationAccounts/dep-<namePrefix>-auto-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-ehn-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaoiwadv01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed/providers/Microsoft.Storage/storageAccounts/saavmxdwmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed/providers/Microsoft.Databricks/accessConnectors/unity-catalog-access-connector] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1/providers/Microsoft.Storage/storageAccounts/q3qok4o2xgwxwvuvs86hucv0] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg/providers/Microsoft.Synapse/workspaces/<namePrefix>swenua001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saswenua01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-servicebus.namespaces-sbnmin-rg/providers/Microsoft.ServiceBus/namespaces/<namePrefix>sbnmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.Search/searchServices/<namePrefix>sssmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-sssmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saoiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaoiwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-oiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Automation/automationAccounts/dep-<namePrefix>-auto-oiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saoiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasasssmax03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipmin-rg/providers/Microsoft.Network/publicIPPrefixes/<namePrefix>npipmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed/providers/Microsoft.Databricks/accessConnectors/unity-catalog-access-connector] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasakvvwaf03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-kvvwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/privateDnsZones/privatelink.vaultcore.azure.net] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-kvvwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg/providers/Microsoft.Insights/dataCollectionEndpoints/<namePrefix>idcemin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saicmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaicmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Insights/components/<namePrefix>icmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-icmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/microsoft.alertsmanagement/smartDetectorAlertRules/Failure Anomalies - <namePrefix>icmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-eventhub.namespaces-ehnenc-rg/providers/Microsoft.EventHub/namespaces/<namePrefix>ehnenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasadtdiwaf03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-dtdiwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.DigitalTwins/digitalTwinsInstances/<namePrefix>dtdiwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-lwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipwaf-rg/providers/Microsoft.Network/publicIPPrefixes/<namePrefix>npipwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.Logic/workflows/<namePrefix>lwwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg/providers/Microsoft.Network/applicationGatewayWebApplicationFirewallPolicies/<namePrefix>nagwafpmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.privateendpoints-npemin-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-npemin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.networkmanagers-nnmmin-rg/providers/Microsoft.Network/networkManagers/<namePrefix>nnmmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.firewallpolicies-nfpmin-rg/providers/Microsoft.Network/firewallPolicies/<namePrefix>nfpmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmin-rg/providers/Microsoft.Network/expressRouteCircuits/<namePrefix>nercmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanercmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.Network/expressRouteCircuits/<namePrefix>nercmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nercmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndrwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndrmin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsForwardingRulesets/<namePrefix>ndfrswaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasalwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed/providers/Microsoft.Storage/storageAccounts/saavmxdwwaf001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-<namePrefix>-vwan-nergmin] of type [Microsoft.Network/virtualWans] VERBOSE: [-] Removing resource [pdnsout] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] WARNING: [!] Removal moved back for retry. Reason: [BadRequest : Existing outbound endpoint has DNS forwarding ruleset links that have to be deleted first before outbound endpoint can be deleted. outboundEndpointResourceId=/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout, numberOfDnsForwardingRulesetLinks=1 CorrelationId: 5bca8494-6de9-4c01-be0d-5988811d0d9b] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-kvvwaf-vnetlink] of type [Microsoft.Network/privateDnsZones/virtualNetworkLinks] DELETE /subscriptions/<subscriptionId>/r. [Starting - 0,00 % completed. ] DELETE /subscriptions/<subscriptionId>/r. [Starting - 0,00 % completed. ] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf-az-pdnsin-x-001] of type [Microsoft.Network/dnsResolvers/inboundEndpoints] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 856b562e-9cc7-416a-9a00-797667b04ecb] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf-az-pdnsout-x-001] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '31388eb2-15b6-40fc-91d8-c4e9e92cba59', correlation id is 'f97aa916-0644-41b1-976b-8cc1f800bc3a'. CorrelationId: f97aa916-0644-41b1-976b-8cc1f800bc3a] VERBOSE: [-] Removing resource [dep<namePrefix>diasanvnwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nvnwaf001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-rt-nvnwaf] of type [Microsoft.Network/routeTables] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-nvnwaf] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnwaf] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nvnwaf] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-nvnpeer] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>nvnpeer001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnpeer] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep<namePrefix>diasanvnmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nvnmax001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-rt-nvnmax] of type [Microsoft.Network/routeTables] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-nvnmax] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-auto-oiwadv] of type [Microsoft.Automation/automationAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-ehn-oiwadv] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-oiwadv] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>diasaoiwadv01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [saavmxdwmax001] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [unity-catalog-access-connector] of type [Microsoft.Databricks/accessConnectors] VERBOSE: [-] Removing resource [q3qok4o2xgwxwvuvs86hucv0] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: ffb58929-b5db-48bb-aaa0-45285bf31114] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 9bc0f1d4-e469-4569-83da-9bd95df04feb] VERBOSE: [-] Removing resource [<namePrefix>swenua001] of type [Microsoft.Synapse/workspaces] VERBOSE: [-] Removing resource [dep<namePrefix>saswenua01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnmax] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [<namePrefix>sbnmin001] of type [Microsoft.ServiceBus/namespaces] VERBOSE: [-] Removing resource [<namePrefix>sssmax001] of type [Microsoft.Search/searchServices] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-sssmax01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>saoiwwaf] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasaoiwwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-oiwwaf] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-auto-oiwwaf] of type [Microsoft.Automation/automationAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>saoiwadv] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasasssmax03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nvnmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>npipmin001] of type [Microsoft.Network/publicIPPrefixes] VERBOSE: [-] Removing resource [unity-catalog-access-connector] of type [Microsoft.Databricks/accessConnectors] VERBOSE: [-] Removing resource [dep<namePrefix>diasakvvwaf03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-kvvwaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [privatelink.vaultcore.azure.net] of type [Microsoft.Network/privateDnsZones] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-kvvwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>idcemin001] of type [Microsoft.Insights/dataCollectionEndpoints] VERBOSE: [-] Removing resource [dep<namePrefix>saicmax] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasaicmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>icmax001] of type [Microsoft.Insights/components] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-icmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [Failure Anomalies - <namePrefix>icmax001] of type [microsoft.alertsmanagement/smartDetectorAlertRules] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ehnenc] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ehnenc001] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>diasadtdiwaf03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-dtdiwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>dtdiwaf001] of type [Microsoft.DigitalTwins/digitalTwinsInstances] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-lwwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>npipwaf001] of type [Microsoft.Network/publicIPPrefixes] VERBOSE: [-] Removing resource [<namePrefix>lwwaf001] of type [Microsoft.Logic/workflows] VERBOSE: [-] Removing resource [<namePrefix>nagwafpmax001] of type [Microsoft.Network/applicationGatewayWebApplicationFirewallPolicies] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-npemin] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>nnmmin001] of type [Microsoft.Network/networkManagers] VERBOSE: [-] Removing resource [<namePrefix>nfpmin001] of type [Microsoft.Network/firewallPolicies] VERBOSE: [-] Removing resource [<namePrefix>nercmin001] of type [Microsoft.Network/expressRouteCircuits] VERBOSE: [-] Removing resource [dep<namePrefix>diasanercmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nercmax001] of type [Microsoft.Network/expressRouteCircuits] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nercmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndrwaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf001] of type [Microsoft.Network/dnsResolvers] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndrmin] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ndrmin001] of type [Microsoft.Network/dnsResolvers] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndfrswaf] of type [Microsoft.Network/virtualNetworks] WARNING: [!] Removal moved back for retry. Reason: [InUseSubnetCannotBeDeleted : Subnet subnet-1 is in use by /subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf/subnets/subnet-1/serviceAssociationLinks/dnsResolverLink and cannot be deleted. In order to delete the subnet, delete all the resources within the subnet. See aka.ms/deletesubnet. CorrelationId: 636498cc-a349-4dbd-8c67-c9d2e020db3e] VERBOSE: [-] Removing resource [dep-<namePrefix>-ndr-ndfrswaf] of type [Microsoft.Network/dnsResolvers] WARNING: [!] Removal moved back for retry. Reason: [CannotDeleteResource : Cannot delete resource while nested resources exist. Some existing nested resource IDs include: 'Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout'. Please delete all nested resources before deleting this resource. CorrelationId: 5a56e4c8-d626-46bb-bd81-783138352cae] VERBOSE: [-] Removing resource [<namePrefix>ndfrswaf001] of type [Microsoft.Network/dnsForwardingRulesets] VERBOSE: [-] Removing resource [dep<namePrefix>diasalwwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [saavmxdwwaf001] of type [Microsoft.Storage/storageAccounts] VERBOSE: ---------------------------------- VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [pdnsout] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 15c85c04-aaa5-41a8-a012-5db2d08b2f88] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '3220689c-83cf-45f8-a4a1-5c12150cf1bb', correlation id is '577dd566-cd51-487e-9c98-cc0e4486ce02'. CorrelationId: 577dd566-cd51-487e-9c98-cc0e4486ce02] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 81d5f560-b89c-4159-ad4c-b3aba2dd5f12] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 1dd1305e-d7e2-4166-8193-78a6e053759c] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndfrswaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-ndr-ndfrswaf] of type [Microsoft.Network/dnsResolvers] VERBOSE: ---------------------------------- VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 632be08b-bc75-461e-988c-5269717cb199] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is 'be6e61ad-ec39-4c10-86c8-ed36817db00a', correlation id is '696735a0-485f-44e6-9ecf-92915f9db5b4'. CorrelationId: 696735a0-485f-44e6-9ecf-92915f9db5b4] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 39e58329-ed01-43c2-868c-0dfc710198db] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 5f7a64b8-2d6e-4ea8-a8b9-03face113b0b] VERBOSE: ---------------------------------- Exception: C:\dev\bicep-registry-modules\avm\utilities\pipelines\e2eValidation\resourceRemoval\helper\Remove-ResourceList.ps1:124:9 Line | 124 | throw ('The removal failed for resources [{0}]' -f ((Split-Pa … | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | The removal failed for resources [master, <namePrefix>cicgenc001, avmrhbhbmin001, avmrhbhbmax001] ``` </details> <details> <summary>Execution after adding RG support</summary> ``` PS C:\dev\bicep-registry-modules> Initialize-DeploymentRemoval -RemoveAllDepResources VERBOSE: Total number of deployment target resources after fetching deployments [36] VERBOSE: Total number of deployment target resources after pre-filtering (duplicates) & ordering items [36] VERBOSE: Total number of deployment target resources after formatting items [36] VERBOSE: Total number of deployments after filtering all dependency resources [36] VERBOSE: Total number of deployments after final ordering of resources [36] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.privateendpoints-npemin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-servicebus.namespaces-sbnmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.networkmanagers-nnmmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressRouteGateway-nergmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-eventhub.namespaces-ehnenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.firewallpolicies-nfpmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-<namePrefix>-network.publicipprefixes-npipmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.publicipprefixes-npipwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-search.searchservices-sssmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.privateendpoints-npemin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-servicebus.namespaces-sbnmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-synapse.workspaces-swenua-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '270ed8ad-68a0-476a-942c-6d22377c36a9'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: b90bb002-14f7-4032-832b-69ae37e3b30a] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '701812e8-5059-4a92-97d6-c0d35fc92d44'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 3ca89140-4603-49e7-93e3-0c959fb97014] VERBOSE: [-] Removing resource [IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.networkmanagers-nnmmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressRouteGateway-nergmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwmax-rg-managed] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressroutecircuits-nercmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressroutecircuits-nercmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsResolvers-ndrmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-logic.workflows-lwwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-keyvault.vaults-kvvwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-insights.components-icmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-eventhub.namespaces-ehnenc-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionTimeout","message":"Deletion of resource group 'dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg' did not finish within the allowed time as resources with identifiers 'Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '3ab01252-3168-4ef2-8491-5317dae1db41'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001","message":"{\"error\":{\"code\":\"InternalServerError\",\"message\":\"Encountered an internal server error. The tracking activity id is 'c0cd7e57-12ec-4d56-a001-c03780eef578', correlation id is '3ab01252-3168-4ef2-8491-5317dae1db41'.\"}}"}]}} CorrelationId: 873c04ae-e730-4e41-adb1-e85f7b8f9fef] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.firewallpolicies-nfpmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: 6c61fe5d-7233-4ad6-b33a-c4ef906bd270] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 2c130ff7-ca6b-462d-a722-fbf18fbd86e8] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '609139de-e745-49a7-922c-d40caf735f18', correlation id is 'b913c064-03dd-4e7a-ab30-4e39155d12ef'. CorrelationId: b913c064-03dd-4e7a-ab30-4e39155d12ef] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: c00fbfc3-307d-4129-a24b-0957c01d453a] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: e73374cb-84e0-40af-adbd-f09607d63879] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [1|3] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '4b5a669c-71fa-4872-a74e-f7dc9e42fdcd'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: f027db06-7884-44cd-bbd5-503b9f853401] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '895a795f-d6fb-4df0-90ad-05d5e5767bc8'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 290f9cb4-27d9-49e8-8e5c-89aeb1b24548] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionTimeout","message":"Deletion of resource group 'dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg' did not finish within the allowed time as resources with identifiers 'Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '9068dc6f-57ad-4b54-a0b9-0a97223e8eae'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001","message":"{\"error\":{\"code\":\"InternalServerError\",\"message\":\"Encountered an internal server error. The tracking activity id is '5119291c-288d-48ab-b1e1-dfa90c29cad6', correlation id is '9068dc6f-57ad-4b54-a0b9-0a97223e8eae'.\"}}"}]}} CorrelationId: 68196e76-7bdd-4e47-ab29-ad51b6eddcd4] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: 1b17ec09-6039-4785-9112-e43acb7cda1f] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 4e03c4f3-4605-4ad4-b672-f37b231fecbb] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '92c169ae-e964-4bce-a31d-f13307e729ea', correlation id is '0eec5b46-fc55-4e88-9409-95f1c9933cd4'. CorrelationId: 0eec5b46-fc55-4e88-9409-95f1c9933cd4] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: edb388a1-6e3e-48fd-803f-4c173ffe8184] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 3f721795-2e7f-4cb9-bf40-e41e29589f23] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [2|3] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '672f3094-43a1-4eb6-859b-f9e2fe7d086f'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 3ad140d1-9d60-47fc-83ae-4cbdc0ce33e3] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '721645e9-ac6b-450a-a08a-e05e57dee3a3'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: de39ed72-ca70-43be-950f-0177cfdfc54a] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [No such host is known. (management.azure.com:443)] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: e8f0a716-c316-4179-9f18-5f364c6df5bf] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 62edcdde-c886-4638-9f33-1c8c96f3dc12] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '819de35f-9f5b-4782-801b-833fb84309e2', correlation id is '37ca6aaa-87f3-48ff-bcc9-6acf23fa80bc'. CorrelationId: 37ca6aaa-87f3-48ff-bcc9-6acf23fa80bc] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: fb86ed27-6d42-4393-b04d-08e43b07904d] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 7cbb2e66-2269-4372-9ce6-d3a2163b76d2] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [3|3] Exception: C:\dev\bicep-registry-modules\avm\utilities\pipelines\e2eValidation\resourceRemoval\helper\Remove-ResourceList.ps1:124:9 Line | 124 | throw ('The removal failed for resources [{0}]' -f ((Split-Pa … | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | The removal failed for resources [dep-avmr-healthbot.healthbots-hbhbmax-rg, dep-avmr-healthbot.healthbots-hbhbmin-rg, dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg, | rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed, master, <namePrefix>cicgenc001, avmrhbhbmax001, avmrhbhbmin001] ``` </details> ## Pipeline Reference <!-- Insert your Pipeline Status Badge below --> | Pipeline | | -------- | | [](https://github.com/AlexanderSehr/bicep-registry-modules/actions/workflows/avm.res.analysis-services.server.yml) | ## Type of Change <!-- Use the check-boxes [x] on the options that are relevant. --> - [x] Update to CI Environment or utlities (Non-module effecting changes) - [ ] Azure Verified Module updates: - [ ] Bugfix containing backwards compatible bug fixes, and I have NOT bumped the MAJOR or MINOR version in `version.json`: - [ ] Someone has opened a bug report issue, and I have included "Closes #{bug_report_issue_number}" in the PR description. - [ ] The bug was found by the module author, and no one has opened an issue to report it yet. - [ ] Feature update backwards compatible feature updates, and I have bumped the MINOR version in `version.json`. - [ ] Breaking changes and I have bumped the MAJOR version in `version.json`. - [ ] Update to documentation --------- Co-authored-by: Erika Gressi <[email protected]> Co-authored-by: ChrisSidebotham-MSFT <[email protected]>
segraef
pushed a commit
to segraef/bicep-registry-modules
that referenced
this pull request
Apr 17, 2024
…moval function (Azure#1607) ## Description - Added ResourceId list input to removal function - Added option to fetch any resource & resourceGroup with `dep-` in its name to be removed using the default removal logic <details> <summary>Initial execution</summary> ``` PS C:\dev\bicep-registry-modules> Initialize-DeploymentRemoval -RemoveAllDepResources VERBOSE: Total number of deployment target resources after fetching deployments [79] VERBOSE: Total number of deployment target resources after pre-filtering (duplicates) & ordering items [79] VERBOSE: Total number of deployment target resources after formatting items [79] VERBOSE: Total number of deployments after filtering all dependency resources [79] VERBOSE: Total number of deployments after final ordering of resources [79] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressRouteGateway-nergmin-rg/providers/Microsoft.Network/virtualWans/dep-<namePrefix>-vwan-nergmin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/privateDnsZones/privatelink.vaultcore.azure.net/virtualNetworkLinks/dep-<namePrefix>-vnet-kvvwaf-vnetlink] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001/inboundEndpoints/<namePrefix>ndrwaf-az-pdnsin-x-001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001/outboundEndpoints/<namePrefix>ndrwaf-az-pdnsout-x-001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanvnwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/routeTables/dep-<namePrefix>-rt-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nvnwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-nvnpeer] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnpeer001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnpeer] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanvnmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/virtualNetworks/<namePrefix>nvnmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/routeTables/dep-<namePrefix>-rt-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Automation/automationAccounts/dep-<namePrefix>-auto-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-ehn-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-oiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaoiwadv01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed/providers/Microsoft.Storage/storageAccounts/saavmxdwmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed/providers/Microsoft.Databricks/accessConnectors/unity-catalog-access-connector] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1/providers/Microsoft.Storage/storageAccounts/q3qok4o2xgwxwvuvs86hucv0] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg/providers/Microsoft.Synapse/workspaces/<namePrefix>swenua001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saswenua01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.Network/networkSecurityGroups/dep-<namePrefix>-nsg-bastion-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-servicebus.namespaces-sbnmin-rg/providers/Microsoft.ServiceBus/namespaces/<namePrefix>sbnmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.Search/searchServices/<namePrefix>sssmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-sssmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saoiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaoiwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-oiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg/providers/Microsoft.Automation/automationAccounts/dep-<namePrefix>-auto-oiwwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saoiwadv] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasasssmax03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nvnmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipmin-rg/providers/Microsoft.Network/publicIPPrefixes/<namePrefix>npipmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed/providers/Microsoft.Databricks/accessConnectors/unity-catalog-access-connector] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasakvvwaf03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-kvvwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.Network/privateDnsZones/privatelink.vaultcore.azure.net] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-kvvwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg/providers/Microsoft.Insights/dataCollectionEndpoints/<namePrefix>idcemin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>saicmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasaicmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.Insights/components/<namePrefix>icmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-icmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg/providers/microsoft.alertsmanagement/smartDetectorAlertRules/Failure Anomalies - <namePrefix>icmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-eventhub.namespaces-ehnenc-rg/providers/Microsoft.EventHub/namespaces/<namePrefix>ehnenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasadtdiwaf03] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-dtdiwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg/providers/Microsoft.DigitalTwins/digitalTwinsInstances/<namePrefix>dtdiwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-lwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipwaf-rg/providers/Microsoft.Network/publicIPPrefixes/<namePrefix>npipwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.Logic/workflows/<namePrefix>lwwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg/providers/Microsoft.Network/applicationGatewayWebApplicationFirewallPolicies/<namePrefix>nagwafpmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.privateendpoints-npemin-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-npemin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.networkmanagers-nnmmin-rg/providers/Microsoft.Network/networkManagers/<namePrefix>nnmmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.firewallpolicies-nfpmin-rg/providers/Microsoft.Network/firewallPolicies/<namePrefix>nfpmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmin-rg/providers/Microsoft.Network/expressRouteCircuits/<namePrefix>nercmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasanercmax01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.Network/expressRouteCircuits/<namePrefix>nercmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg/providers/Microsoft.EventHub/namespaces/dep-<namePrefix>-evhns-nercmax] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndrwaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrwaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndrmin] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg/providers/Microsoft.Network/dnsResolvers/<namePrefix>ndrmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsForwardingRulesets/<namePrefix>ndfrswaf001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg/providers/Microsoft.Storage/storageAccounts/dep<namePrefix>diasalwwaf01] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed/providers/Microsoft.Storage/storageAccounts/saavmxdwwaf001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-<namePrefix>-vwan-nergmin] of type [Microsoft.Network/virtualWans] VERBOSE: [-] Removing resource [pdnsout] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] WARNING: [!] Removal moved back for retry. Reason: [BadRequest : Existing outbound endpoint has DNS forwarding ruleset links that have to be deleted first before outbound endpoint can be deleted. outboundEndpointResourceId=/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout, numberOfDnsForwardingRulesetLinks=1 CorrelationId: 5bca8494-6de9-4c01-be0d-5988811d0d9b] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-kvvwaf-vnetlink] of type [Microsoft.Network/privateDnsZones/virtualNetworkLinks] DELETE /subscriptions/<subscriptionId>/r. [Starting - 0,00 % completed. ] DELETE /subscriptions/<subscriptionId>/r. [Starting - 0,00 % completed. ] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf-az-pdnsin-x-001] of type [Microsoft.Network/dnsResolvers/inboundEndpoints] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 856b562e-9cc7-416a-9a00-797667b04ecb] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf-az-pdnsout-x-001] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '31388eb2-15b6-40fc-91d8-c4e9e92cba59', correlation id is 'f97aa916-0644-41b1-976b-8cc1f800bc3a'. CorrelationId: f97aa916-0644-41b1-976b-8cc1f800bc3a] VERBOSE: [-] Removing resource [dep<namePrefix>diasanvnwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nvnwaf001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-rt-nvnwaf] of type [Microsoft.Network/routeTables] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-nvnwaf] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnwaf] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nvnwaf] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-nvnpeer] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>nvnpeer001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnpeer] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep<namePrefix>diasanvnmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nvnmax001] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-rt-nvnmax] of type [Microsoft.Network/routeTables] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-nvnmax] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-auto-oiwadv] of type [Microsoft.Automation/automationAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-ehn-oiwadv] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-oiwadv] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>diasaoiwadv01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [saavmxdwmax001] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [unity-catalog-access-connector] of type [Microsoft.Databricks/accessConnectors] VERBOSE: [-] Removing resource [q3qok4o2xgwxwvuvs86hucv0] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: ffb58929-b5db-48bb-aaa0-45285bf31114] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 9bc0f1d4-e469-4569-83da-9bd95df04feb] VERBOSE: [-] Removing resource [<namePrefix>swenua001] of type [Microsoft.Synapse/workspaces] VERBOSE: [-] Removing resource [dep<namePrefix>saswenua01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-nsg-bastion-nvnmax] of type [Microsoft.Network/networkSecurityGroups] VERBOSE: [-] Removing resource [<namePrefix>sbnmin001] of type [Microsoft.ServiceBus/namespaces] VERBOSE: [-] Removing resource [<namePrefix>sssmax001] of type [Microsoft.Search/searchServices] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-sssmax01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>saoiwwaf] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasaoiwwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-oiwwaf] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-auto-oiwwaf] of type [Microsoft.Automation/automationAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>saoiwadv] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasasssmax03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nvnmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>npipmin001] of type [Microsoft.Network/publicIPPrefixes] VERBOSE: [-] Removing resource [unity-catalog-access-connector] of type [Microsoft.Databricks/accessConnectors] VERBOSE: [-] Removing resource [dep<namePrefix>diasakvvwaf03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-kvvwaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [privatelink.vaultcore.azure.net] of type [Microsoft.Network/privateDnsZones] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-kvvwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>idcemin001] of type [Microsoft.Insights/dataCollectionEndpoints] VERBOSE: [-] Removing resource [dep<namePrefix>saicmax] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep<namePrefix>diasaicmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>icmax001] of type [Microsoft.Insights/components] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-icmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [Failure Anomalies - <namePrefix>icmax001] of type [microsoft.alertsmanagement/smartDetectorAlertRules] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ehnenc] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ehnenc001] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep<namePrefix>diasadtdiwaf03] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-dtdiwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>dtdiwaf001] of type [Microsoft.DigitalTwins/digitalTwinsInstances] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-lwwaf01] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [<namePrefix>npipwaf001] of type [Microsoft.Network/publicIPPrefixes] VERBOSE: [-] Removing resource [<namePrefix>lwwaf001] of type [Microsoft.Logic/workflows] VERBOSE: [-] Removing resource [<namePrefix>nagwafpmax001] of type [Microsoft.Network/applicationGatewayWebApplicationFirewallPolicies] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-npemin] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>nnmmin001] of type [Microsoft.Network/networkManagers] VERBOSE: [-] Removing resource [<namePrefix>nfpmin001] of type [Microsoft.Network/firewallPolicies] VERBOSE: [-] Removing resource [<namePrefix>nercmin001] of type [Microsoft.Network/expressRouteCircuits] VERBOSE: [-] Removing resource [dep<namePrefix>diasanercmax01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [<namePrefix>nercmax001] of type [Microsoft.Network/expressRouteCircuits] VERBOSE: [-] Removing resource [dep-<namePrefix>-evhns-nercmax] of type [Microsoft.EventHub/namespaces] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndrwaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ndrwaf001] of type [Microsoft.Network/dnsResolvers] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndrmin] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [<namePrefix>ndrmin001] of type [Microsoft.Network/dnsResolvers] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndfrswaf] of type [Microsoft.Network/virtualNetworks] WARNING: [!] Removal moved back for retry. Reason: [InUseSubnetCannotBeDeleted : Subnet subnet-1 is in use by /subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf/subnets/subnet-1/serviceAssociationLinks/dnsResolverLink and cannot be deleted. In order to delete the subnet, delete all the resources within the subnet. See aka.ms/deletesubnet. CorrelationId: 636498cc-a349-4dbd-8c67-c9d2e020db3e] VERBOSE: [-] Removing resource [dep-<namePrefix>-ndr-ndfrswaf] of type [Microsoft.Network/dnsResolvers] WARNING: [!] Removal moved back for retry. Reason: [CannotDeleteResource : Cannot delete resource while nested resources exist. Some existing nested resource IDs include: 'Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout'. Please delete all nested resources before deleting this resource. CorrelationId: 5a56e4c8-d626-46bb-bd81-783138352cae] VERBOSE: [-] Removing resource [<namePrefix>ndfrswaf001] of type [Microsoft.Network/dnsForwardingRulesets] VERBOSE: [-] Removing resource [dep<namePrefix>diasalwwaf01] of type [Microsoft.Storage/storageAccounts] VERBOSE: [-] Removing resource [saavmxdwwaf001] of type [Microsoft.Storage/storageAccounts] VERBOSE: ---------------------------------- VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf/outboundEndpoints/pdnsout] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/virtualNetworks/dep-<namePrefix>-vnet-ndfrswaf] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg/providers/Microsoft.Network/dnsResolvers/dep-<namePrefix>-ndr-ndfrswaf] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [pdnsout] of type [Microsoft.Network/dnsResolvers/outboundEndpoints] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 15c85c04-aaa5-41a8-a012-5db2d08b2f88] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '3220689c-83cf-45f8-a4a1-5c12150cf1bb', correlation id is '577dd566-cd51-487e-9c98-cc0e4486ce02'. CorrelationId: 577dd566-cd51-487e-9c98-cc0e4486ce02] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 81d5f560-b89c-4159-ad4c-b3aba2dd5f12] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 1dd1305e-d7e2-4166-8193-78a6e053759c] VERBOSE: [-] Removing resource [dep-<namePrefix>-vnet-ndfrswaf] of type [Microsoft.Network/virtualNetworks] VERBOSE: [-] Removing resource [dep-<namePrefix>-ndr-ndfrswaf] of type [Microsoft.Network/dnsResolvers] VERBOSE: ---------------------------------- VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 632be08b-bc75-461e-988c-5269717cb199] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is 'be6e61ad-ec39-4c10-86c8-ed36817db00a', correlation id is '696735a0-485f-44e6-9ecf-92915f9db5b4'. CorrelationId: 696735a0-485f-44e6-9ecf-92915f9db5b4] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 39e58329-ed01-43c2-868c-0dfc710198db] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 5f7a64b8-2d6e-4ea8-a8b9-03face113b0b] VERBOSE: ---------------------------------- Exception: C:\dev\bicep-registry-modules\avm\utilities\pipelines\e2eValidation\resourceRemoval\helper\Remove-ResourceList.ps1:124:9 Line | 124 | throw ('The removal failed for resources [{0}]' -f ((Split-Pa … | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | The removal failed for resources [master, <namePrefix>cicgenc001, avmrhbhbmin001, avmrhbhbmax001] ``` </details> <details> <summary>Execution after adding RG support</summary> ``` PS C:\dev\bicep-registry-modules> Initialize-DeploymentRemoval -RemoveAllDepResources VERBOSE: Total number of deployment target resources after fetching deployments [36] VERBOSE: Total number of deployment target resources after pre-filtering (duplicates) & ordering items [36] VERBOSE: Total number of deployment target resources after formatting items [36] VERBOSE: Total number of deployments after filtering all dependency resources [36] VERBOSE: Total number of deployments after final ordering of resources [36] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.publicipprefixes-npipwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-search.searchservices-sssmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.privateendpoints-npemin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-servicebus.namespaces-sbnmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-synapse.workspaces-swenua-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.networkmanagers-nnmmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressRouteGateway-nergmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwmax-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.expressroutecircuits-nercmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsResolvers-ndrmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-logic.workflows-lwwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-keyvault.vaults-kvvwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-insights.components-icmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-eventhub.namespaces-ehnenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-network.firewallpolicies-nfpmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-<namePrefix>-network.publicipprefixes-npipmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.publicipprefixes-npipwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnpeer-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.virtualnetworks-nvnwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-operationalinsights.workspaces-oiwadv-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-search.searchservices-sssmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.privateendpoints-npemin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-servicebus.namespaces-sbnmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-synapse.workspaces-swenua-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '270ed8ad-68a0-476a-942c-6d22377c36a9'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: b90bb002-14f7-4032-832b-69ae37e3b30a] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '701812e8-5059-4a92-97d6-c0d35fc92d44'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 3ca89140-4603-49e7-93e3-0c959fb97014] VERBOSE: [-] Removing resource [IT_dep-<namePrefix>-compute.images-cimin-rg_dep-<namePrefix>-_0cde4fa3-334a-4ea8-be55-f9ca6584e6e1] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-operationalinsights.workspaces-oiwwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.networkmanagers-nnmmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressRouteGateway-nergmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwmax-rg-managed] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressroutecircuits-nercmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.expressroutecircuits-nercmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsResolvers-ndrwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsResolvers-ndrmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.dnsForwardingRuleset-ndfrswaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.applicationGatewayWebApplicationFirewallPolicies-nagwafpmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-logic.workflows-lwwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-keyvault.vaults-kvvwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-insights.dataCollectionEndpoints-idcemin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-insights.components-icmax-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-eventhub.namespaces-ehnenc-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-digitaltwins.digitaltwinsinstances-dtdiwaf-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionTimeout","message":"Deletion of resource group 'dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg' did not finish within the allowed time as resources with identifiers 'Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '3ab01252-3168-4ef2-8491-5317dae1db41'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001","message":"{\"error\":{\"code\":\"InternalServerError\",\"message\":\"Encountered an internal server error. The tracking activity id is 'c0cd7e57-12ec-4d56-a001-c03780eef578', correlation id is '3ab01252-3168-4ef2-8491-5317dae1db41'.\"}}"}]}} CorrelationId: 873c04ae-e730-4e41-adb1-e85f7b8f9fef] VERBOSE: [-] Removing resource [dep-<namePrefix>-network.firewallpolicies-nfpmin-rg] of type [Microsoft.Resources/resourceGroups] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: 6c61fe5d-7233-4ad6-b33a-c4ef906bd270] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 2c130ff7-ca6b-462d-a722-fbf18fbd86e8] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '609139de-e745-49a7-922c-d40caf735f18', correlation id is 'b913c064-03dd-4e7a-ab30-4e39155d12ef'. CorrelationId: b913c064-03dd-4e7a-ab30-4e39155d12ef] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: c00fbfc3-307d-4129-a24b-0957c01d453a] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: e73374cb-84e0-40af-adbd-f09607d63879] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [1|3] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '4b5a669c-71fa-4872-a74e-f7dc9e42fdcd'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: f027db06-7884-44cd-bbd5-503b9f853401] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '895a795f-d6fb-4df0-90ad-05d5e5767bc8'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 290f9cb4-27d9-49e8-8e5c-89aeb1b24548] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionTimeout","message":"Deletion of resource group 'dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg' did not finish within the allowed time as resources with identifiers 'Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '9068dc6f-57ad-4b54-a0b9-0a97223e8eae'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001","message":"{\"error\":{\"code\":\"InternalServerError\",\"message\":\"Encountered an internal server error. The tracking activity id is '5119291c-288d-48ab-b1e1-dfa90c29cad6', correlation id is '9068dc6f-57ad-4b54-a0b9-0a97223e8eae'.\"}}"}]}} CorrelationId: 68196e76-7bdd-4e47-ab29-ad51b6eddcd4] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: 1b17ec09-6039-4785-9112-e43acb7cda1f] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 4e03c4f3-4605-4ad4-b672-f37b231fecbb] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '92c169ae-e964-4bce-a31d-f13307e729ea', correlation id is '0eec5b46-fc55-4e88-9409-95f1c9933cd4'. CorrelationId: 0eec5b46-fc55-4e88-9409-95f1c9933cd4] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: edb388a1-6e3e-48fd-803f-4c173ffe8184] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 3f721795-2e7f-4cb9-bf40-e41e29589f23] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [2|3] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-sql.servers-sqlspe-rg/providers/Microsoft.Sql/servers/<namePrefix>-sqlspe/databases/master] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg/providers/Microsoft.ContainerInstance/containerGroups/<namePrefix>cicgenc001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001] VERBOSE: - Remove [/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001] VERBOSE: ---------------------------------- VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmax-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmax-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmax001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '672f3094-43a1-4eb6-859b-f9e2fe7d086f'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmax-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmax001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: 3ad140d1-9d60-47fc-83ae-4cbdc0ce33e3] VERBOSE: [-] Removing resource [dep-avmr-healthbot.healthbots-hbhbmin-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [{"error":{"code":"ResourceGroupDeletionBlocked","message":"Deletion of resource group 'dep-avmr-healthbot.healthbots-hbhbmin-rg' failed as resources with identifiers 'Microsoft.HealthBot/healthBots/avmrhbhbmin001' could not be deleted. The provisioning state of the resource group will be rolled back. The tracking Id is '721645e9-ac6b-450a-a08a-e05e57dee3a3'. Please check audit logs for more details.","details":[{"target":"/subscriptions/<subscriptionId>/resourceGroups/dep-avmr-healthbot.healthbots-hbhbmin-rg/providers/Microsoft.HealthBot/healthBots/avmrhbhbmin001","message":"{\"error\":{\"code\":\"400\",\"message\":\"Resource not in terminal state. Wait until resource is in terminal provisioningState and try again\"}}"}]}} CorrelationId: de39ed72-ca70-43be-950f-0177cfdfc54a] VERBOSE: [-] Removing resource [dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [No such host is known. (management.azure.com:443)] VERBOSE: [-] Removing resource [rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed] of type [Microsoft.Resources/resourceGroups] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed' could not be found. CorrelationId: e8f0a716-c316-4179-9f18-5f364c6df5bf] VERBOSE: [-] Removing resource [master] of type [Microsoft.Sql/servers/databases] WARNING: [!] Removal moved back for retry. Reason: [ResourceGroupNotFound : Resource group 'dep-<namePrefix>-sql.servers-sqlspe-rg' could not be found. CorrelationId: 62edcdde-c886-4638-9f33-1c8c96f3dc12] VERBOSE: [-] Removing resource [<namePrefix>cicgenc001] of type [Microsoft.ContainerInstance/containerGroups] WARNING: [!] Removal moved back for retry. Reason: [InternalServerError : Encountered an internal server error. The tracking activity id is '819de35f-9f5b-4782-801b-833fb84309e2', correlation id is '37ca6aaa-87f3-48ff-bcc9-6acf23fa80bc'. CorrelationId: 37ca6aaa-87f3-48ff-bcc9-6acf23fa80bc] VERBOSE: [-] Removing resource [avmrhbhbmax001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: fb86ed27-6d42-4393-b04d-08e43b07904d] VERBOSE: [-] Removing resource [avmrhbhbmin001] of type [Microsoft.HealthBot/healthBots] WARNING: [!] Removal moved back for retry. Reason: [400 : Resource not in terminal state. Wait until resource is in terminal provisioningState and try again CorrelationId: 7cbb2e66-2269-4372-9ce6-d3a2163b76d2] VERBOSE: ---------------------------------- VERBOSE: Retry removal of remaining [8] resources. Waiting [15] seconds. Round [3|3] Exception: C:\dev\bicep-registry-modules\avm\utilities\pipelines\e2eValidation\resourceRemoval\helper\Remove-ResourceList.ps1:124:9 Line | 124 | throw ('The removal failed for resources [{0}]' -f ((Split-Pa … | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | The removal failed for resources [dep-avmr-healthbot.healthbots-hbhbmax-rg, dep-avmr-healthbot.healthbots-hbhbmin-rg, dep-<namePrefix>-containerinstance.containergroups-cicgenc-rg, | rg-dep-avmx-databricks.workspaces-dwwaf-rg-managed, master, <namePrefix>cicgenc001, avmrhbhbmax001, avmrhbhbmin001] ``` </details> ## Pipeline Reference <!-- Insert your Pipeline Status Badge below --> | Pipeline | | -------- | | [](https://github.com/AlexanderSehr/bicep-registry-modules/actions/workflows/avm.res.analysis-services.server.yml) | ## Type of Change <!-- Use the check-boxes [x] on the options that are relevant. --> - [x] Update to CI Environment or utlities (Non-module effecting changes) - [ ] Azure Verified Module updates: - [ ] Bugfix containing backwards compatible bug fixes, and I have NOT bumped the MAJOR or MINOR version in `version.json`: - [ ] Someone has opened a bug report issue, and I have included "Closes #{bug_report_issue_number}" in the PR description. - [ ] The bug was found by the module author, and no one has opened an issue to report it yet. - [ ] Feature update backwards compatible feature updates, and I have bumped the MINOR version in `version.json`. - [ ] Breaking changes and I have bumped the MAJOR version in `version.json`. - [ ] Update to documentation --------- Co-authored-by: Erika Gressi <[email protected]> Co-authored-by: ChrisSidebotham-MSFT <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
dep-in its name to be removed using the default removal logicInitial execution
Execution after adding RG support
Pipeline Reference
Type of Change
version.json:version.json.version.json.