Airlock VM not Deleting

[eyalanmegaw]

Hello,

Upon approving Airlock Export Request the VM that was created to review the data is not deleting:

NOTE: I was still connected to the Export Review VM in the browser after I approved the Export Request

Status: deleting_failed
Action: uninstall
Message: c6b037c0-6c5f-4726-b1ba-831069bd89fd: Error message: �[31m╷�[0m�[0m �[31m│�[0m �[0m�[1m�[31mError: �[0m�[0m�[1mdeleting Network Interface (Subscription: "" �[31m│�[0m �[0mResource Group Name: "rg-demotre01-ws-189d" �[31m│�[0m �[0mNetwork Interface Name: "internal-nic-demotre01-ws-189d-svc-89fd"): performing Delete: unexpected status 400 (400 Bad Request) with error: NicReservedForAnotherVm: Nic(s) in request is reserved for another Virtual Machine for 180 seconds. Please provide another nic(s) or retry after 180 seconds. Reserved VM: /subscriptions//resourceGroups/rg-demotre01-ws-189d/providers/Microsoft.Compute/virtualMachines/windowsvm89fd�[0m �[31m│�[0m �[0m �[31m│�[0m �[0m�[0m �[31m╵�[0m�[0m error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime uninstall �[31m╷�[0m�[0m �[31m│�[0m �[0m�[1m�[31mError: �[0m�[0m�[1mdeleting Network Interface (Subscription: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" �[31m│�[0m �[0mResource Group Name: "rg-demotre01-ws-189d" �[31m│�[0m �[0mNetwork Interface Name: "internal-nic-demotre01-ws-189d-svc-89fd"): performing Delete: unexpected status 400 (400 Bad Request) with error: NicReservedForAnotherVm: Nic(s) in request is reserved for another Virtual Machine for 180 seconds. Please provide another nic(s) or retry after 180 seconds. Reserved VM: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-demotre01-ws-189d/providers/Microsoft.Compute/virtualMachines/windowsvm89fd�[0m �[31m│�[0m �[0m �[31m│�[0m �[0m�[0m �[31m╵�[0m�[0m error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 1 error occurred: * mixin execution failed: package command failed /cnab/app/cnab/app/mixins/terraform/runtimes/terraform-runtime uninstall �[31m╷�[0m�[0m �[31m│�[0m �[0m�[1m�[31mError: �[0m�[0m�[1mdeleting Network Interface (Subscription: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" �[31m│�[0m �[0mResource Group Name: "rg-demotre01-ws-189d" �[31m│�[0m �[0mNetwork Interface Name: "internal-nic-demotre01-ws-189d-svc-89fd"): performing Delete: unexpected status 400 (400 Bad Request) with error: NicReservedForAnotherVm: Nic(s) in request is reserved for another Virtual Machine for 180 seconds. Please provide another nic(s) or retry after 180 seconds. Reserved VM: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-demotre01-ws-189d/providers/Microsoft.Compute/virtualMachines/windowsvm89fd�[0m �[31m│�[0m �[0m �[31m│�[0m �[0m�[0m �[31m╵�[0m�[0m error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 Error: error running command /cnab/app/terraform /usr/bin/terraform destroy -auto-approve -input=false -var airlock_request_sas_url=unused -var enable_cmk_encryption=false -var image=Server 2019 Data Science VM -var key_store_id= -var parent_service_id=dcf37db8-78c5-40cf-a99b-0e1f26f525d3 -var tre_id=demotre01 -var tre_resource_id=c6b037c0-6c5f-4726-b1ba-831069bd89fd -var vm_size=2 CPU | 8GB RAM -var workspace_id=dd1c6ac6-f0d0-4775-aa3a-869b0afb189d: exit status 1 1 error occurred: * container exit code: 1, message: ; Command executed: porter uninstall "c6b037c0-6c5f-4726-b1ba-831069bd89fd" --reference acrdemotre01.azurecr.io/tre-service-guacamole-export-reviewvm:v0.2.2 --param airlock_request_sas_url="REDACTED" --param arm_environment="public" --param arm_use_msi="true" --param azure_environment="AzureCloud" --param enable_cmk_encryption="false" --param id="c6b037c0-6c5f-4726-b1ba-831069bd89fd" --param key_store_id="" --param parent_service_id="dcf37db8-78c5-40cf-a99b-0e1f26f525d3" --param tfstate_container_name="tfstate" --param tfstate_resource_group_name="RG-DEMOTRE" --param tfstate_storage_account_name="sademotre01" --param tre_id="demotre01" --param workspace_id="dd1c6ac6-f0d0-4775-aa3a-869b0afb189d" --force --credential-set arm_auth --credential-set aad_auth

If I close the browser tab with the connection to the Export Review VM and then try to delete the Export Review VM manually via the ellipsis:

The Export review VM is deleted.

Is above the expected behaviour?

Thanks,
Alan

[marrobi]

Weird not seen this before. Looks like Terraform is trying to delete the Nic before the VM is deleted.

Similar to: hashicorp/terraform-provider-azurerm#18915

@tamirkamara got any thoughts on this one?

[eyalanmegaw]

@marrobi @tamirkamara any further thoughts on this, we are seeing same behaviour with airlock import review VM's..

[SiobhanBaynes]

@marrobi assign to me please

[LoicbarbeE61]

I encountered the same error and was able to resolve it by adding a 180-second delay when the network interface (NIC) is destroyed in windowsvm.tf of each review vm.

resource "null_resource" "nic_destroy_delay" {
  triggers = {
    nic_id = azurerm_network_interface.internal.id
  }

  provisioner "local-exec" {
    when    = destroy
    command = "sleep 180"
  }
}

[marrobi]

@LoicbarbeE61 thank you, that is great to know, @SiobhanBaynes, FYI.

[eyalanmegaw]

@LoicbarbeE61 thank you!

Could I ask specifically where in the windowsvm.tf you added:

resource "null_resource" "nic_destroy_delay" {
triggers = {
nic_id = azurerm_network_interface.internal.id
}

provisioner "local-exec" {
when = destroy
command = "sleep 180"
}
}

also, after amending the files did you run the following?

• make user_resource_bundle BUNDLE=guacamole-azure-export-reviewvm WORKSPACE_SERVICE=guacamole
• make user_resource_bundle BUNDLE=guacamole-azure-import-reviewvm WORKSPACE_SERVICE=guacamole

thanks again,
Alan

[LoicbarbeE61]

Hi @eyalanmegaw,

I added the null_resource "nic_destroy_delay" block just above the resource "azurerm_network_interface" "internal" declaration in windowsvm.tf in both review templates, like this:

resource "null_resource" "nic_destroy_delay" {
  triggers = {
    nic_id = azurerm_network_interface.internal.id
  }

  provisioner "local-exec" {
    when    = destroy
    command = "sleep 180"
  }
}


resource "azurerm_network_interface" "internal" {
  name                = "internal-nic-${local.service_resource_name_suffix}"
  location            = data.azurerm_resource_group.ws.location
  resource_group_name = data.azurerm_resource_group.ws.name
  tags                = local.tre_user_resources_tags

  ip_configuration {
    name                          = "primary"
    subnet_id                     = data.azurerm_subnet.services.id
    private_ip_address_allocation = "Dynamic"
  }

  lifecycle {
    ignore_changes = [tags]
  }
}

After that, I bumped the version of the templates in porter.yaml and ran the two make commands you mentioned:

make user_resource_bundle BUNDLE=guacamole-azure-export-reviewvm WORKSPACE_SERVICE=guacamole  
make user_resource_bundle BUNDLE=guacamole-azure-import-reviewvm WORKSPACE_SERVICE=guacamole

Everything worked smoothly after that.

[eyalanmegaw]

much appreciated @LoicbarbeE61