Files into storage are also listed in state file

[farreciado]

Hello, I ran the tool to get a RG (running in production) resources file, and got like 3000 entries. As there actually were like 20-30 resources in that RG...I checked what happened and found thousands of media files (such mp4) present in an storage. Is there a way to avoid listing the resources inside an storage? Are the files inside storage considered resources? Thanks for helping and congrats for the tool. BTW process took really long, I wish with paralellism the execution time lowers!

[magodo]

@farreciado Assuming you are seeing thousands of azurerm_storage_blob, then yes they are also counted as valid resoruces in the RG. If you don't want to export them, you can modify the resource mapping file (named aztfyResourceMapping.json) to remove those entries and then run aztfy map [options] <path2mappingFile>.

The parallel import feature is implemeneted in #260 and will be available in the next release.

[farreciado]

Thanks for the comments. Editing files to make such a huge change (hundreds of entries) is something I wish to avoid due to human errors, but currently there's no other choice.

This is how entries look like (Names obfuscated). Why the MP4 video files are listed?

{
  "mode": "managed",
  "type": "azurerm_media_asset",
  "name": "res-1539",
  "provider": "provider[\"registry.terraform.io/hashicorp/azurerm\"]",
  "instances": [
    {
      "schema_version": 0,
      "attributes": {
        "alternate_id": "02myVideo.mp4",
        "container": "asset-9999999-1fdc-46af-ffff-b1cc32b32349",
        "description": "final asset",
        "id": "/subscriptions/SUBSCRIPTION_ID/resourceGroups/MYRG/providers/Microsoft.Media/mediaservices/PROJECT/assets/02myVideo.mp4",
        "media_services_account_name": "MYRG",
        "name": "02myVideo.mp4",
        "resource_group_name": "MYRG",
        "storage_account_name": "STORAGENAME",
        "timeouts": {
          "create": null,
          "delete": null,
          "read": null,
          "update": null
        }
      },
      "sensitive_attributes": [],
      "private": "eyJlMmJmYjczMC1lY2FhLTExZTYtOGY4OC0zNDM2M2JjN2M0YzAiOnsiY3JlYXRlIjoxODAwMDAwMDAwMDAwLCJkZWxldGUiOjE4MDAwMDAwMDAwMDAsInJlYWQiOjMwMDAwMDAwMDAwMCwidXBkYXRlIjoxODAwMDAwMDAwMDAwfSwic2NoZW1hX3ZlcnNpb24iOiIwIn0="
    }
  ]
},

[magodo]

@farreciado That is because aztfy firstly recursively list all the Azure resources in the RG you've specified, where these assets are also listed. Then it maps these resources to the TF resource via its Azure resource id, and deduce the correct TF resource type, in this case it is azurerm_media_asset.

If you simply want to ignore the azurerm_media_asset resources, you can run following jq command:

cat aztfyResourceMapping.json | jq 'with_entries(select(.value.resource_type != "azurerm_media_asset"))'

[magodo]

@farreciado Since we haven't get further response from you, I'll mark this issue as closed for now. Feel free to reopen it if the issue still remains.