(cdk import): (imports of a certain size cause ENOENT error) #22530

tbreysse · 2022-10-17T15:43:06Z

Describe the bug

Currently, it seems that there is a bug with the 'cdk import' functionality which causes an ENOENT error when attempting to import multiple resources in certain templates.

Error:

 [100%] fail:ENOENT: no such file or directory, open '\cdk-sample\ cdk.out\ test-stack.template.json-4dd9ae34ff7bf1fc59854e70adaf75041674eba29d3d02e7a34f8521ce.yaml'

After some extensive testing, I have not been able to find a definite root cause, but it seems that the issue appears to be related to template size and number of resources imported.

Expected Behavior

The expected behavior is that the import process will successfully import the resources without error

Current Behavior

After importing a certain number of resources the import command fails with an ENOENT error.

Reproduction Steps

Create a CDK stack with the following code:

from constructs import Construct
from aws_cdk import (
    Stack,
    aws_iam,
    aws_apigateway,
    aws_lambda
)
import aws_cdk as cdk

class SampleAppStack(Stack):
    
    def __init__(self, scope: Construct, construct_id: str, **kwargs) -> None:
        super().__init__(scope, construct_id, **kwargs)

        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest1', 
            _replace_name='sampleTest1',
            #_alias='test'
        )

        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest2', 
            _replace_name='sampleTest2', 
            #_alias='test'
        )

        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest3', 
            _replace_name='sampleTest3', 
            #_alias='test'
        )
        
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest4', 
            _replace_name='sampleTest4',
            #_alias='test'
        )       
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest5', 
            _replace_name='sampleTest5', 
           #_alias='test'
        )
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest6', 
            _replace_name='sampleTest6',
            #_alias='ST'
        )    
        
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest7', 
            _replace_name='sampleTest7',
            #_alias='ST'
        )
        
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest8', 
            _replace_name='sampleTest8',
            #_alias='test'
        )
         
        lambda_function = self.create_lambda_function(
            'manufacture-sampleTest9', 
            _replace_name = 'sampleTest9',
            #_alias='test'
        )
               
    def set_lambda_variables(self, _lmd_func):
        _lmd_func.add_environment(
            'testParam1', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam2', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam3', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam4', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 


    def create_lambda_function(self, _lambda_name: str, _replace_name: str, _alias=None):
        result_lambda = aws_lambda.Function(
            self,
            id='id-{}'.format(_lambda_name),
            function_name='lmd-an2-st-t20-common-{}'.format(_lambda_name),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        self.set_lambda_variables(result_lambda)
        function_version = result_lambda.current_version
        if _alias:
            _function_alias = aws_lambda.Alias(
                self,
                id='id-alias-{}'.format(_lambda_name),
                alias_name='{}'.format(_alias),
                version=function_version)
        cfn_lambda = result_lambda.node.default_child
        cfn_lambda.override_logical_id(_replace_name)

Manually create an Alias for each of the created functions in the Lambda console.
Uncomment the alias definition for reach resource in the code
Run cdk import and import each of the Aliases.

For a second reproduction you can utilize the following template which shows the same behavior, but only after importing 10 Aliases as opposed to 6 which is the number that can import before failure for the above template.

from constructs import Construct
from aws_cdk import (
    Stack,
    aws_iam,
    aws_apigateway,
    aws_lambda
)
import aws_cdk as cdk

class Cdkpython3Stack(Stack):
    
    def __init__(self, scope: Construct, construct_id: str, **kwargs) -> None:
        super().__init__(scope, construct_id, **kwargs)
        result_lambda1 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest1'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest1'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda2 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest2'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest2'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda3 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest3'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest3'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda4 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest4'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest4'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda5 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest5'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest5'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda6 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest6'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest6'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda7 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest7'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest7'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda8 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest8'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest8'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        result_lambda9 = aws_lambda.Function(
            self,
            id='id-{}'.format('manufacture-sampleTest9'),
            function_name='lmd-an2-st-t20-common-{}'.format('manufacture-sampleTest9'),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )

        self.set_lambda_variables(result_lambda1)
        self.set_lambda_variables(result_lambda2)
        self.set_lambda_variables(result_lambda3)
        self.set_lambda_variables(result_lambda4)
        self.set_lambda_variables(result_lambda5)
        self.set_lambda_variables(result_lambda6)
        self.set_lambda_variables(result_lambda7)
        self.set_lambda_variables(result_lambda8)
        self.set_lambda_variables(result_lambda9)


        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest1'),
            alias_name='{}'.format('ST'),
            version=result_lambda1.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest2'),
            alias_name='{}'.format('ST'),
            version=result_lambda2.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest3'),
            alias_name='{}'.format('ST'),
            version=result_lambda3.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest4'),
            alias_name='{}'.format('ST'),
            version=result_lambda4.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest5'),
            alias_name='{}'.format('ST'),
            version=result_lambda5.latest_version)
        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest6'),
            alias_name='{}'.format('ST'),
            version=result_lambda6.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest7'),
            alias_name='{}'.format('ST'),
            version=result_lambda7.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest8'),
            alias_name='{}'.format('ST'),
            version=result_lambda8.latest_version)

        _function_alias = aws_lambda.Alias(
            self,
            id='id-alias-{}'.format('manufacture-sampleTest9'),
            alias_name='{}'.format('ST'),
            version=result_lambda9.latest_version)
               
    def set_lambda_variables(self, _lmd_func):
        _lmd_func.add_environment(
            'testParam1', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam2', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam3', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 
        _lmd_func.add_environment(
            'testParam4', '''"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx \
                    xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx "''' 
                ) 


    def create_lambda_function(self, _lambda_name: str, _replace_name: str, _alias=None):
        result_lambda = aws_lambda.Function(
            self,
            id='id-{}'.format(_lambda_name),
            function_name='lmd-an2-st-t20-common-{}'.format(_lambda_name),
            runtime=aws_lambda.Runtime.PYTHON_3_9,
            code=aws_lambda.Code.from_asset('lambda'),
            handler='hello.handler',
        )
        self.set_lambda_variables(result_lambda)
        function_version = result_lambda.current_version
        cfn_lambda = result_lambda.node.default_child
        cfn_lambda.override_logical_id(_replace_name)

Possible Solution

N/A

Additional Information/Context

As mentioned in the reproduction steps, the behavior of this bug is peculiar.

With the first provided reproduction template, you can import 6 Aliases before the failure occurs. The error will occur for any additional imports after 6.

With the second provided template, you can successfully import 9 Aliases, but once you try to import a 10th, the same error occurs again. Also the error occurs with both Python and TypeScript stacks.

It is understandable that issue such as this may occur since the cdk import feature is still currently in preview, however this behavior seems worth reporting.

CDK CLI Version

2.41.0

Framework Version

No response

Node.js Version

14.17.0

OS

Windows 10

Language

Typescript, Python

Language Version

No response

Other information

No response

The text was updated successfully, but these errors were encountered:

mascur · 2022-10-18T23:13:54Z

Hi @tbreysse,

I was able to successfully reproduce this issue. Thank you for reporting this! We will try to look at this soon.

If anyone has any ideas on where the root cause of this issue may be occurring please feel free to comment below!

rix0rrr · 2022-11-10T09:03:01Z

@mascur does this reproduce anywhere besides Windows?

The ENOENT thoroughly confuses me. That means "file not found", but I don't see how template size would impact that.

The best I can think of is that there might be a race condition somewhere that only shows itself on Windows...

rix0rrr · 2022-11-10T09:06:14Z

I also wonder what kind of file test-stack.template.json-4dd9ae34ff7bf1fc59854e70adaf75041674eba29d3d02e7a34f8521ce.yaml is supposed to be...

rix0rrr · 2022-11-10T09:06:55Z

@mascur can you throw a repro up on GitHub?

github-actions · 2023-01-06T16:07:04Z

This issue has not received a response in a while. If you want to keep this issue open, please leave a comment below and auto-close will be canceled.

woodyfeng-swingvy · 2023-04-30T09:28:15Z

@mascur @rix0rrr
Take OP's output for example:

[100%] fail:ENOENT: no such file or directory, open '\cdk-sample\cdk.out\test-stack.template.json-4dd9ae34ff7bf1fc59854e70adaf75041674eba29d3d02e7a34f8521ce.yaml'

The problem is the YAML file was generated under the project root, not the output directory
i.e. it would be at

'\cdk-sample\test-stack.template.json-4dd9ae34ff7bf1fc59854e70adaf75041674eba29d3d02e7a34f8521ce.yaml'

I hope this helps.

P.S. The content of the generated YAML looks just like a .template.json file

camitz · 2024-04-29T12:06:41Z

@woodyfeng-swingvy is right.

@TheRealAmazonKendra

…folder (#29830) ### Issue # (if applicable) Closes #22928 #22530 I'm reopening as the original was closed due to inactivity. ### Reason for this change When the template is synthesized, if it is larger than 50kb and cannot be inlined in the CFN request, CLI writes it to the filesystem to be uploaded to S3. Unlike regular deployments `import` overrides the template, when it does so the code responsible for writing the large template to the filesystem writes to the project root. This code reproduces the issue: ``` import * as cdk from "aws-cdk-lib"; import { Construct } from "constructs"; import * as sqs from "aws-cdk-lib/aws-sqs"; import * as iam from "aws-cdk-lib/aws-iam"; export class AwsCdkImportBugStack extends cdk.Stack { constructor(scope: Construct, id: string, props?: cdk.StackProps) { super(scope, id, props); for (let i = 0; i < 70; i++) { const q = new sqs.Queue(this, `AwsCdkImportBugQueue${i}`, { visibilityTimeout: cdk.Duration.seconds(300), enforceSSL: true, }); } // new sqs.Queue(this, `AwsCdkImportBugQueue`, { // visibilityTimeout: cdk.Duration.seconds(300), // enforceSSL: true, // removalPolicy: cdk.RemovalPolicy.RETAIN, // }); } } ``` Deploy the stack, uncomment the queue, and try to import. This error happens: ``` $ npx cdk import AwsCdkImportBugStack AwsCdkImportBugStack/AwsCdkImportBugQueue/Resource (AWS::SQS::Queue): enter QueueUrl (empty to skip): https://sqs.eu-central-1.amazonaws.com/<cut>/AwsCdkBugStack-keep186A2ECA-IznVNwytuY1b AwsCdkImportBugStack/AwsCdkImportBugQueue/Policy/Resource (AWS::SQS::QueuePolicy): enter Id (empty to skip): Skipping import of AwsCdkImportBugStack/AwsCdkImportBugQueue/Policy/Resource AwsCdkImportBugStack: importing resources into stack... [0%] start: Publishing 06a2c6415fd2982e3285e9d615e5f9b99d1d795a9064479fbe6b88455ac62f6c:current [100%] fail: ENOENT: no such file or directory, open '/home/nburtsev/projects/aws-cdk-import-bug/cdk.out/AwsCdkImportBugStack.template.json-06a2c6415fd2982e3285e9d615e5f9b99d1d795a9064479fbe6b88455ac62f6c.yaml' ❌ AwsCdkImportBugStack failed: Error: Failed to publish one or more assets. See the error messages above for more information. at publishAssets (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:420:84876) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async deployStack (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:430:391) at async ResourceImporter.importResources (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:433:171694) at async ResourceImporter.importResourcesFromMap (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:433:171357) at async CdkToolkit.import (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:433:205058) at async exec4 (/home/nburtsev/projects/aws-cdk-import-bug/node_modules/aws-cdk/lib/index.js:488:54378) Failed to publish one or more assets. See the error messages above for more information. ``` The file is created, it's just in the project root not in cdk.out: ``` ~/projects/aws-cdk-import-bug $ ls -la total 284 drwxr-xr-x 7 nburtsev users 4096 Mar 22 10:48 . drwxr-xr-x 8 nburtsev users 4096 Mar 22 10:11 .. -rw-r--r-- 1 nburtsev users 64131 Mar 22 10:48 AwsCdkImportBugStack.template.json-06a2c6415fd2982e3285e9d615e5f9b99d1d795a9064479fbe6b88455ac62f6c.yaml drwxr-xr-x 2 nburtsev users 4096 Mar 22 10:12 bin -rw-r--r-- 1 nburtsev users 3185 Mar 22 10:12 cdk.json drwxr-xr-x 2 nburtsev users 4096 Mar 22 10:48 cdk.out <cut> ``` ### Description of changes I've just added a path.join similar to how it is done in regular template generation. ### Description of how you validated changes I've added a test case but I believe tests are broken globally as per @TheRealAmazonKendra ### Checklist - [x] My code adheres to the [CONTRIBUTING GUIDE](https://github.com/aws/aws-cdk/blob/main/CONTRIBUTING.md) and [DESIGN GUIDELINES](https://github.com/aws/aws-cdk/blob/main/docs/DESIGN_GUIDELINES.md) ---- *By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*

tbreysse added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Oct 17, 2022

github-actions bot added the @aws-cdk/aws-lambda Related to AWS Lambda label Oct 17, 2022

github-actions bot assigned kaizencc Oct 17, 2022

mascur added p1 package/tools Related to AWS CDK Tools or CLI effort/medium Medium work item – several days of effort and removed needs-triage This issue or PR still needs to be triaged. @aws-cdk/aws-lambda Related to AWS Lambda labels Oct 18, 2022

kaizencc removed their assignment Oct 28, 2022

kaizencc assigned rix0rrr Nov 9, 2022

rix0rrr added the response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. label Jan 6, 2023

github-actions bot closed this as completed Jan 11, 2023

MikeDombo mentioned this issue Mar 22, 2024

fix: import should write overrideTemplate to assembly.outdir #29509

Closed

1 task

nburtsev mentioned this issue Apr 15, 2024

fix(cli): template created during import should be written to assets folder #29830

Merged

1 task

tengell mentioned this issue Jun 6, 2024

[Snyk] Upgrade aws-cdk-lib from 2.141.0 to 2.142.0 capralifecycle/liflig-cdk#267

Closed

NOUIY mentioned this issue Jun 7, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#102

Open

niravparikh05 mentioned this issue Jun 13, 2024

[Snyk] Upgrade aws-cdk from 2.65.0 to 2.142.1 paralus/eks-blueprints-addon#3

Open

NOUIY mentioned this issue Jun 14, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#103

Open

snyk-io bot mentioned this issue Jun 20, 2024

[Snyk] Upgrade aws-cdk-lib from 2.138.0 to 2.143.1 Opetushallitus/heratepalvelu#280

Open

NOUIY mentioned this issue Jun 20, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#104

Open

snyk-io bot mentioned this issue Jun 21, 2024

[Snyk] Upgrade aws-cdk-lib from 2.139.0 to 2.143.1 Opetushallitus/ovara#36

Open

rwlxxvii mentioned this issue Jun 22, 2024

[Snyk] Upgrade aws-cdk-lib from 2.139.0 to 2.144.0 rwlxxvii/containers#140

Merged

This was referenced Jun 22, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#105

Open

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#106

Open

This was referenced Jul 5, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#107

Open

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#108

Open

This was referenced Jul 16, 2024

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#109

Open

[Snyk] Upgrade: , aws-cdk NOUIY/aws-solutions-constructs#110

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

(cdk import): (imports of a certain size cause ENOENT error) #22530

(cdk import): (imports of a certain size cause ENOENT error) #22530

tbreysse commented Oct 17, 2022

mascur commented Oct 18, 2022

rix0rrr commented Nov 10, 2022

rix0rrr commented Nov 10, 2022

rix0rrr commented Nov 10, 2022

github-actions bot commented Jan 6, 2023

woodyfeng-swingvy commented Apr 30, 2023

camitz commented Apr 29, 2024

(cdk import): (imports of a certain size cause ENOENT error) #22530

(cdk import): (imports of a certain size cause ENOENT error) #22530

Comments

tbreysse commented Oct 17, 2022

Describe the bug

Expected Behavior

Current Behavior

Reproduction Steps

Possible Solution

Additional Information/Context

CDK CLI Version

Framework Version

Node.js Version

OS

Language

Language Version

Other information

mascur commented Oct 18, 2022

rix0rrr commented Nov 10, 2022

rix0rrr commented Nov 10, 2022

rix0rrr commented Nov 10, 2022

github-actions bot commented Jan 6, 2023

woodyfeng-swingvy commented Apr 30, 2023

camitz commented Apr 29, 2024