Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ [Integration.DataFactory] Add support for Dataflows which contain flowlets #227

Open
ClementVaillantCodit opened this issue Nov 20, 2024 · 0 comments
Assignees
Labels
area:integration All issues related to integration resources. feature All issues related to new features
Milestone

Comments

@ClementVaillantCodit
Copy link
Contributor

ClementVaillantCodit commented Nov 20, 2024

A dataflow can contain one or multiple flowlet.

A flowlet is acting like a piece of dataflow that can be reused.

More information here: https://learn.microsoft.com/en-us/rest/api/datafactory/data-flow-debug-session/add-data-flow?view=rest-datafactory-2018-06-01&tabs=HTTP#dataflowdebugresource

Here is a code sample on how to add a flowlet to the DataFactoryDataFlowDebugPackageContent:

if (flowletNames?.Count > 0)
{
    foreach (var flowletName in flowletNames)
    {
        // get the flowlet
        DataFactoryDataFlowResource flowlet = (await _datafactoryResource.GetDataFactoryDataFlowAsync(flowletName)).Value;

        var dataFactoryFlowletDebugInfo = new DataFactoryDataFlowDebugInfo(flowlet.Data.Properties)
        {
            Name = flowletName
        };
        dataFactoryDataFlowDebugPackageContent.DataFlows.Add(dataFactoryFlowletDebugInfo);
    }
}

This can be re-used and re-adjusted in Arcus.Testing.Integration.DataFactory

@ClementVaillantCodit ClementVaillantCodit self-assigned this Nov 20, 2024
@ClementVaillantCodit ClementVaillantCodit added feature All issues related to new features area:integration All issues related to integration resources. labels Nov 20, 2024
@ClementVaillantCodit ClementVaillantCodit added this to the v1.3 milestone Nov 20, 2024
@ClementVaillantCodit ClementVaillantCodit moved this to To do in Roadmap Nov 20, 2024
@stijnmoreels stijnmoreels changed the title [Integration.DataFactory] Add support for Dataflows which contain flowlets ✨ [Integration.DataFactory] Add support for Dataflows which contain flowlets Dec 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:integration All issues related to integration resources. feature All issues related to new features
Projects
Status: To do
Development

No branches or pull requests

1 participant