DataLakeFileClient openQueryInputStream returns 403 #20193

irbash · 2021-03-29T08:27:31Z

Hi,

I am using azure datalake dependency as below:

<dependency>
			<groupId>com.azure</groupId>
			<artifactId>azure-storage-file-datalake</artifactId>
			<version>12.4.0</version>
		</dependency>

I create the DataLakeServiceClient as below:

private DataLakeServiceClient getDataLakeServiceClient() {
        DataLakeServiceClientBuilder builder = new DataLakeServiceClientBuilder();
        if (StringUtils.isNotBlank(sasToken)) {
            return builder.sasToken(sasToken).endpoint(accountFQDN).buildClient();
        } else {
            ClientSecretCredential clientSecretCredential = new ClientSecretCredentialBuilder()
                    .clientId(clientId)
                    .clientSecret(clientKey)
                    .tenantId(tenantId)
                    .build();
            return builder.credential(clientSecretCredential).endpoint(accountFQDN).buildClient();
        }
    }

And I use the below code for getting InputStream from a file on ADLS Gen2:

DataLakeServiceClient dataLakeServiceClient = getDataLakeServiceClient();
       DataLakeFileSystemClient srcFileSystemClient = dataLakeServiceClient.getFileSystemClient(fileSystem)
       DataLakeFileClient srcFileClient =
               srcFileSystemClient.getFileClient(srcFilePath);

      InputStream inputStream =  srcFileClient.openQueryInputStream("SELECT * FROM BlobStorage");

The above code works fine when I create the DataLakeServiceClient using SAS Token but when I authenticate using ClientId and ClientSecret the same code throws:

com.azure.storage.file.datalake.models.DataLakeStorageException: If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
Status code 403, "<?xml version="1.0" encoding="utf-8"?>
<Error><Code>AuthorizationPermissionMismatch</Code><Message>This request is not authorized to perform this operation using this permission.
RequestId:ca9dd909-801e-002f-5272-24a53c000000
Time:2021-03-29T08:09:14.4772718Z</Message></Error>"

Btw, the ClientId and ClientSecret do work because instead of openQueryInputStream if I do the following then it works fine:

DataLakeServiceClient dataLakeServiceClient = getDataLakeServiceClient();
     DataLakeFileSystemClient srcFileSystemClient = dataLakeServiceClient.getFileSystemClient(fileSystem)
     DataLakeFileClient srcFileClient =
             srcFileSystemClient.getFileClient(srcFilePath);

     ByteArrayOutputStream outputStream = new ByteArrayOutputStream();
     srcFileClient.read(outputStream);
     byte[] bytes = outputStream.toByteArray();
     InputStream inputStream = new ByteArrayInputStream(bytes);

Can you kindly let me know if I am doing something incorrectly with openQueryInputStream ?

Thanks,
Irfan

The text was updated successfully, but these errors were encountered:

gapra-msft · 2021-03-29T19:03:50Z

Hi @irbash

Thank you for posting this question. Using OAuth (ClientSecretCredential) should work. I will attempt to reproduce your issue as soon as I can and get back to you.

irbash · 2021-03-30T05:08:03Z

Hi @gapra-msft

Thanks... Hope you are able to reproduce it.

gapra-msft · 2021-03-30T15:43:11Z

Hi @irbash,

Thank you for following up. I was able to successfully run a query test using OAuth. It could be that the permissions you have given to the credential are incorrect.

Could you share what permissions you are providing the credential? Mine has the blob owner role and blob data contributor role I believe.

irbash · 2021-03-31T09:17:50Z

Hi @gapra-msft

Thank you very much for the reply.

Say we have a directory structure like: parent/subFolder1/subFolder2

The Service Principal that we use has RWX permissions on subFolder2. (This subFolder2 is suppose to be used by this service principal)
The Service Principal has only R-X permissions on the folders above. (on parent/subFolder1. So that it is able to navigate to subFolder2)
The Service Principal is not the owner.

Can you kindly let me know if the Service Principal should be owner and and should have permissions on parent folders as well ? Or What are the needed permissions for Service Principal to be able to use openQueryInputStream method ?

Thanks in advance,
Irfan

gapra-msft · 2021-04-02T19:29:01Z

Hi @irbash
To continue the investigation could you please repro this issue early next week and provide us an updated stack trace? I am particularly interested in the RequestId information in the error trace. Unfortunately the log for the request id in your original description has rolled over.

Once we have that we can look into why the request failed.

irbash · 2021-04-06T08:10:57Z

Hi @gapra-msft

Thank you very much for looking into this.

Please find the stack trace below:

com.azure.storage.file.datalake.models.DataLakeStorageException: If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
Status code 403, "<?xml version="1.0" encoding="utf-8"?>
<Error><Code>AuthorizationPermissionMismatch</Code><Message>This request is not authorized to perform this operation using this permission.
RequestId:f25f4fac-b01e-000b-24bc-2a539c000000
Time:2021-04-06T08:09:34.6652909Z</Message></Error>"

	at com.azure.storage.file.datalake.implementation.util.DataLakeImplUtils.transformBlobStorageException(DataLakeImplUtils.java:30)
	at reactor.core.publisher.Mono.lambda$onErrorMap$30(Mono.java:3325)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onError(FluxOnErrorResume.java:88)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onError(FluxMapFuseable.java:134)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onError(FluxMapFuseable.java:134)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onError(MonoFlatMap.java:165)
	at reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onError(FluxContextStart.java:110)
	at reactor.core.publisher.FluxDoOnEach$DoOnEachSubscriber.onError(FluxDoOnEach.java:181)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onError(Operators.java:2021)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onError(Operators.java:2021)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:135)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1782)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:320)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onNext(MonoCacheTime.java:337)
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2344)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onSubscribe(MonoCacheTime.java:276)
	at reactor.core.publisher.FluxFlatMap.trySubscribeScalarMap(FluxFlatMap.java:191)
	at reactor.core.publisher.MonoFlatMap.subscribeOrReturn(MonoFlatMap.java:53)
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
	at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52)
	at reactor.core.publisher.MonoCacheTime.subscribeOrReturn(MonoCacheTime.java:132)
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150)
	at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:123)
	at reactor.core.publisher.FluxHandle$HandleSubscriber.onNext(FluxHandle.java:112)
	at reactor.core.publisher.FluxMap$MapConditionalSubscriber.onNext(FluxMap.java:213)
	at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:123)
	at reactor.core.publisher.FluxHandleFuseable$HandleFuseableSubscriber.onNext(FluxHandleFuseable.java:178)
	at reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:96)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1782)
	at reactor.core.publisher.MonoCollectList$MonoCollectListSubscriber.onComplete(MonoCollectList.java:121)
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:252)
	at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)
	at reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:383)
	at reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:373)
	at reactor.netty.channel.ChannelOperations.terminate(ChannelOperations.java:429)
	at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:655)
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:96)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
	at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1533)
	at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1294)
	at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1331)
	at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)
	at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:834)
	Suppressed: java.lang.Exception: #block terminated with an error
		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99)
		at reactor.core.publisher.Mono.block(Mono.java:1685)
		at com.azure.storage.file.datalake.DataLakeFileClient.openQueryInputStreamWithResponse(DataLakeFileClient.java:668)
		at com.azure.storage.file.datalake.DataLakeFileClient.openQueryInputStream(DataLakeFileClient.java:647)
		at com.m.d.service.utils.impl.AdlsUtilsGen2.getReadStream(AdlsUtilsGen2.java:224)
		at com.m.d.service.utils.adls.it.AdlsUtilsGen2ITest.testCopyToAdls(AdlsUtilsGen2ITest.java:300)
		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
		at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
		at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
		at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
		at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
		at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
		at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
		at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
		at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
		at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
		at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
		at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
		at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
		at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
		at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33)
		at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:230)
		at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:58)

gapra-msft · 2021-04-07T23:36:12Z

Hi @irbash Thanks for providing the updated request id. I am following up with my team to further investigate the issue and I will let you know if I need any further info or if I have any updates to share.

gapra-msft · 2021-04-12T19:38:30Z

Hi @irbash
My team shared this piece of documentation with me that can help you understand why the request could fail.
https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-access-control-model#how-permissions-are-evaluated

Could you please take a look at this and see if you have permissions set up correctly? If this doesnt help, could you please share a latest request id once again? Apologies, the logs roll over fairly frequently.

irbash · 2021-04-13T12:02:54Z

Hi @gapra-msft

Thank you very much. I will check the permissions and get back to you.

In the mean time, how am I able to read the file using the below code ?

ByteArrayOutputStream outputStream = new ByteArrayOutputStream();
     srcFileClient.read(outputStream);

And also, I found this page and I used your answer and it works with BlobClient as well.

So, it just doesn't work with DataLakeFileClient.openQueryInputStream and works with DataLakeFileClient.read and BlobClient.openInputStream()

I guess the permissions are fine, but I will check and give you more details.

irbash · 2021-04-16T04:39:03Z

Hi @gapra-msft

I checked with our IT team and shared the above link with them. After verifying they came back saying the permissions are set correctly and according to that link.

Thanks,
Irfan

gapra-msft · 2021-04-16T15:50:19Z

Hi @irbash

Thanks for checking, could you repro the issue once more early next week so I can get folks from the service to take a look at the logs? They may be able to help understand what's going wrong here. This time I can also copy over the log information once I get the request id from you in case it rolls over.

Sorry for any inconvenience.

irbash · 2021-04-20T07:16:55Z

Hi @gapra-msft

Thank you very much for taking time and looking into this issue. I reproduced the issue and please find the stack trace below.


com.azure.storage.file.datalake.models.DataLakeStorageException: If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
Status code 403, "<?xml version="1.0" encoding="utf-8"?>
<Error><Code>AuthorizationPermissionMismatch</Code><Message>This request is not authorized to perform this operation using this permission.
RequestId:eeeaff86-601e-0045-1fb4-357d14000000
Time:2021-04-20T07:13:33.3481035Z</Message></Error>"

	at com.azure.storage.file.datalake.implementation.util.DataLakeImplUtils.transformBlobStorageException(DataLakeImplUtils.java:30)
	at reactor.core.publisher.Mono.lambda$onErrorMap$30(Mono.java:3325)
	at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onError(FluxOnErrorResume.java:88)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onError(FluxMapFuseable.java:134)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onError(FluxMapFuseable.java:134)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onError(MonoFlatMap.java:165)
	at reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onError(FluxContextStart.java:110)
	at reactor.core.publisher.FluxDoOnEach$DoOnEachSubscriber.onError(FluxDoOnEach.java:181)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onError(Operators.java:2021)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondError(MonoFlatMap.java:185)
	at reactor.core.publisher.MonoFlatMap$FlatMapInner.onError(MonoFlatMap.java:251)
	at reactor.core.publisher.Operators$MultiSubscriptionSubscriber.onError(Operators.java:2021)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:135)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1782)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:320)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onNext(MonoCacheTime.java:337)
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2344)
	at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.onSubscribe(MonoCacheTime.java:276)
	at reactor.core.publisher.FluxFlatMap.trySubscribeScalarMap(FluxFlatMap.java:191)
	at reactor.core.publisher.MonoFlatMap.subscribeOrReturn(MonoFlatMap.java:53)
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
	at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52)
	at reactor.core.publisher.MonoCacheTime.subscribeOrReturn(MonoCacheTime.java:132)
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:57)
	at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150)
	at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:123)
	at reactor.core.publisher.FluxHandle$HandleSubscriber.onNext(FluxHandle.java:112)
	at reactor.core.publisher.FluxMap$MapConditionalSubscriber.onNext(FluxMap.java:213)
	at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:123)
	at reactor.core.publisher.FluxHandleFuseable$HandleFuseableSubscriber.onNext(FluxHandleFuseable.java:178)
	at reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:96)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1782)
	at reactor.core.publisher.MonoCollectList$MonoCollectListSubscriber.onComplete(MonoCollectList.java:121)
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:252)
	at reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)
	at reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:383)
	at reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:373)
	at reactor.netty.channel.ChannelOperations.terminate(ChannelOperations.java:429)
	at reactor.netty.http.client.HttpClientOperations.onInboundNext(HttpClientOperations.java:655)
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:96)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
	at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1533)
	at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1294)
	at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1331)
	at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)
	at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:834)
	Suppressed: java.lang.Exception: #block terminated with an error
		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99)
		at reactor.core.publisher.Mono.block(Mono.java:1685)
		at com.azure.storage.file.datalake.DataLakeFileClient.openQueryInputStreamWithResponse(DataLakeFileClient.java:668)
		at com.azure.storage.file.datalake.DataLakeFileClient.openQueryInputStream(DataLakeFileClient.java:647)
		at com.xxx.service.utils.impl.gen2.AdlsUtilsGen2.getReadStream(AdlsUtilsGen2.java:250)
		at com.xxx.service.utils.impl.gen2.AdlsUtilsGen2.copyAdlsToAdls(AdlsUtilsGen2.java:532)
		at com.xxx.service.utils.adls.it.AdlsUtilsGen2ITest.testCopyAdlsToAdls(AdlsUtilsGen2ITest.java:336)
		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
		at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
		at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
		at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
		at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
		at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
		at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
		at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
		at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
		at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
		at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
		at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
		at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
		at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
		at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33)
		at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:230)
		at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:58)

gapra-msft · 2021-04-21T21:47:13Z

Hi @irbash

I've followed up with my team and it looks like to temporarily unblock you, you will have to give RWX permission to the file to query it's contents.

irbash · 2021-04-26T07:57:25Z

Hi @gapra-msft

Thanks, i will see if we dont already have RWX permissions on the file. IF not i will try to do that.

Regards,
Irfan

irbash · 2021-05-05T07:17:20Z

Hi @gapra-msft

I verified it, the file had 660. I changed the permissions to 760 and it worked.

Does it need to have Execute permissions to even read the file ?

Thanks,
Irfan

gapra-msft · 2021-05-06T22:38:41Z

Hi @irbash

I will follow up with the service team on why it requires all 3 permissions and get back to you. Since you are able to successfully use the API, I will close this issue for now.

Merge Microsoft.app 2022 06 01 preview to main (Azure#20787) * Adds base for updating Microsoft.App from version stable/2022-03-01 to version 2022-05-01 * Updates readme * Updates API version in new specs and examples * Add app diag to 2022-05-01 (Azure#18678) * Add container apps diagnostics * Fix validation errors * Move Microsoft.App diag APIs to 2022-05-01 * Fix validation errors * Fix validation errors * Fix validation errors 3 * Change operationIds Co-authored-by: Michimune Kohno <[email protected]> * Fix definition for customhostnameesult (Azure#19014) * fix * update * more fix * Cherry pick for the parameter name fixes for the 2022-03-01 and making the same fixes in 2022-05-01 (Azure#19048) * Correct Probe enums (Azure#18839) * fix probe enums * Fix revision mode enum * Fix patch example * Fix the casing of enums in the latest api version * Change the parameter names to unblock Terraform release (Azure#19005) * contianerapps: fixing swagger inconsistencies in 2022-01-01-preview * containerapps: fixing inconsistencies in the 2022-03-01 swagger * containerapps: updating the examples for 2022-01-01-preview * containerapps: updating the examples to account for the updated parameter names * containerapps: fixing linting * fix probe enums * Fix revision mode enum * Fix the policheck error * Revert "containerapps: fixing linting" This reverts commit 3c4872f4a43fbe1a285830461f48d8c0a5ffeee8. * Revert "containerapps: updating the examples for 2022-01-01-preview" This reverts commit 9b81fbd65652d558c0296d72a63ca1a7c4850e3c. * Revert "contianerapps: fixing swagger inconsistencies in 2022-01-01-preview" This reverts commit 553fc551b3239598157238ed6246085748421b87. * Undo changes to 2022-01-01-preview * Fix one issue * fix remaining inconsistency * fix authConfig and sourceControl names Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Mike Vu <[email protected]> * Change param names * Fix examples * Fix CI errors Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> * Fix description in all API versions (Azure#19313) * Fix description for ManagedEnvironment.Internal property (Azure#19307) * Fix descriptions in all api versions * Add traffic info to revisions api (Azure#19054) * Add traffic info to a revision api * Add deprecated prop * Prettier fixes * 1pdate based on new proposal * Rename * Change names * minor fix * Add httpReadBufferSize to dapr config in Microsoft.App-2022-05-01 (Azure#19360) * Add httpReadBufferSize to dapr config * remove nullable * Adds base for updating Microsoft.App from version stable/2022-05-01 to version 2022-06-01-preview * Updates readme * Updates API version in new specs and examples * Add new resources for 2022-06-01-preview (Azure#19494) * update * update * update * fix * update * update * update * update * fix * update * update * Enable Dapr AI Connection string for Microsoft.App connected environment (Azure#19974) * Enable Dapr AI Connection string for Microsoft.App connected environment * Fix dapr ai connection string * remove read * remove read permission of dapr ai connection string and instrument key for managed environment * fixes for comments * update (Azure#20013) * Fixdescriptions on microsoft.app 2022 06 01 preview (Azure#20133) * Fix casing for detector properties * Fix descriptions * Fix descriptions and detectorProperties in 2022-06-01-preview * Added `secretsStoreComponent` in 2022-06-01 spec (Azure#20044) * Added `secretsStoreComponent` in 2022-06-01 spec Signed-off-by: ItalyPaleAle <[email protected]> * Fixed typos and added example of name/key Signed-off-by: ItalyPaleAle <[email protected]> * Add custom domain configuration for managed environment (Azure#20149) Co-authored-by: Mengjun Qin <[email protected]> * Add additional Dapr options (2022-06-01-preview) (Azure#19886) * Add additional Dapr options * Update examples for 2022-06-01-preview * force ci * force ci * force ci * adding ip-restriction feat (Azure#19841) * adding ip-restriction feat * remove from stable, add to preview * fix lintDiff error * fix modelvalidation error * fix formatting changes * rename names, add note to all allow or all deny * fix spell check error * update name and examples * rename `ipAddress` to `ipAddressRange` * making small change to re-run build pipeline * trigger GitHub actions * resolve comments Co-authored-by: Taher Darolywala <[email protected]> * Remove Traffic Labels from revisions because they haven't been impelemented (Azure#20261) * Revert "Add traffic info to revisions api (Azure#19054)" This reverts commit 056cc51226bf2eef3d3a7e7bdca875a4a571026b. * Remove traffic labels from revisions * Add property for tcp apps (Azure#20193) * Add property for tcp apps * Add scale * Fix * Fix * Add Init Containers to common definitions (Azure#19855) * add init containers to common definitions * move changes to 06-01 preview * remove repeated container definition * fix allof syntax * fix anonymous container definition * fix lintdiff errors * fix container allof syntax * add more init examples * split baseContainer definition * remove description Co-authored-by: p-bouchon <[email protected]> * Update container app provisioningstate (Azure#20411) * update * update * add property: maxInactiveRevisions (Azure#20334) * add property: maxInactiveRevisions * update * update * Add premium sku related properties for managed environment (Azure#19770) * Add premium sku related properties for managed environment * Move sku to base property * Add workloadProfileType * Examples for managed environment * Add container app example * Fix workloadProfiles * Add custom word * Fix WorkloadProfileType references * prettier fixes * Fix workload profile * Fix typo * remove readonly property for workload profile * Add object type * nit: Fix description location * Fix XmsIdentifierValidation * Remove spaces from enum values * Remove unwanted change * Add aka ms url * Update examples for workload profile type * Fix rebase issue * Fix json * Update description and move location * Remove provisioning state for node pool * sku capacity explanation * Remove capacity attribute * Remove capacity attribute from required * Mark sku property as required * Add x-ms-identifiers * Rename mimum and maximum * Rename skutype to skuName * Make sku property as optional * Make workload profile type as string * fix go SDK automation config Co-authored-by: Chenjie Shi <[email protected]> * Fix source control status code in 2022-06-01-preview. (Azure#20429) * Remove 20220501 because we will not support it in server side (Azure#20427) * remove * update * Added support for user defined routing (Azure#20464) * Added support for user defined routing * Added examples * fixed JSON syntax * syntax fix * fixed vnetenvironment syntax * fixed camel case * case fix * enum syntax * fixed comma cases ManagedEnvironmentOutBoundType * fixing casing * Some more APIs (Azure#20448) * new APIs to 06-01 * test fix * more fixes * add last active time for revision (Azure#20658) * Add custom domain for connected env (Azure#20731) * add custom domain * fhcekout * billingMeters - GET endpoint (Azure#20485) * Swagger documentation for /locations/{location}/billingMeters - GET endpoint * Add example, fix validation errors * Fix ARM validation errors, code review comments * Fix response validation * add proxy resource properties * Response formatting * add default error response * ARM Review feedback + small naming change for a property * Change GB to GiB * Fix 2022-06-01-preview branch merge conflicts (Azure#20773) * Reset * more fixes * More fixes * another conflict fix * Fix old preview version * fix 2022-03-01 * supress lint Signed-off-by: ItalyPaleAle <[email protected]> Co-authored-by: Ruslan Yakushev <[email protected]> Co-authored-by: michimune <[email protected]> Co-authored-by: Michimune Kohno <[email protected]> Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Ahmed ElSayed <[email protected]> Co-authored-by: LaylaLiu-gmail <[email protected]> Co-authored-by: Alessandro (Ale) Segala <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Taher Daroly <[email protected]> Co-authored-by: Taher Darolywala <[email protected]> Co-authored-by: zhenqxuMSFT <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: njucz <[email protected]> Co-authored-by: JJ <[email protected]> Co-authored-by: Chenjie Shi <[email protected]> Co-authored-by: yalixiang <[email protected]> Co-authored-by: Mahmoud Desokey <[email protected]> Co-authored-by: Xingjian Wang <[email protected]> Co-authored-by: trajkobal <[email protected]>

Rename Post Action and Add Secrets Tags (Azure#20775) * Adds base for updating Microsoft.App from version stable/2022-03-01 to version 2022-05-01 * Updates readme * Updates API version in new specs and examples * Add app diag to 2022-05-01 (Azure#18678) * Add container apps diagnostics * Fix validation errors * Move Microsoft.App diag APIs to 2022-05-01 * Fix validation errors * Fix validation errors * Fix validation errors 3 * Change operationIds Co-authored-by: Michimune Kohno <[email protected]> * Fix definition for customhostnameesult (Azure#19014) * fix * update * more fix * Cherry pick for the parameter name fixes for the 2022-03-01 and making the same fixes in 2022-05-01 (Azure#19048) * Correct Probe enums (Azure#18839) * fix probe enums * Fix revision mode enum * Fix patch example * Fix the casing of enums in the latest api version * Change the parameter names to unblock Terraform release (Azure#19005) * contianerapps: fixing swagger inconsistencies in 2022-01-01-preview * containerapps: fixing inconsistencies in the 2022-03-01 swagger * containerapps: updating the examples for 2022-01-01-preview * containerapps: updating the examples to account for the updated parameter names * containerapps: fixing linting * fix probe enums * Fix revision mode enum * Fix the policheck error * Revert "containerapps: fixing linting" This reverts commit 3c4872f4a43fbe1a285830461f48d8c0a5ffeee8. * Revert "containerapps: updating the examples for 2022-01-01-preview" This reverts commit 9b81fbd65652d558c0296d72a63ca1a7c4850e3c. * Revert "contianerapps: fixing swagger inconsistencies in 2022-01-01-preview" This reverts commit 553fc551b3239598157238ed6246085748421b87. * Undo changes to 2022-01-01-preview * Fix one issue * fix remaining inconsistency * fix authConfig and sourceControl names Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Mike Vu <[email protected]> * Change param names * Fix examples * Fix CI errors Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> * Fix description in all API versions (Azure#19313) * Fix description for ManagedEnvironment.Internal property (Azure#19307) * Fix descriptions in all api versions * Add traffic info to revisions api (Azure#19054) * Add traffic info to a revision api * Add deprecated prop * Prettier fixes * 1pdate based on new proposal * Rename * Change names * minor fix * Add httpReadBufferSize to dapr config in Microsoft.App-2022-05-01 (Azure#19360) * Add httpReadBufferSize to dapr config * remove nullable * Adds base for updating Microsoft.App from version stable/2022-05-01 to version 2022-06-01-preview * Updates readme * Updates API version in new specs and examples * Add new resources for 2022-06-01-preview (Azure#19494) * update * update * update * fix * update * update * update * update * fix * update * update * Enable Dapr AI Connection string for Microsoft.App connected environment (Azure#19974) * Enable Dapr AI Connection string for Microsoft.App connected environment * Fix dapr ai connection string * remove read * remove read permission of dapr ai connection string and instrument key for managed environment * fixes for comments * update (Azure#20013) * Fixdescriptions on microsoft.app 2022 06 01 preview (Azure#20133) * Fix casing for detector properties * Fix descriptions * Fix descriptions and detectorProperties in 2022-06-01-preview * Added `secretsStoreComponent` in 2022-06-01 spec (Azure#20044) * Added `secretsStoreComponent` in 2022-06-01 spec Signed-off-by: ItalyPaleAle <[email protected]> * Fixed typos and added example of name/key Signed-off-by: ItalyPaleAle <[email protected]> * Add custom domain configuration for managed environment (Azure#20149) Co-authored-by: Mengjun Qin <[email protected]> * Add additional Dapr options (2022-06-01-preview) (Azure#19886) * Add additional Dapr options * Update examples for 2022-06-01-preview * force ci * force ci * force ci * adding ip-restriction feat (Azure#19841) * adding ip-restriction feat * remove from stable, add to preview * fix lintDiff error * fix modelvalidation error * fix formatting changes * rename names, add note to all allow or all deny * fix spell check error * update name and examples * rename `ipAddress` to `ipAddressRange` * making small change to re-run build pipeline * trigger GitHub actions * resolve comments Co-authored-by: Taher Darolywala <[email protected]> * Remove Traffic Labels from revisions because they haven't been impelemented (Azure#20261) * Revert "Add traffic info to revisions api (Azure#19054)" This reverts commit 056cc51226bf2eef3d3a7e7bdca875a4a571026b. * Remove traffic labels from revisions * Add property for tcp apps (Azure#20193) * Add property for tcp apps * Add scale * Fix * Fix * Add Init Containers to common definitions (Azure#19855) * add init containers to common definitions * move changes to 06-01 preview * remove repeated container definition * fix allof syntax * fix anonymous container definition * fix lintdiff errors * fix container allof syntax * add more init examples * split baseContainer definition * remove description Co-authored-by: p-bouchon <[email protected]> * Update container app provisioningstate (Azure#20411) * update * update * add property: maxInactiveRevisions (Azure#20334) * add property: maxInactiveRevisions * update * update * Add premium sku related properties for managed environment (Azure#19770) * Add premium sku related properties for managed environment * Move sku to base property * Add workloadProfileType * Examples for managed environment * Add container app example * Fix workloadProfiles * Add custom word * Fix WorkloadProfileType references * prettier fixes * Fix workload profile * Fix typo * remove readonly property for workload profile * Add object type * nit: Fix description location * Fix XmsIdentifierValidation * Remove spaces from enum values * Remove unwanted change * Add aka ms url * Update examples for workload profile type * Fix rebase issue * Fix json * Update description and move location * Remove provisioning state for node pool * sku capacity explanation * Remove capacity attribute * Remove capacity attribute from required * Mark sku property as required * Add x-ms-identifiers * Rename mimum and maximum * Rename skutype to skuName * Make sku property as optional * Make workload profile type as string * fix go SDK automation config Co-authored-by: Chenjie Shi <[email protected]> * Fix source control status code in 2022-06-01-preview. (Azure#20429) * Remove 20220501 because we will not support it in server side (Azure#20427) * remove * update * Added support for user defined routing (Azure#20464) * Added support for user defined routing * Added examples * fixed JSON syntax * syntax fix * fixed vnetenvironment syntax * fixed camel case * case fix * enum syntax * fixed comma cases ManagedEnvironmentOutBoundType * fixing casing * Some more APIs (Azure#20448) * new APIs to 06-01 * test fix * more fixes * add last active time for revision (Azure#20658) * Add custom domain for connected env (Azure#20731) * add custom domain * fhcekout * billingMeters - GET endpoint (Azure#20485) * Swagger documentation for /locations/{location}/billingMeters - GET endpoint * Add example, fix validation errors * Fix ARM validation errors, code review comments * Fix response validation * add proxy resource properties * Response formatting * add default error response * ARM Review feedback + small naming change for a property * Change GB to GiB * Rename Action * secrets tag * missed fix Signed-off-by: ItalyPaleAle <[email protected]> Co-authored-by: Ruslan Yakushev <[email protected]> Co-authored-by: michimune <[email protected]> Co-authored-by: Michimune Kohno <[email protected]> Co-authored-by: Zunli Hu <[email protected]> Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Ahmed ElSayed <[email protected]> Co-authored-by: LaylaLiu-gmail <[email protected]> Co-authored-by: Alessandro (Ale) Segala <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Taher Daroly <[email protected]> Co-authored-by: Taher Darolywala <[email protected]> Co-authored-by: zhenqxuMSFT <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: njucz <[email protected]> Co-authored-by: JJ <[email protected]> Co-authored-by: Chenjie Shi <[email protected]> Co-authored-by: yalixiang <[email protected]> Co-authored-by: Mahmoud Desokey <[email protected]> Co-authored-by: trajkobal <[email protected]>

Availableworkloadprofiles - GET endpoint (Azure#20650) * Adds base for updating Microsoft.App from version stable/2022-03-01 to version 2022-05-01 * Updates readme * Updates API version in new specs and examples * Add app diag to 2022-05-01 (Azure#18678) * Add container apps diagnostics * Fix validation errors * Move Microsoft.App diag APIs to 2022-05-01 * Fix validation errors * Fix validation errors * Fix validation errors 3 * Change operationIds Co-authored-by: Michimune Kohno <[email protected]> * Fix definition for customhostnameesult (Azure#19014) * fix * update * more fix * Cherry pick for the parameter name fixes for the 2022-03-01 and making the same fixes in 2022-05-01 (Azure#19048) * Correct Probe enums (Azure#18839) * fix probe enums * Fix revision mode enum * Fix patch example * Fix the casing of enums in the latest api version * Change the parameter names to unblock Terraform release (Azure#19005) * contianerapps: fixing swagger inconsistencies in 2022-01-01-preview * containerapps: fixing inconsistencies in the 2022-03-01 swagger * containerapps: updating the examples for 2022-01-01-preview * containerapps: updating the examples to account for the updated parameter names * containerapps: fixing linting * fix probe enums * Fix revision mode enum * Fix the policheck error * Revert "containerapps: fixing linting" This reverts commit 3c4872f4a43fbe1a285830461f48d8c0a5ffeee8. * Revert "containerapps: updating the examples for 2022-01-01-preview" This reverts commit 9b81fbd65652d558c0296d72a63ca1a7c4850e3c. * Revert "contianerapps: fixing swagger inconsistencies in 2022-01-01-preview" This reverts commit 553fc551b3239598157238ed6246085748421b87. * Undo changes to 2022-01-01-preview * Fix one issue * fix remaining inconsistency * fix authConfig and sourceControl names Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Mike Vu <[email protected]> * Change param names * Fix examples * Fix CI errors Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> * Fix description in all API versions (Azure#19313) * Fix description for ManagedEnvironment.Internal property (Azure#19307) * Fix descriptions in all api versions * Add traffic info to revisions api (Azure#19054) * Add traffic info to a revision api * Add deprecated prop * Prettier fixes * 1pdate based on new proposal * Rename * Change names * minor fix * Add httpReadBufferSize to dapr config in Microsoft.App-2022-05-01 (Azure#19360) * Add httpReadBufferSize to dapr config * remove nullable * Adds base for updating Microsoft.App from version stable/2022-05-01 to version 2022-06-01-preview * Updates readme * Updates API version in new specs and examples * Add new resources for 2022-06-01-preview (Azure#19494) * update * update * update * fix * update * update * update * update * fix * update * update * Enable Dapr AI Connection string for Microsoft.App connected environment (Azure#19974) * Enable Dapr AI Connection string for Microsoft.App connected environment * Fix dapr ai connection string * remove read * remove read permission of dapr ai connection string and instrument key for managed environment * fixes for comments * update (Azure#20013) * Fixdescriptions on microsoft.app 2022 06 01 preview (Azure#20133) * Fix casing for detector properties * Fix descriptions * Fix descriptions and detectorProperties in 2022-06-01-preview * Added `secretsStoreComponent` in 2022-06-01 spec (Azure#20044) * Added `secretsStoreComponent` in 2022-06-01 spec Signed-off-by: ItalyPaleAle <[email protected]> * Fixed typos and added example of name/key Signed-off-by: ItalyPaleAle <[email protected]> * Add custom domain configuration for managed environment (Azure#20149) Co-authored-by: Mengjun Qin <[email protected]> * Add additional Dapr options (2022-06-01-preview) (Azure#19886) * Add additional Dapr options * Update examples for 2022-06-01-preview * force ci * force ci * force ci * adding ip-restriction feat (Azure#19841) * adding ip-restriction feat * remove from stable, add to preview * fix lintDiff error * fix modelvalidation error * fix formatting changes * rename names, add note to all allow or all deny * fix spell check error * update name and examples * rename `ipAddress` to `ipAddressRange` * making small change to re-run build pipeline * trigger GitHub actions * resolve comments Co-authored-by: Taher Darolywala <[email protected]> * Remove Traffic Labels from revisions because they haven't been impelemented (Azure#20261) * Revert "Add traffic info to revisions api (Azure#19054)" This reverts commit 056cc51226bf2eef3d3a7e7bdca875a4a571026b. * Remove traffic labels from revisions * Add property for tcp apps (Azure#20193) * Add property for tcp apps * Add scale * Fix * Fix * Add Init Containers to common definitions (Azure#19855) * add init containers to common definitions * move changes to 06-01 preview * remove repeated container definition * fix allof syntax * fix anonymous container definition * fix lintdiff errors * fix container allof syntax * add more init examples * split baseContainer definition * remove description Co-authored-by: p-bouchon <[email protected]> * Update container app provisioningstate (Azure#20411) * update * update * add property: maxInactiveRevisions (Azure#20334) * add property: maxInactiveRevisions * update * update * Add premium sku related properties for managed environment (Azure#19770) * Add premium sku related properties for managed environment * Move sku to base property * Add workloadProfileType * Examples for managed environment * Add container app example * Fix workloadProfiles * Add custom word * Fix WorkloadProfileType references * prettier fixes * Fix workload profile * Fix typo * remove readonly property for workload profile * Add object type * nit: Fix description location * Fix XmsIdentifierValidation * Remove spaces from enum values * Remove unwanted change * Add aka ms url * Update examples for workload profile type * Fix rebase issue * Fix json * Update description and move location * Remove provisioning state for node pool * sku capacity explanation * Remove capacity attribute * Remove capacity attribute from required * Mark sku property as required * Add x-ms-identifiers * Rename mimum and maximum * Rename skutype to skuName * Make sku property as optional * Make workload profile type as string * fix go SDK automation config Co-authored-by: Chenjie Shi <[email protected]> * Fix source control status code in 2022-06-01-preview. (Azure#20429) * Swagger documentation for /locations/{location}/billingMeters - GET endpoint * Add example, fix validation errors * Fix ARM validation errors, code review comments * Fix response validation * Remove 20220501 because we will not support it in server side (Azure#20427) * remove * update * add proxy resource properties * Response formatting * Added support for user defined routing (Azure#20464) * Added support for user defined routing * Added examples * fixed JSON syntax * syntax fix * fixed vnetenvironment syntax * fixed camel case * case fix * enum syntax * fixed comma cases ManagedEnvironmentOutBoundType * fixing casing * add default error response * Add available workprofiles -GET endpoint * Remove duplicate schema name WorkloadProfile * Change memoryGiB to memoryGB as suggested in code review * Add x-ms-pageable - nextLink support to not introduce breaking changes in the future * rename to memory in GiB because our case is Gibibytes base 1024 * change friendlyName to displayName * Some more APIs (Azure#20448) * new APIs to 06-01 * test fix * more fixes * Add new property to the response object * add last active time for revision (Azure#20658) * Add custom domain for connected env (Azure#20731) * add custom domain * fhcekout * billingMeters - GET endpoint (Azure#20485) * Swagger documentation for /locations/{location}/billingMeters - GET endpoint * Add example, fix validation errors * Fix ARM validation errors, code review comments * Fix response validation * add proxy resource properties * Response formatting * add default error response * ARM Review feedback + small naming change for a property * Change GB to GiB * Change the boolean value for default to enum * change error response to v3/ErrorResponse * Fix 2022-06-01-preview branch merge conflicts (Azure#20773) * Reset * more fixes * More fixes * another conflict fix * Fix old preview version * fix 2022-03-01 Signed-off-by: ItalyPaleAle <[email protected]> Co-authored-by: Ruslan Yakushev <[email protected]> Co-authored-by: michimune <[email protected]> Co-authored-by: Michimune Kohno <[email protected]> Co-authored-by: Zunli Hu <[email protected]> Co-authored-by: Mike Vu <[email protected]> Co-authored-by: tombuildsstuff <[email protected]> Co-authored-by: Ahmed ElSayed <[email protected]> Co-authored-by: LaylaLiu-gmail <[email protected]> Co-authored-by: Alessandro (Ale) Segala <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Mengjun Qin <[email protected]> Co-authored-by: Taher Daroly <[email protected]> Co-authored-by: Taher Darolywala <[email protected]> Co-authored-by: zhenqxuMSFT <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: p-bouchon <[email protected]> Co-authored-by: njucz <[email protected]> Co-authored-by: JJ <[email protected]> Co-authored-by: Chenjie Shi <[email protected]> Co-authored-by: yalixiang <[email protected]> Co-authored-by: Mahmoud Desokey <[email protected]> Co-authored-by: Xingjian Wang <[email protected]>

joshfree added Client This issue points to a problem in the data-plane of the library. needs-author-feedback Workflow: More information is needed from author to address the issue. Storage Storage Service (Queues, Blobs, Files) labels Mar 30, 2021

ghost removed the needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. label Mar 30, 2021

joshfree assigned gapra-msft Mar 30, 2021

joshfree added this to the [2021] May milestone Mar 30, 2021

ghost added needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team and removed needs-author-feedback Workflow: More information is needed from author to address the issue. labels Mar 31, 2021

gapra-msft added the needs-author-feedback Workflow: More information is needed from author to address the issue. label Apr 22, 2021

ghost removed the needs-author-feedback Workflow: More information is needed from author to address the issue. label Apr 26, 2021

gapra-msft closed this as completed May 6, 2021

github-actions bot locked and limited conversation to collaborators Apr 12, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DataLakeFileClient openQueryInputStream returns 403 #20193

DataLakeFileClient openQueryInputStream returns 403 #20193

irbash commented Mar 29, 2021

gapra-msft commented Mar 29, 2021

irbash commented Mar 30, 2021

gapra-msft commented Mar 30, 2021 •

edited

Loading

irbash commented Mar 31, 2021

gapra-msft commented Apr 2, 2021

irbash commented Apr 6, 2021 •

edited

Loading

gapra-msft commented Apr 7, 2021

gapra-msft commented Apr 12, 2021

irbash commented Apr 13, 2021

irbash commented Apr 16, 2021

gapra-msft commented Apr 16, 2021

irbash commented Apr 20, 2021

gapra-msft commented Apr 21, 2021 •

edited

Loading

irbash commented Apr 26, 2021

irbash commented May 5, 2021

gapra-msft commented May 6, 2021

DataLakeFileClient openQueryInputStream returns 403 #20193

DataLakeFileClient openQueryInputStream returns 403 #20193

Comments

irbash commented Mar 29, 2021

gapra-msft commented Mar 29, 2021

irbash commented Mar 30, 2021

gapra-msft commented Mar 30, 2021 • edited Loading

irbash commented Mar 31, 2021

gapra-msft commented Apr 2, 2021

irbash commented Apr 6, 2021 • edited Loading

gapra-msft commented Apr 7, 2021

gapra-msft commented Apr 12, 2021

irbash commented Apr 13, 2021

irbash commented Apr 16, 2021

gapra-msft commented Apr 16, 2021

irbash commented Apr 20, 2021

gapra-msft commented Apr 21, 2021 • edited Loading

irbash commented Apr 26, 2021

irbash commented May 5, 2021

gapra-msft commented May 6, 2021

gapra-msft commented Mar 30, 2021 •

edited

Loading

irbash commented Apr 6, 2021 •

edited

Loading

gapra-msft commented Apr 21, 2021 •

edited

Loading