[Deployment] Week of 11/29/2018

[dtivel]

Deployment 2018-11-29

Planned production date: 2018-12-03

Repo	Service	Commit	Build	INT	PROD	Prod Asia
NuGet.Services.Metadata	Catalog2Dnx	NuGet/NuGet.Services.Metadata@37b26ad	#2239802
NuGet.Services.Metadata	Catalog2Registration	NuGet/NuGet.Services.Metadata@37b26ad	#2239802
NuGet.Jobs	Orchestrator	NuGet/NuGet.Jobs@47326c5	#2243583			NA
NuGet.Jobs	CollectAzureCdnLogs	NuGet/NuGet.Jobs@47326c5	#2243582			NA

Includes:

Title	PR	Commit
Improve signing time of NuGet.Services.Metadata	NuGet/NuGet.Services.Metadata#399	NuGet/NuGet.Services.Metadata@6ef2a1a
V3: extract parallelized commit processing into common utility class	NuGet/NuGet.Services.Metadata#401	NuGet/NuGet.Services.Metadata@b87f57b
Copy NuGet.Protocol.Catalog from Samples repository	NuGet/NuGet.Services.Metadata#405	NuGet/NuGet.Services.Metadata@791f129
V3: simplify catalog commit processing parallelization	NuGet/NuGet.Services.Metadata#407	NuGet/NuGet.Services.Metadata@3688478
Test: move tests from NgTests project to CatalogTests project	NuGet/NuGet.Services.Metadata#409	NuGet/NuGet.Services.Metadata@903e08a
V3: fix potential NullReferenceException	NuGet/NuGet.Services.Metadata#408	NuGet/NuGet.Services.Metadata@9e08ae3
MonitoringProcessor: fix incomplete package delete identification	NuGet/NuGet.Services.Metadata#411	NuGet/NuGet.Services.Metadata@18d1d32
Catalog2Dnx: parallelize commit processing	NuGet/NuGet.Services.Metadata#412	NuGet/NuGet.Services.Metadata@ae0d22f
V3: fix missing initialization of IsDelete	NuGet/NuGet.Services.Metadata#413	NuGet/NuGet.Services.Metadata@49ed106
V3 Monitoring - Improve logging when queue message processing fails	NuGet/NuGet.Services.Metadata#410	NuGet/NuGet.Services.Metadata@a1a4bf4
Refactoring: moved FeedHelpers.GetCatalogPropertiesAsync	NuGet/NuGet.Services.Metadata#414	NuGet/NuGet.Services.Metadata@11d3d81
Monitoring: undo IsDelete change	NuGet/NuGet.Services.Metadata#421	NuGet/NuGet.Services.Metadata@bea889f
CollectAzureCdnLogs should properly handle files ending in .tmp	NuGet/NuGet.Jobs#673	NuGet/NuGet.Jobs@ced7785
Recognize "NuGet VS VSIX" as valid NuGet client	NuGet/NuGet.Jobs#681	NuGet/NuGet.Jobs@c1801e1
Convert CollectCdnLogs jobs to JsonConfig	NuGet/NuGet.Jobs#685	NuGet/NuGet.Jobs@497d470
Repository sign packages owned by users with "malformed" usernames	NuGet/NuGet.Jobs#686	NuGet/NuGet.Jobs@9008706
Add configuration argument	NuGet/NuGet.Jobs#689	NuGet/NuGet.Jobs@f85cafb
Remove legacy validation code (VCS-based)	NuGet/NuGet.Jobs#605	NuGet/NuGet.Jobs@8a3b27d

[agr]

Catalog2dnx is in INT, running E2E tests

[agr]

Deployed both to INT, E2E tests succeeded.

[agr]

Stats pipeline in INT seem to have died. Do not promote ColelctAzureCdnLogs job to PROD.

[scottbommarito]

ImportAzureCdnStatistics is failing, not CollectAzureCdnLogs:

The SELECT permission was denied on the object 'Dimension_Time', database 'nuget-int-statistics', schema 'dbo'.
--
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlConnection.OnError","level":0,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlInternalConnection.OnError","level":1,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning","level":2,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.TdsParser.TryRun","level":3,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlDataReader.TryConsumeMetaData","level":4,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlDataReader.get_MetaData","level":5,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlCommand.FinishExecuteReader","level":6,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlCommand.CompleteAsyncExecuteReader","level":7,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlCommand.InternalEndExecuteReader","level":8,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlCommand.EndExecuteReaderInternal","level":9,"line":0
"assembly":"System.Data, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Data.SqlClient.SqlCommand.EndExecuteReaderAsync","level":10,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic","level":11,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess","level":12,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification","level":13,"line":0
"assembly":"Stats.ImportAzureCdnStatistics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35","method":"Stats.ImportAzureCdnStatistics.Warehouse+<RetrieveTimeDimensions>d__29.MoveNext","level":14,"line":774,"fileName":"E:\\A\\_work\\53\\s\\src\\Stats.ImportAzureCdnStatistics\\Warehouse.cs"
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess","level":15,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification","level":16,"line":0
"assembly":"Stats.ImportAzureCdnStatistics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35","method":"Stats.ImportAzureCdnStatistics.Warehouse+<GetDimension>d__23`1.MoveNext","level":17,"line":587,"fileName":"E:\\A\\_work\\53\\s\\src\\Stats.ImportAzureCdnStatistics\\Warehouse.cs"
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess","level":18,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification","level":19,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd","level":20,"line":0
"assembly":"Stats.ImportAzureCdnStatistics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35","method":"Stats.ImportAzureCdnStatistics.Warehouse+<CreateAsync>d__15.MoveNext","level":21,"line":103,"fileName":"E:\\A\\_work\\53\\s\\src\\Stats.ImportAzureCdnStatistics\\Warehouse.cs"
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess","level":22,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification","level":23,"line":0
"assembly":"Stats.ImportAzureCdnStatistics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35","method":"Stats.ImportAzureCdnStatistics.LogFileProcessor+<ProcessPackageStatisticsInLogFileAsync>d__6.MoveNext","level":24,"line":110,"fileName":"E:\\A\\_work\\53\\s\\src\\Stats.ImportAzureCdnStatistics\\LogFileProcessor.cs"
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess","level":25,"line":0
"assembly":"mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089","method":"System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification","level":26,"line":0
"assembly":"Stats.ImportAzureCdnStatistics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35","method":"Stats.ImportAzureCdnStatistics.LogFileProcessor+<ProcessLogFileAsync>d__4.MoveNext","level":27,"line":54,"fileName":"E:\\A\\_work\\53\\s\\src\\Stats.ImportAzureCdnStatistics\\LogFileProcessor.cs"

[chenriksson]

@scottbommarito @agr - @xavierdecoster mentioned this to me, so I'm planning to investigate. If anyone already knows the cause, please keep me in the loop.

[chenriksson]

Permissions issues should be resolved on INT. I recommend we hold off on deploying the collect jobs until @xavierdecoster completes NuGet/NuGet.Jobs#690.