This repository has been archived by the owner on Jul 30, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 21
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Search] Generate secondary region's auxiliary data (#555)
Tweaks the `Search.GenerateAuxiliaryData` job to generate auxiliary data for each region, including secondary regions (like US South Central and South East Asia).
- Loading branch information
1 parent
8377acc
commit 9cb3e60
Showing
10 changed files
with
156 additions
and
12 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
16 changes: 16 additions & 0 deletions
16
src/Search.GenerateAuxiliaryData/Scripts/Search.GenerateAuxiliaryData.SouthEastAsia.cmd
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| @echo OFF | ||
|
|
||
| REM This script is the same as Search.GenerateAuxillaryData.cmd. However, this copy is required until "Jobs.ServiceNames" deployment config is consolidated. | ||
|
|
||
| cd bin | ||
|
|
||
| :Top | ||
| echo "Starting job - #{Jobs.SouthEastAsia.search.generateauxiliarydata.Title}" | ||
|
|
||
| title #{Jobs.SouthEastAsia.search.generateauxiliarydata.Title} | ||
|
|
||
| start /w search.generateauxiliarydata.exe -Configuration "#{Jobs.SouthEastAsia.search.generateauxiliarydata.Configuration}" -verbose true -Sleep #{Jobs.search.generateauxiliarydata.Sleep} -InstrumentationKey "#{Jobs.search.generateauxiliarydata.ApplicationInsightsInstrumentationKey}" | ||
|
|
||
| echo "Finished #{Jobs.SouthEastAsia.search.generateauxiliarydata.Title}" | ||
|
|
||
| goto Top |
16 changes: 16 additions & 0 deletions
16
src/Search.GenerateAuxiliaryData/Scripts/Search.GenerateAuxiliaryData.USSC.cmd
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| @echo OFF | ||
|
|
||
| REM This script is the same as Search.GenerateAuxillaryData.cmd. However, this copy is required until "Jobs.ServiceNames" deployment config is consolidated. | ||
|
|
||
| cd bin | ||
|
|
||
| :Top | ||
| echo "Starting job - #{Jobs.USSC.search.generateauxiliarydata.Title}" | ||
|
|
||
| title #{Jobs.USSC.search.generateauxiliarydata.Title} | ||
|
|
||
| start /w search.generateauxiliarydata.exe -Configuration "#{Jobs.USSC.search.generateauxiliarydata.Configuration}" -verbose true -Sleep #{Jobs.search.generateauxiliarydata.Sleep} -InstrumentationKey "#{Jobs.search.generateauxiliarydata.ApplicationInsightsInstrumentationKey}" | ||
|
|
||
| echo "Finished #{Jobs.USSC.search.generateauxiliarydata.Title}" | ||
|
|
||
| goto Top |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
22 changes: 22 additions & 0 deletions
22
src/Search.GenerateAuxiliaryData/Settings/dev-southeastasia.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| { | ||
| "Initialization": { | ||
| "AzureCdnCloudStorageAccount": "DefaultEndpointsProtocol=https;AccountName=nugetdevlegacy;AccountKey=$$Dev-NuGetDevLegacyStorage-Key$$", | ||
| "AzureCdnCloudStorageContainerName": "nuget-cdnstats", | ||
| "PrimaryDestination": "DefaultEndpointsProtocol=https;AccountName=nugetdevsea;AccountKey=$$Dev-NuGetDevSeaStorage-Key$$" | ||
| }, | ||
|
|
||
| "GalleryDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.GalleryDatabaseAddress};Initial Catalog=nuget-dev-0-v2gallery;Persist Security Info=False;Connect Timeout=30;Encrypt=True;TrustServerCertificate=False;Application Name=Search.GenerateAuxData.Asia;AadTenant=#{Deployment.Azure.ActiveDirectory.Tenant};AadClientId=#{Deployment.Azure.ActiveDirectory.GalleryDbReader.ClientId};AadCertificate=$$dev-gallerydb-reader$$" | ||
| }, | ||
|
|
||
| "StatisticsDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.StatisticsDatabaseAddress};Initial Catalog=nuget-dev-statistics;Persist Security Info=False;Connect Timeout=30;Encrypt=True;TrustServerCertificate=False;Application Name=Search.GenerateAuxData.Asia;AadTenant=#{Deployment.Azure.ActiveDirectory.Tenant};AadClientId=#{Deployment.Azure.ActiveDirectory.StatisticsDbReader.ClientId};AadCertificate=$$dev-statisticsdb-reader$$" | ||
| }, | ||
|
|
||
| "KeyVault_VaultName": "#{Deployment.Azure.KeyVault.VaultName}", | ||
| "KeyVault_ClientId": "#{Deployment.Azure.KeyVault.ClientId}", | ||
| "KeyVault_CertificateThumbprint": "#{Deployment.Azure.KeyVault.CertificateThumbprint}", | ||
| "KeyVault_ValidateCertificate": true, | ||
| "KeyVault_StoreName": "My", | ||
| "KeyVault_StoreLocation": "LocalMachine" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| { | ||
| "Initialization": { | ||
| "AzureCdnCloudStorageAccount": "DefaultEndpointsProtocol=https;AccountName=nugetdevlegacy;AccountKey=$$Dev-NuGetDevLegacyStorage-Key$$", | ||
| "AzureCdnCloudStorageContainerName": "nuget-cdnstats", | ||
| "PrimaryDestination": "DefaultEndpointsProtocol=https;AccountName=nugetdevussc;AccountKey=$$Dev-NuGetDevUsscStorage-Key$$" | ||
| }, | ||
|
|
||
| "GalleryDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.GalleryDatabaseAddress};Initial Catalog=nuget-dev-0-v2gallery;Persist Security Info=False;Connect Timeout=30;Encrypt=True;TrustServerCertificate=False;Application Name=Search.GenerateAuxData;AadTenant=#{Deployment.Azure.ActiveDirectory.Tenant};AadClientId=#{Deployment.Azure.ActiveDirectory.GalleryDbReader.ClientId};AadCertificate=$$dev-gallerydb-reader$$" | ||
| }, | ||
|
|
||
| "StatisticsDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.StatisticsDatabaseAddress};Initial Catalog=nuget-dev-statistics;Persist Security Info=False;Connect Timeout=30;Encrypt=True;TrustServerCertificate=False;Application Name=Search.GenerateAuxData;AadTenant=#{Deployment.Azure.ActiveDirectory.Tenant};AadClientId=#{Deployment.Azure.ActiveDirectory.StatisticsDbReader.ClientId};AadCertificate=$$dev-statisticsdb-reader$$" | ||
| }, | ||
|
|
||
| "KeyVault_VaultName": "#{Deployment.Azure.KeyVault.VaultName}", | ||
| "KeyVault_ClientId": "#{Deployment.Azure.KeyVault.ClientId}", | ||
| "KeyVault_CertificateThumbprint": "#{Deployment.Azure.KeyVault.CertificateThumbprint}", | ||
| "KeyVault_ValidateCertificate": true, | ||
| "KeyVault_StoreName": "My", | ||
| "KeyVault_StoreLocation": "LocalMachine" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| { | ||
| "Initialization": { | ||
| "AzureCdnCloudStorageAccount": "DefaultEndpointsProtocol=https;AccountName=nugetint0;AccountKey=$$Int-NuGetInt0Storage-Key$$", | ||
| "AzureCdnCloudStorageContainerName": "nuget-cdnstats", | ||
| "PrimaryDestination": "DefaultEndpointsProtocol=https;AccountName=nugetintussc;AccountKey=$$Int-NuGetIntUsscStorage-Key$$" | ||
| }, | ||
|
|
||
| "GalleryDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.GalleryDatabaseAddress};Initial Catalog=nuget-int-0-v2gallery;User ID=$$Int-GalleryDBReadOnly-UserName$$;Password=$$Int-GalleryDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "StatisticsDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.StatisticsDatabaseAddress};Initial Catalog=nuget-int-statistics;User ID=$$Int-StatisticsDBReadOnly-UserName$$;Password=$$Int-StatisticsDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "KeyVault_VaultName": "#{Deployment.Azure.KeyVault.VaultName}", | ||
| "KeyVault_ClientId": "#{Deployment.Azure.KeyVault.ClientId}", | ||
| "KeyVault_CertificateThumbprint": "#{Deployment.Azure.KeyVault.CertificateThumbprint}", | ||
| "KeyVault_ValidateCertificate": true, | ||
| "KeyVault_StoreName": "My", | ||
| "KeyVault_StoreLocation": "LocalMachine" | ||
| } |
22 changes: 22 additions & 0 deletions
22
src/Search.GenerateAuxiliaryData/Settings/prod-southeastasia.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| { | ||
| "Initialization": { | ||
| "AzureCdnCloudStorageAccount": "DefaultEndpointsProtocol=https;AccountName=nugetgallery;AccountKey=$$Prod-NuGetGalleryStorage-Key$$", | ||
| "AzureCdnCloudStorageContainerName": "nuget-cdnstats", | ||
| "PrimaryDestination": "DefaultEndpointsProtocol=https;AccountName=nugetprodsea;AccountKey=$$Prod-NuGetProdSeaStorage-Key$$" | ||
| }, | ||
|
|
||
| "GalleryDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.GalleryDatabaseAddress};Initial Catalog=NuGetGallery;User ID=$$Prod-GalleryDBReadOnly-UserName$$;Password=$$Prod-GalleryDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "StatisticsDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.StatisticsDatabaseAddress};Initial Catalog=nuget-prod-statistics;User ID=$$Prod-StatisticsDBReadOnly-UserName$$;Password=$$Prod-StatisticsDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "KeyVault_VaultName": "#{Deployment.Azure.KeyVault.VaultName}", | ||
| "KeyVault_ClientId": "#{Deployment.Azure.KeyVault.ClientId}", | ||
| "KeyVault_CertificateThumbprint": "#{Deployment.Azure.KeyVault.CertificateThumbprint}", | ||
| "KeyVault_ValidateCertificate": true, | ||
| "KeyVault_StoreName": "My", | ||
| "KeyVault_StoreLocation": "LocalMachine" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| { | ||
| "Initialization": { | ||
| "AzureCdnCloudStorageAccount": "DefaultEndpointsProtocol=https;AccountName=nugetgallery;AccountKey=$$Prod-NuGetGalleryStorage-Key$$", | ||
| "AzureCdnCloudStorageContainerName": "nuget-cdnstats", | ||
| "PrimaryDestination": "DefaultEndpointsProtocol=https;AccountName=nugetprodussc;AccountKey=$$Prod-NuGetProdUsscStorage-Key$$" | ||
| }, | ||
|
|
||
| "GalleryDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.GalleryDatabaseAddress};Initial Catalog=NuGetGallery;User ID=$$Prod-GalleryDBReadOnly-UserName$$;Password=$$Prod-GalleryDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "StatisticsDb": { | ||
| "ConnectionString": "Data Source=tcp:#{Deployment.Azure.Sql.StatisticsDatabaseAddress};Initial Catalog=nuget-prod-statistics;User ID=$$Prod-StatisticsDBReadOnly-UserName$$;Password=$$Prod-StatisticsDBReadOnly-Password$$;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;" | ||
| }, | ||
|
|
||
| "KeyVault_VaultName": "#{Deployment.Azure.KeyVault.VaultName}", | ||
| "KeyVault_ClientId": "#{Deployment.Azure.KeyVault.ClientId}", | ||
| "KeyVault_CertificateThumbprint": "#{Deployment.Azure.KeyVault.CertificateThumbprint}", | ||
| "KeyVault_ValidateCertificate": true, | ||
| "KeyVault_StoreName": "My", | ||
| "KeyVault_StoreLocation": "LocalMachine" | ||
| } |