Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Abl 10 fill db for perftests tool - intermediate #921

Open
wants to merge 160 commits into
base: abl-10
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
160 commits
Select commit Hold shift + click to select a range
6cc50af
feat: added inital excel calc-sheet and loadtest json configs
ericbrunner Oct 15, 2024
f132409
chore: modified testdata excel, added json pool configs
ericbrunner Oct 16, 2024
ab8d904
chore: fixed excel and json files
ericbrunner Oct 16, 2024
9540eb5
test: added Models and test DeserializeFromJson
ericbrunner Oct 17, 2024
170a3be
test: added tests for DeserializeFromExcel, VerifyJsonPoolConfig
ericbrunner Oct 17, 2024
33b5847
feat: added own solution for snapshot-creator-v2
ericbrunner Oct 18, 2024
da2f3a7
fix: test-data path and check formatting oof backbone.sln
ericbrunner Oct 18, 2024
81cfa6a
fix: solution path
ericbrunner Oct 18, 2024
4cc4212
fix: WHITESPACE
ericbrunner Oct 18, 2024
846a17e
chore: added dev readme
ericbrunner Oct 18, 2024
6c1ac4d
feat: Generate JSON configs from Excel Calculation (PerformanceTestData)
ericbrunner Oct 18, 2024
2c2ba79
fix: error IDE0042: Variable declaration can be deconstructed
ericbrunner Oct 18, 2024
59fe4d8
fix: error IDE0007: use 'var' instead of explicit type
ericbrunner Oct 18, 2024
3377db7
feat: Generate Relationships Excel (RelationshipsAndMessagePoolConfig…
ericbrunner Oct 21, 2024
f426718
feat: Distribute Messages on Relationships
ericbrunner Oct 22, 2024
756605c
feat: Distribute Messages on Relationships
ericbrunner Oct 23, 2024
61cd674
feat: Distribute Messages on Relationships (RelationshipsAndMessagePo…
ericbrunner Oct 23, 2024
ee4a223
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
mergify[bot] Oct 23, 2024
43fb3f6
feat: added VerifyAndFixNumberOfSentMessages, and included PR Review …
ericbrunner Oct 24, 2024
d83be8c
Merge branch 'abl-10-fill-db-for-perftests-tool' of github.com:nmshd/…
ericbrunner Oct 24, 2024
44744e7
fix: heavy loadtest data corrected according to confluence Performanc…
ericbrunner Oct 24, 2024
1825190
fix: PR review refactorings
ericbrunner Oct 25, 2024
45d36a5
fix: VerifyNumberOfSentMessages
ericbrunner Oct 25, 2024
2923b81
test: added tests for test, light, heavy load
ericbrunner Oct 28, 2024
75f8240
refactor: added PoolConfigurationJsonGeneratorCommand
ericbrunner Oct 28, 2024
d01e68e
refactor: added verify-json, generate-relationships commands
ericbrunner Oct 29, 2024
388891e
fix: formatting import order
ericbrunner Oct 29, 2024
a623025
feat: add command generate-all (pool-config with relationships-and-me…
ericbrunner Oct 29, 2024
8db1d9e
refactor: updated to only generate a single json pool config incl. re…
ericbrunner Oct 30, 2024
8cefbac
fix: error IMPORTS: Fix imports ordering
ericbrunner Oct 30, 2024
f2126fe
feat: added inital excel calc-sheet and loadtest json configs
ericbrunner Oct 15, 2024
f280a07
chore: modified testdata excel, added json pool configs
ericbrunner Oct 16, 2024
40fcb54
chore: fixed excel and json files
ericbrunner Oct 16, 2024
b72d9eb
test: added Models and test DeserializeFromJson
ericbrunner Oct 17, 2024
16f9e58
test: added tests for DeserializeFromExcel, VerifyJsonPoolConfig
ericbrunner Oct 17, 2024
73dd8bc
feat: added own solution for snapshot-creator-v2
ericbrunner Oct 18, 2024
769fe7f
fix: test-data path and check formatting oof backbone.sln
ericbrunner Oct 18, 2024
5f67950
fix: solution path
ericbrunner Oct 18, 2024
12eccce
fix: WHITESPACE
ericbrunner Oct 18, 2024
c8094ae
chore: added dev readme
ericbrunner Oct 18, 2024
a1493df
feat: Generate JSON configs from Excel Calculation (PerformanceTestData)
ericbrunner Oct 18, 2024
6be7e57
fix: error IDE0042: Variable declaration can be deconstructed
ericbrunner Oct 18, 2024
cb5cac2
fix: error IDE0007: use 'var' instead of explicit type
ericbrunner Oct 18, 2024
842c969
feat: Generate Relationships Excel (RelationshipsAndMessagePoolConfig…
ericbrunner Oct 21, 2024
0c88156
feat: Distribute Messages on Relationships
ericbrunner Oct 22, 2024
f4e130f
feat: Distribute Messages on Relationships
ericbrunner Oct 23, 2024
1a43a74
feat: Distribute Messages on Relationships (RelationshipsAndMessagePo…
ericbrunner Oct 23, 2024
da0cd25
feat: added VerifyAndFixNumberOfSentMessages, and included PR Review …
ericbrunner Oct 24, 2024
93346a3
fix: heavy loadtest data corrected according to confluence Performanc…
ericbrunner Oct 24, 2024
4142d3f
fix: PR review refactorings
ericbrunner Oct 25, 2024
604bf5a
fix: VerifyNumberOfSentMessages
ericbrunner Oct 25, 2024
2f9c942
test: added tests for test, light, heavy load
ericbrunner Oct 28, 2024
afefcac
refactor: added PoolConfigurationJsonGeneratorCommand
ericbrunner Oct 28, 2024
a931482
refactor: added verify-json, generate-relationships commands
ericbrunner Oct 29, 2024
6b2ce0e
fix: formatting import order
ericbrunner Oct 29, 2024
7aaaf38
feat: add command generate-all (pool-config with relationships-and-me…
ericbrunner Oct 29, 2024
545a1d1
refactor: updated to only generate a single json pool config incl. re…
ericbrunner Oct 30, 2024
24b729c
fix: error IMPORTS: Fix imports ordering
ericbrunner Oct 30, 2024
8acee94
refactor: rebased on head of parent branch
ericbrunner Oct 30, 2024
85d38cb
fix: use Directory.Build.props (FakeItEasy, FluentAssertions, GitHub…
ericbrunner Oct 30, 2024
6cd3849
feat: add CreateIdentities and some refactorings (mostly rename)
ericbrunner Oct 31, 2024
960a4ee
feat: added AddDevices command
ericbrunner Oct 31, 2024
000ec15
feat: added CreateRelationshipTemplates command
ericbrunner Oct 31, 2024
4bb211d
feat: added CreateRelationships command
ericbrunner Oct 31, 2024
a018859
feat: added CreateChallenges command
ericbrunner Oct 31, 2024
652d8ea
refactor: replaced ICommands with MediatR.NET
ericbrunner Nov 11, 2024
6f21e7c
chore: some renamings and clean-up
ericbrunner Nov 11, 2024
e1de2a1
feat: added CreateMessages command
ericbrunner Nov 11, 2024
39e6526
fix: an IDE0270 issue
ericbrunner Nov 11, 2024
9cac4e6
feat: added CreateDatawalletModifications command
ericbrunner Nov 11, 2024
5b29792
feat: added create snapshot csv output helper
ericbrunner Nov 12, 2024
8da027e
refac: simplified sub-handler
ericbrunner Nov 12, 2024
373e772
feat: use existing impl. of PreGenerateDatawalletModifications
ericbrunner Nov 12, 2024
3f39ae7
merged abl-10 (head of current main) into it
ericbrunner Nov 12, 2024
7b21dfd
feat: added debugmode for pool-config generator command
ericbrunner Nov 12, 2024
561addb
fix: some adjustments
ericbrunner Nov 12, 2024
31ae30f
fix: added IdentityData to solve signature error on adding new device
ericbrunner Nov 13, 2024
df8e1f9
refactor: create snapshot handler (part I)
ericbrunner Nov 13, 2024
26b27f0
chore: added database cleanup scripts
ericbrunner Nov 14, 2024
18f8ca6
feat: added clean-db backup and restore script
ericbrunner Nov 15, 2024
57de4b7
refactor: create snapshot handler (part II)
ericbrunner Nov 15, 2024
0245455
refactor: create snapshot handler (part III)
ericbrunner Nov 16, 2024
bdfcab6
refactor: create snapshot handler (part IV)
ericbrunner Nov 16, 2024
6799322
fix: relationship validation
ericbrunner Nov 16, 2024
ba99c67
refactor: some code cleanup
ericbrunner Nov 18, 2024
5229e04
fix: unit tests
ericbrunner Nov 18, 2024
5010db5
refactor: create snapshot handler's challenge command
ericbrunner Nov 18, 2024
e40e712
refactor: create snapshot handler's message command
ericbrunner Nov 18, 2024
d73484e
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
ericbrunner Nov 18, 2024
ae7fd6e
feat: upgraded to net9.0
ericbrunner Nov 18, 2024
0deda60
fix: fixed Create Message Handler
ericbrunner Nov 19, 2024
01d4da0
feat: added DatawalletModifications command
ericbrunner Nov 19, 2024
74a8f38
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
mergify[bot] Nov 19, 2024
1d57203
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
ericbrunner Nov 19, 2024
9a0d8b8
Merge remote-tracking branch 'origin/abl-10-fill-db-for-perftests-too…
ericbrunner Nov 19, 2024
e33dba8
chore: usage of common .csproj properties from Directory.Build.props
ericbrunner Nov 19, 2024
f09888a
test: real snapshot result for test performance-load added
ericbrunner Nov 20, 2024
99e42a1
test: added light, heavy pool-config
ericbrunner Nov 20, 2024
a5af4ed
test: added light, heavy pool-config
ericbrunner Nov 20, 2024
5006bfa
Merge remote-tracking branch 'origin/abl-10-fill-db-for-perftests-too…
ericbrunner Nov 20, 2024
d12a6e4
fix: ordered relationship id lists
ericbrunner Nov 20, 2024
e939e33
fix: usage RelationshipIdBag.NumberOfSentMessages
ericbrunner Nov 20, 2024
569c612
feat: added logging
ericbrunner Nov 21, 2024
413f8df
chore: some minor fix in already created device
ericbrunner Nov 21, 2024
5a277db
fix: set Modules.Messages.Application.MaxNumberOfUnreceivedMessagesFr…
ericbrunner Nov 22, 2024
c673c6d
fix: set upper range of MaxNumberOfUnreceivedMessagesFromOneSender
ericbrunner Nov 22, 2024
a8d0438
refactor: added a degree of concurrency
ericbrunner Nov 22, 2024
5e0281d
refactor: added a throttle of concurrency
ericbrunner Nov 22, 2024
de852ce
refactor: concurrency
ericbrunner Nov 23, 2024
94066e4
refactor: concurrency further improved - part I
ericbrunner Nov 23, 2024
e5ef38a
refactor: tweaked concurrency based on processor-count - part II
ericbrunner Nov 23, 2024
c40c105
refactor: tweaked concurrency based on processor-count - part III
ericbrunner Nov 25, 2024
de25843
refactor: each handler can individually set maxDegreeOfParallelism
ericbrunner Nov 25, 2024
37b905b
chore: added completed LIGHT Testrun
ericbrunner Dec 4, 2024
c205e97
chore: revmoved individual maxDegreeOfParallelism
ericbrunner Dec 4, 2024
b3097c7
chore: aligned config files
ericbrunner Dec 4, 2024
46799c6
test: CreateIdentities
ericbrunner Dec 4, 2024
f0c99b0
test: CreateDevices
ericbrunner Dec 4, 2024
554bac4
test: DeviceFactory
ericbrunner Dec 4, 2024
0131567
refactor: minor code adjustments
ericbrunner Dec 5, 2024
4ce6f43
fix: removed wrong code segment in CreateDevice
ericbrunner Dec 5, 2024
26aee31
test: DeviceFactoryTests
ericbrunner Dec 5, 2024
9c627a2
test: IdentityFactory
ericbrunner Dec 5, 2024
3d817e1
fix: fixed wrong return value
ericbrunner Dec 5, 2024
ff57091
refactor: prep CreateChallenges for tests
ericbrunner Dec 5, 2024
d97bed5
test: added CreateChallengesTests
ericbrunner Dec 6, 2024
dcd9620
test: added ChallengeFactoryTests
ericbrunner Dec 6, 2024
3bec63a
refactor: adjusted CreateDatawalletModifications to support unit tests
ericbrunner Dec 6, 2024
f8bccc4
refactor: adjusted CreateRelationshipTemplates to support unit tests
ericbrunner Dec 6, 2024
fd7720e
refactor: adjusted CreateRelationships to support unit tests
ericbrunner Dec 6, 2024
baaa5d5
refactor: adjusted CreateMessages to support unit tests
ericbrunner Dec 6, 2024
856441e
fix: added missing identity.IdentityData
ericbrunner Dec 6, 2024
60ceba4
test: added CreateDatawalletModificationsTests
ericbrunner Dec 6, 2024
850e2d3
test: added DatawalletModificationFactoryTests
ericbrunner Dec 6, 2024
3c2e9d7
test: added CreateRelationshipTemplates unit tests
ericbrunner Dec 9, 2024
79717f1
test: added RelationshipTemplateFactory unit tests
ericbrunner Dec 9, 2024
ff5c6a6
test: added CreateRelationships unit tests
ericbrunner Dec 9, 2024
58f51f9
test: added RelationshipFactory unit tests
ericbrunner Dec 9, 2024
f1d71c9
test: add CreateMessages unit tests
ericbrunner Dec 9, 2024
7a86be2
test: added MessageFactory unit tests
ericbrunner Dec 9, 2024
0d43049
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
ericbrunner Dec 9, 2024
13779bf
fix: upgraded Microsoft.NET.Test.Sdk package version
ericbrunner Dec 9, 2024
a009ac6
test: added MaxDegreeOfParallelism
ericbrunner Dec 10, 2024
976c0d4
test: added CreateSnapshot unit tests
ericbrunner Dec 10, 2024
20c4678
test: completed PoolConfigurationExcelReader unit tests
ericbrunner Dec 10, 2024
c45086d
test: add PoolConfigurationJsonValidator unit tests
ericbrunner Dec 10, 2024
f4b6456
test: added VerifyConfig unit test
ericbrunner Dec 10, 2024
527e836
test: added PoolConfigurationJsonWriter unit tests
ericbrunner Dec 10, 2024
f747330
test: added RelationshipAndMessagesGenerator unit tests
ericbrunner Dec 10, 2024
1d7b5dd
test: added GenerateConfig unit tests - part I/II
ericbrunner Dec 10, 2024
049108b
test: added GenerateConfig unit tests part II/II
ericbrunner Dec 11, 2024
d3ba93d
fix: cleanup after CreateSnapshotTests run
ericbrunner Dec 11, 2024
604db04
test: some unit tests
ericbrunner Dec 11, 2024
bca2fca
feat: added restore clean-db option (draft)
ericbrunner Dec 11, 2024
bc1d7b9
refactor: added restore clean-db option
ericbrunner Dec 12, 2024
9a1c984
feat: added a clearOnly and a snapshot backupDB cli command switch
ericbrunner Dec 16, 2024
783f7ea
fix: unit test argument
ericbrunner Dec 16, 2024
dd7d0e0
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
ericbrunner Dec 17, 2024
918bf39
Merge branch 'abl-10' into abl-10-fill-db-for-perftests-tool
mergify[bot] Dec 17, 2024
86d6fd2
Merge remote-tracking branch 'origin/abl-10-fill-db-for-perftests-too…
ericbrunner Dec 17, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .ci/checkFormatting.sh
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
#!/bin/bash

dotnet restore /p:ContinuousIntegrationBuild=true
dotnet format --no-restore --verify-no-changes
dotnet restore /p:ContinuousIntegrationBuild=true ./Backbone.sln
dotnet format --no-restore --verify-no-changes ./Backbone.sln
ericbrunner marked this conversation as resolved.
Show resolved Hide resolved
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
<Project Sdk="Microsoft.NET.Sdk">

<PropertyGroup>
<TargetFramework>net8.0</TargetFramework>
<ImplicitUsings>enable</ImplicitUsings>
<Nullable>annotations</Nullable>
<LangVersion>latest</LangVersion>

<IsPackable>false</IsPackable>
<IsTestProject>true</IsTestProject>
</PropertyGroup>

<ItemGroup>
<PackageReference Include="coverlet.collector" Version="6.0.2">
<PrivateAssets>all</PrivateAssets>
<IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
</PackageReference>
<PackageReference Include="FakeItEasy" Version="8.3.0" />
<PackageReference Include="FluentAssertions" Version="6.12.1" />
<PackageReference Include="GitHubActionsTestLogger" Version="2.4.1">
<PrivateAssets>all</PrivateAssets>
<IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
</PackageReference>
ericbrunner marked this conversation as resolved.
Show resolved Hide resolved
<PackageReference Include="Microsoft.NET.Test.Sdk" Version="17.11.1" />
<PackageReference Include="xunit" Version="2.9.2" />
<PackageReference Include="xunit.runner.visualstudio" Version="2.8.2">
<PrivateAssets>all</PrivateAssets>
<IncludeAssets>runtime; build; native; contentfiles; analyzers; buildtransitive</IncludeAssets>
</PackageReference>
</ItemGroup>

<ItemGroup>
<Using Include="Xunit" />
</ItemGroup>
ericbrunner marked this conversation as resolved.
Show resolved Hide resolved

<ItemGroup>
<None Update="TestData\ExpectedRelationshipsAndMessagePoolConfigs.test.json">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
<None Update="TestData\PerformanceTestData-plusNewMedium.xlsx">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
<None Update="TestData\pool-config.heavy.json">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
<None Update="TestData\pool-config.light.json">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
<None Update="TestData\pool-config.test.json">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
<None Update="TestData\PerformanceTestData.xlsx">
<CopyToOutputDirectory>Always</CopyToOutputDirectory>
</None>
</ItemGroup>

<ItemGroup>
<ProjectReference Include="..\ConsumerApi.Tests.Performance\tools\snapshot-creator-v2\ConsumerApi.Tests.Performance.SnapshotCreator.V2.csproj" />
</ItemGroup>

</Project>
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
global using static Backbone.ConsumerApi.Tests.Performance.SnapshotCreator.V2.Constants.Resources;
Loading