Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(mojaloop/#2975): mojaloop helm release v14.1.0 #509

Merged
merged 46 commits into from
Nov 22, 2022
Merged

Conversation

mdebarros
Copy link
Member

@mdebarros mdebarros commented Oct 20, 2022

feat(mojaloop/#2975): mojaloop helm release v14.1.0 - mojaloop/project#2975

mdebarros and others added 5 commits October 6, 2022 19:29
* docs: added initial sdk-scheme-adapter folder with main readme

* feat: ceate an sdk-scheme-adapter helm chart

- added initial chart-service for sdk-scheme-adapter-svc
- added parent sdk-scheme-adapter wrapper chart

* deployment fixes

* updates

- added wait-for-redis
- fixed env vars

* fixes for ingress

* fixes for ingress

* cleanup of main values config for sdk-scheme-adapter-svc

* fixes for sdk-scheme-adapter

* clean up to sdk-scheme-adapter values

* clean up to sdk-scheme-adapter values

* updated readme with documentation

* fix: for global vs local vars for kafka and redis

- fixed global vs local assignment issues
- updated documentation

* fixes for configs

* cleaned up configs

* added 'sdk-scheme-adapter to package/update scripts

* added sdk-scheme-adapter to lint script

* cleaned up codeowners

* bump chart version to v2

* updates for redis database support and kafka topic prefixes

- added database to redis config and URI mapping
- added chart name as a prefix to all sdk-scheme-adapter topics

* bumped sdk-scheme-adapter to latest snapshot

* Updated API_SERVER_* env configs to include DOMAIN_EVENT/COMMAND_EVENT prefix depending on context

- Updated API_SERVER_* env configs to include DOMAIN_EVENT/COMMAND_EVENT prefix depending on context
- updated serviceName on metric configs

* typo on port
* chore: bump and validate sdk-scheme-adapter api-svc

* chore: fix name in readme

* bump to mojaloop-sim charts

- bumped chart and dependencies
- updated descriptions

* updates to thirdparty charts

Co-authored-by: Miguel de Barros <[email protected]>
…#503)

feat(mojaloop/#2964): add three new simulator dfsps using sdk and ttk - mojaloop/project#2964
- added mojaloop-ttk-simulators parent wrapper chart that provides 3 simulators that are configurable for deployment
- fixed configs with sdk-scheme-adapter to make them more configurable for the mojaloop-ttk-sim parent wrapper

fix: "data: Too long: must have at most 1048576 bytes" error
- `helm.go:84: [debug] Secret "sh.helm.release.v1.bulk.v1" is invalid: data: Too long: must have at most 1048576 bytes` <-- this error occurs because parent charts are including the "raw" child-* folders when they are packaged (i.e. copying unnecessary files), and are already being included in the "charts" folder as tgz packages. Fixed this by adding `chart-*` to all `.helmignore` files, and adding `.helmignore` files where missing.

Co-authored-by: Vijay Kumar <[email protected]>
…y to mojaloop (#507)

feat([mojaloop/2976](mojaloop/project#2976)): added mojaloop-ttk-simulators chart as dependency to mojaloop (#507)
* feat: added mojaloop-ttk-simulators chart as dependency to mojaloop
* feat: added helm test command
* Updated README.md
@mdebarros mdebarros marked this pull request as draft October 20, 2022 10:06
@mdebarros mdebarros self-assigned this Oct 20, 2022
@mdebarros mdebarros changed the title release(mojaloop/#2975): mojaloop helm release v14.1.0 feat(mojaloop/#2975): mojaloop helm release v14.1.0 Oct 20, 2022
elnyry-sam-k
elnyry-sam-k previously approved these changes Oct 20, 2022
- updated central-ledger from v15.1.0 to v16.3.0
- updated v14.1.0 release notes
- updated central-ledger release notes link to v14.1.2.1 which was missed
- updated bulk-api-adapter from v15.1.0 to v16.3.0
- updated v14.1.0 release notes
@mdebarros
Copy link
Member Author

mdebarros commented Oct 21, 2022

All tests passing with commits:

--------------------FINAL REPORT--------------------

Test Suite:GP Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 598                           │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 130                           │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Fri, 21 Oct 2022 11:58:42 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Fri, 21 Oct 2022 12:01:50 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 187516 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-10-21T12:01:50.222Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Bulk Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 54                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 13                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Fri, 21 Oct 2022 12:02:01 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Fri, 21 Oct 2022 12:04:01 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 120421 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-10-21T12:04:01.796Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Thirdparty Provisioning Collection
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 137                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 137                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 135                           │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 15                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Fri, 21 Oct 2022 12:04:12 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Fri, 21 Oct 2022 12:04:50 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 38118 ms                      │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-10-21T12:04:50.363Z.html was generated

kleyow and others added 11 commits October 21, 2022 16:35
- removed accidently paste line
* chore: bump sdk

* chore: bump to release

* chore: bump

* chore: bump sdk
* feat: added jws support to sdk-scheme-adapter
* chore: added checksums for jws keys in sdk chart
* feat(mojaloop/#2352): update and standardise helm charts to use networking v1 (#508)

feat(mojaloop/#2352): update and standardise helm charts to use networking v1 - mojaloop/project#2352

# Notes

This PR is re-created from #506 which includes some fixes based on tests on k8s v1.24

# Changes:

## Update the Chart.yaml's and standardise all charts to helm v3 (API v2)
    - move any dependencies in the requirements.yaml to Charts.yaml
    - update the apiVersion for helm in all the Charts.yaml to 2.0
    - add the common dependency to each chart that already has an ingress
    - remove all requirements.lock 
    - update maintainers in chart.yaml to include [email protected]
    - bump chart versions 

## Update the ingress and networking API to v1 and standardise where possible 
   -  if the chart has an ingress template the chart  is not on the exclusion list (see below) => the ingress template is updated to be a clone of the bitnami example (a version of what already exists in the charts repo)
   - updates the values files for the new ingress settings
   - ensure the updated values files have the correct hostname for the ingress
   - checks for paths and extra paths correctly allowed for (i.e. all charts with extraPaths or extraHosts are on e
   - ensure the updated values files have the correct port number for the ingress
    - update config/default.json files for values.ingress.api.host or similar to use .Values.ingress.hostname
    - _helper.tpl's updated to use correct ingress APIs and remove redundant ingress logic and templates

## General Maintenance
    - Fixed lint issue
    - Removed forensicloggingsidecar, centralenduserregistry, kube-system from lint scripts since they are no longer supported
    - Updated Maintainers list for each chart

## Exclusion list of charts
- i.e. these charts are not yet standardised to the new ingress modeled on the bitnami example :
- Any existing ingress in these charts has been updated "in place" rather than replaced with the newer standardised bitnami modeled chart.
- So the ingress.yaml, config/*json, _helper.tpls , values.yaml files etc have been updated to use the latest ingress but they remain non-standard compared to the rest of the code-base.
- "finance-portal-settlement-management",
- "finance-portal",
- ~"thirdparty"~,
- ~"thirdparty/chart-tp-api-svc"~,
- ~"thirdparty/chart-consent-oracle"~,
- ~"thirdparty/chart-auth-svc"~,
- ~"mojaloop-simulator"~,
- "keycloak",
- "monitoring",
- "monitoring/promfana",
- "monitoring/elk",
- "ml-testing-toolkit/chart-keycloak",
- "ml-testing-toolkit/chart-backend",
- "ml-testing-toolkit/chart-frontend",
- "ml-testing-toolkit/chart-connection-manager-backend",
- "ml-testing-toolkit/chart-connection-manager-frontend"

Co-authored-by: tdaly61 <[email protected]>
Co-authored-by: Sam <[email protected]>

* fix: als-admin api ingress service port (#511)

- fixed als-admin api ingress service port from 4002 to 4001
- fixed formatting issues in for protocol_versions configs

* fix(mojaloop/2995): update ttk-ui (#512)

* chore: bumped up ttk-ui

* chore: some change in appversion

* fix: als-admin api ingress service port (#513)

- fixed als api ingress service port fix from 4002/4001 to 80
- fixed formatting issues in for protocol_versions configs

* chore: updated TTK and fixed some values

* feat: added example backend chart for mojaloop (#517)

feat: added example backend chart for mojaloop (#517) - mojaloop/project#3000
- updated mojaloop/values.yaml to include CONFIG section with YAML Anchor variables to make configurations easier
- added example-mojaloop-backend for external backend dependencies to enable deployments on Kubernetes v1.22+
    - updated shell helper scripts to include example-mojaloop-backend charts
- updates CI config to add helm dependency repos and updated readme

Co-authored-by: Miguel de Barros <[email protected]>

* updates to chart appVersion description

* fix: changed the default jws file path in sdk helm chart

* fix: sdk helm values

Co-authored-by: Miguel de Barros <[email protected]>
Co-authored-by: tdaly61 <[email protected]>
Co-authored-by: Sam <[email protected]>
…se Switch as fspiop-source (#528)

- upgraded bulk-api-adapter from v14.1.1 to v14.2.0 for mojaloop/project#2867
- upgraded central-ledger from v16.3.0 to v16.3.1  for mojaloop/project#3024
- added JWS config to ENDPOINT_SECURITY default.json for bulk-api-adapters helm charts
- added endpointSecurity config to bulk-api-adapter notification handler config
- added secret-jws template to bulk-api-adapter notification handler
- added volume mounts to bulk-api-adapter notification handler deployment template
@mdebarros
Copy link
Member Author

All tests pass for commit: add29f6

--------------------FINAL REPORT--------------------

Test Suite:GP Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 598                           │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 130                           │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Mon, 21 Nov 2022 18:06:10 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Mon, 21 Nov 2022 18:09:24 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 193970 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-21T18:09:24.291Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Thirdparty Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 21                            │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 21                            │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 20                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 8                             │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Mon, 21 Nov 2022 18:12:28 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Mon, 21 Nov 2022 18:12:36 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 8239 ms                       │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-21T18:12:36.821Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Bulk Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 54                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 13                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Mon, 21 Nov 2022 18:09:32 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Mon, 21 Nov 2022 18:11:32 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 119418 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-21T18:11:32.055Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:SDK Bulk Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 195                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 195                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 33                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 18                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Mon, 21 Nov 2022 18:13:39 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Mon, 21 Nov 2022 18:15:51 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 132410 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-21T18:15:51.452Z.html was generated

Copy link
Member

@elnyry-sam-k elnyry-sam-k left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Miguel..

Made a few minor comments, please review

elnyry-sam-k
elnyry-sam-k previously approved these changes Nov 22, 2022
Copy link
Member

@elnyry-sam-k elnyry-sam-k left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@mdebarros mdebarros marked this pull request as ready for review November 22, 2022 12:01
mdebarros added a commit to mojaloop/testing-toolkit-test-cases that referenced this pull request Nov 22, 2022
feat(mojaloop/#2975): mojaloop helm release v14.1.0 - mojaloop/project#2975
- updates to support [Helm v14.1.0 WIP release](mojaloop/helm#509)

fix(mojaloop/#3024): [core bulk] POST /bulkTransfers from Switch to PayeeFSP to use Switch as fspiop-source - mojaloop/project#3024
- updated other/bulk_transfers to correctly reflect "DESTINATION" headers to switch

Co-authored-by: vijayg10 <[email protected]>
- updated link to use TTK Test Collection release.
- added TODO to update link once the response rules have been migrated to the SDK repo
- updated release notes with correct SDK version
@mdebarros
Copy link
Member Author

All tests pass as of commit: 3c63ea9

--------------------FINAL REPORT--------------------

Test Suite:GP Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 2634                          │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 598                           │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 130                           │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Tue, 22 Nov 2022 16:14:36 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Tue, 22 Nov 2022 16:17:55 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 198855 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-22T16:17:55.338Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Thirdparty Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 21                            │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 21                            │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 20                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 8                             │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Tue, 22 Nov 2022 16:21:16 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Tue, 22 Nov 2022 16:21:25 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 8459 ms                       │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-22T16:21:25.170Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:Bulk Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 337                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 54                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 13                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Tue, 22 Nov 2022 16:18:05 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Tue, 22 Nov 2022 16:20:17 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 132246 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-22T16:20:17.256Z.html was generated
--------------------FINAL REPORT--------------------

Test Suite:SDK Bulk Tests
Environment:Development
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 195                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 195                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 33                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 18                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Tue, 22 Nov 2022 16:22:23 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Tue, 22 Nov 2022 16:24:35 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 132678 ms                     │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2022-11-22T16:24:35.963Z.html was generated

@mdebarros
Copy link
Member Author

feat(mojaloop/#2975): mojaloop helm release v14.1.0 - mojaloop/project#2975

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants