Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DPP-403 log flyway progress #9964

Merged
merged 4 commits into from
Jun 15, 2021
Merged

Conversation

rautenrieth-da
Copy link
Contributor

Overview

This PR adds INFO-level flyway log output to daml-on-sql and all kvutils-based participants. The log output of sandbox-classic is unchanged.

The intention is that it's easier to follow the progress of migrations on large databases.

Examples

Additional output for an empty database:

23:23:02.757 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.c.i.license.VersionPrinter - Flyway Community Edition 6.5.0 by Redgate  
23:23:02.982 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.c.i.database.DatabaseFactory - Database: jdbc:postgresql://localhost/foo (PostgreSQL 12.4)  
23:23:03.096 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbValidate - Successfully validated 52 migrations (execution time 00:00.081s)  
23:23:03.127 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.c.i.s.JdbcTableSchemaHistory - Creating Schema History table "public"."flyway_schema_history" ...  
23:23:03.237 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Current version of schema "public": << Empty Schema >>  
23:23:03.258 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 1 - Init  
23:23:03.330 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 2.0 - Contract divulgence  
23:23:03.353 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 2.1 - Rebuild Acs  
23:23:03.399 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 3 - Recompute Key Hash  
23:23:03.412 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 4.0 - Add parties  
23:23:03.421 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 4.1 - Collect Parties  
23:23:03.441 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 5 - Add packages  
23:23:03.459 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 6 - External Ledger Offset  
23:23:03.473 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 7 - Command deduplication  
23:23:03.487 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 8 - Contract Divulgence  
23:23:03.508 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 9 - Contract Divulgence  
23:23:03.534 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 10.0 - Extract Event Data  
23:23:03.552 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 10.1 - Populate Event Data  
23:23:03.564 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 10.2 - Extract Event Data  
23:23:03.573 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 11 - Disclosures index  
23:23:03.585 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 12 - Add configuration  
23:23:03.606 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 13 - Party entries  
23:23:03.621 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 14 - Package entries  
23:23:03.636 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 15 - Loosen transaction check  
23:23:03.643 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 16 - Create command completions table  
23:23:03.659 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 17 - Command deduplication  
23:23:03.676 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 18 - Backfill completions  
23:23:03.698 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 19 - Fix Completions  
23:23:03.708 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 20 - Events new schema  
23:23:03.768 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 21 - Stable offsets  
23:23:03.907 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 22 - Remove maximum record time  
23:23:03.915 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 23 - Delete checkpoints  
23:23:03.934 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 24 - Stable offsets archival  
23:23:03.965 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 25 - Backfill Participant Events  
23:23:03.972 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 26.0 - Contracts new schema  
23:23:04.000 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 26.1 - Fill create argument  
23:23:04.007 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 26.2 - Contract create arg not null  
23:23:04.023 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 27 - Events table fixes  
23:23:04.033 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 28 - Fix key hashes  
23:23:04.037 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 29 - Fix participant events  
23:23:04.086 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 30 - Drop old schema  
23:23:04.098 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.c.i.s.DefaultSqlScriptExecutor - DB: drop cascades to 5 other objects  
23:23:04.100 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.c.i.s.DefaultSqlScriptExecutor - DB: drop cascades to constraint contract_divulgences_contract_id_fkey1 on table contract_divulgences  
23:23:04.136 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 31 - Event witnesses single table  
23:23:04.165 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 32.0 - Drop archived contracts  
23:23:04.174 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 32.1 - Fix key hashes  
23:23:04.188 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 33 - Add witnesses to participant events  
23:23:04.214 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 34 - Parties is local  
23:23:04.230 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 35 - event sequential id  
23:23:04.266 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 36 - drop participant id  
23:23:04.279 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 37 - add participant id to parameters  
23:23:04.288 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 38 - Update value versions  
23:23:04.299 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 39 - Participant-pruning  
23:23:04.304 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 40 - multiple submitters  
23:23:04.340 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 41 - hash indices  
23:23:04.359 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 42 - Convert hash indices  
23:23:04.370 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 43 - explicit compression  
23:23:04.386 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 44 - offset as text  
23:23:04.504 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Migrating schema "public" to version 45 - fix large size index issues  
23:23:04.513 [daml-on-sql-akka.actor.default-dispatcher-4] INFO  o.f.core.internal.command.DbMigrate - Successfully applied 52 migrations to schema "public" (execution time 00:01.281s)  

Additional output for an up-to-date database (this could be considered spam):

23:10:04.111 [daml-on-sql-akka.actor.default-dispatcher-6] INFO  o.f.c.i.license.VersionPrinter - Flyway Community Edition 6.5.0 by Redgate  
23:10:04.358 [daml-on-sql-akka.actor.default-dispatcher-6] INFO  o.f.c.i.database.DatabaseFactory - Database: jdbc:postgresql://localhost/foo (PostgreSQL 12.4)  
23:10:04.517 [daml-on-sql-akka.actor.default-dispatcher-6] INFO  o.f.core.internal.command.DbValidate - Successfully validated 52 migrations (execution time 00:00.129s)  
23:10:04.622 [daml-on-sql-akka.actor.default-dispatcher-6] INFO  o.f.core.internal.command.DbMigrate - Current version of schema "public": 45  
23:10:04.623 [daml-on-sql-akka.actor.default-dispatcher-6] INFO  o.f.core.internal.command.DbMigrate - Schema "public" is up to date. No migration necessary. 

@rautenrieth-da
Copy link
Contributor Author

@gerolf-da @mziolekda This PR makes it easier to follow the progress of index db migrations, but will make the output significantly more verbose for users that always start with an empty index database.

@kamil-da
Copy link
Contributor

Does this change affects logging after migrations as well? If not I don't think it's adding too much noise for empty dbs.

@rautenrieth-da
Copy link
Contributor Author

Does this change affects logging after migrations as well?

Yes, the "Additional output for an up-to-date database" section in the PR description shows the additional lines logged in the case no migration needs to be applied.

@rautenrieth-da rautenrieth-da merged commit adeba20 into main Jun 15, 2021
@rautenrieth-da rautenrieth-da deleted the dpp-403-log-flyway-progress branch June 15, 2021 19:32
azure-pipelines bot pushed a commit that referenced this pull request Jun 16, 2021
This PR has been created by a script, which is not very smart
and does not have all the context. Please do double-check that
the version prefix is correct before merging.

@stefanobaghino-da is in charge of this release.

Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END
stefanobaghino-da pushed a commit that referenced this pull request Jun 16, 2021
This PR has been created by a script, which is not very smart
and does not have all the context. Please do double-check that
the version prefix is correct before merging.

@stefanobaghino-da is in charge of this release.

Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <[email protected]>
stefanobaghino-da added a commit that referenced this pull request Jun 16, 2021
    This PR has been created by a script, which is not very smart
    and does not have all the context. Please do double-check that
    the version prefix is correct before merging.

    @stefanobaghino-da is in charge of this release.

    Commit log:
    ```
    adeba20 DPP-403 log flyway progress (#9964)
    401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
    3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
    af144e8 LF: Structure package loading errors (#9980)
    3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
    e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
    acb7733 Release 1.14 RC 2 (#10006)
    3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
    0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
    b79e739 Fix Type (#10004)
    998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
    ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
    dd42a5a update maven_install_2.12.json (#9999)
    66d38cd Storage query abstraction first sketch (#9959)
    c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
    b6faace Changing oracle backend from using varray to json array (#9943)
    603a4a4 Add date to log statements in the HTTP JSON service (#9988)
    836a82a Add proper error handling for missing contract keys (#9972)
    85667af Address npm vulnerabilities (#9978)
    d7d6e37 LF: Structure Engine Errors. (#9971)
    0adbbdc update Daml Hub auth in create-daml-app (#9973)
    997a7d4 Use symlinks on Windows (#9969)
    e4258e6 docs: tweak Exception intro (#9967)
    b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
    de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
    630d021 Collect build-event-stream (#9831)
    26e199a Rerelease 1.11.2 snapshot (#9965)
    8399039 Remove broken dep from release job (#9963)
    e1db529 DPP-390 configurable event decoding parallelism (#9931)
    cc7af93 [docs] Remove link to the #daml-contributors (#9928)
    f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
    4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
    28c567b Release SDK 1.11.2 (#9957)
    5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
    b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
    ca0fb16 Fix collect_build_data job (#9956)
    42030b2 Skip Scala_2_12 job on releases (#9954)
    5e1ddfb LF: Fix specification of ArithmeticError (#9949)
    3093a98 Forward port additional contract keys validation tests (#9944)
    e541558 update NOTICES file (#9946)
    db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
    13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
    4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
    fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
    ab55fb2 Handle module-prefixes in Java codegen (#9929)
    7375e28 Force resolution for css what to 5.0.1 (#9925)
    ```
    Changelog:
    ```
    - [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

    - [JSON-API] The source and the path for incoming http requests are now logged
    - [JSON-API] The http response for a request is now logged

    - [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

    - [JSON API] log statements now include the date next to the time
    - [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
    [Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
    - [JSON API] The healthcheck endpoint on the JSON API now proxies the
      health check endpoint on the underlying ledger. Previously it only
      queried for ledger end to determine ledger health.
    [HTTP-JSON]
    - fixed that json log output could not be enabled via cli options except via usage of env vars
    - [Integration Kit] - ledger-api-bench-tool - reading active contract streams
    - [Integration Kit] - ledger-api-bench-tool - Reading completions stream
    - [Java Codegen] The Java codegen will now pick up the
      `module-prefixes` field from `daml.yaml` which can be used to handle
      module name collisions between different DALFs.
    ```

    CHANGELOG_BEGIN
    CHANGELOG_END
stefanobaghino-da added a commit that referenced this pull request Jun 16, 2021
Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END
stefanobaghino-da added a commit that referenced this pull request Jun 16, 2021
Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END
stefanobaghino-da added a commit that referenced this pull request Jun 16, 2021
Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END
dasormeter pushed a commit that referenced this pull request Jun 16, 2021
Commit log:
```
adeba20 DPP-403 log flyway progress (#9964)
401069e prepare for upgrade to Scalaz 7.3.3 (#9997)
3ad9cd5 [JSON-API] Log templateId & choice name (if present) on command submissions in the json API (#10005)
af144e8 LF: Structure package loading errors (#9980)
3583fd1 [JSON-API] Log source and path of incoming http requests & the response with info level (#10007)
e49c7c8 [In-memory fan-out] BufferedTransactionsReader implementation [DPP-413] [DPP-414] (#9882)
acb7733 Release 1.14 RC 2 (#10006)
3d2d4b9 Don't duplicate log failed futures in the http json api (commandservice specific ones) (#9990)
0c32cf2 Clarify the semantics of DIV_INT64 in LF spec. (#10003)
b79e739 Fix Type (#10004)
998f106 Drop pkgIds argument from Engine.validatePackages (#9986)
ae5010f [Mutable state cache] Start cache from latest ledger head (#9998)
dd42a5a update maven_install_2.12.json (#9999)
66d38cd Storage query abstraction first sketch (#9959)
c750136 Just print out the operator name for the operation logging in CommandService.scala (#9989)
b6faace Changing oracle backend from using varray to json array (#9943)
603a4a4 Add date to log statements in the HTTP JSON service (#9988)
836a82a Add proper error handling for missing contract keys (#9972)
85667af Address npm vulnerabilities (#9978)
d7d6e37 LF: Structure Engine Errors. (#9971)
0adbbdc update Daml Hub auth in create-daml-app (#9973)
997a7d4 Use symlinks on Windows (#9969)
e4258e6 docs: tweak Exception intro (#9967)
b2c4ef8 rotate release duty after 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9933)
de7a462 Log call to submitAndWaitRequest with the command id provided in the log ctx (#9940)
630d021 Collect build-event-stream (#9831)
26e199a Rerelease 1.11.2 snapshot (#9965)
8399039 Remove broken dep from release job (#9963)
e1db529 DPP-390 configurable event decoding parallelism (#9931)
cc7af93 [docs] Remove link to the #daml-contributors (#9928)
f7ac3ba Release 1.11.2 snapshot attempt 2 (#9962)
4634147 Adds Indexer state to GRPC health checks [DPP-434] (#9951)
28c567b Release SDK 1.11.2 (#9957)
5f0f575 Define IncompleteTransaction for use by scenario-service (#9952)
b7fd833 Increase `eventually` timeout when waiting for queue to be killed (#9955)
ca0fb16 Fix collect_build_data job (#9956)
42030b2 Skip Scala_2_12 job on releases (#9954)
5e1ddfb LF: Fix specification of ArithmeticError (#9949)
3093a98 Forward port additional contract keys validation tests (#9944)
e541558 update NOTICES file (#9946)
db792a9 Proxy ledger API health endpoint in JSON API health endpoint (#9945)
13767b5 Load the correct logback file for the http json service respecting the deployment situation (#9938)
4e49cf6 `ledger-api-bench-tool` - Active contracts stream, completions stream [DPP-398, DPP-399] (#9857)
fce8e54 release 1.14.0-snapshot.20210608.7123.0.3cb8d5c2 (#9932)
ab55fb2 Handle module-prefixes in Java codegen (#9929)
7375e28 Force resolution for css what to 5.0.1 (#9925)
```
Changelog:
```
- [JSON API] The template id & choice name (if present) are now logged on command submissions in the Json API (at trace level)

- [JSON-API] The source and the path for incoming http requests are now logged
- [JSON-API] The http response for a request is now logged

- [JSON API] Errors which arise from the CommandService are not logged twice anymore (thus reducing noise)

- [JSON API] log statements now include the date next to the time
- [HTTP-JSON] Calls which trigger a submitAndWaitRequest are logged with the command id provided in the log ctx
[Integration Kit] The state of the participant indexer can now be checked via the GRPC health endpoint
- [JSON API] The healthcheck endpoint on the JSON API now proxies the
  health check endpoint on the underlying ledger. Previously it only
  queried for ledger end to determine ledger health.
[HTTP-JSON]
- fixed that json log output could not be enabled via cli options except via usage of env vars
- [Integration Kit] - ledger-api-bench-tool - reading active contract streams
- [Integration Kit] - ledger-api-bench-tool - Reading completions stream
- [Java Codegen] The Java codegen will now pick up the
  `module-prefixes` field from `daml.yaml` which can be used to handle
  module name collisions between different DALFs.
```

CHANGELOG_BEGIN
CHANGELOG_END
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants