🧪 Initial regression testing framework #780

ff137 · 2024-04-25T14:31:53Z

This PR implements regression testing functionality, by utilising fixture parametrization, so existing tests can be run in a "clean_run" or a "regression_run" mode. A clean run will follow the existing logic of creating new members, connections, credentials etc, for each test. A regression run will utilise existing tenants, connections, credentials, etc, to assert that functionality works for existing fixtures.

Usage:

export RUN_REGRESSION_TESTS=true
export SKIP_CLEAN_TESTS=true  # it's possible to run a mix of regression + clean tests, but then it runs every possible combination, of mixing one fixture is clean and this other one reused, etc. About ~3600 tests in total
pytest  # 1st test run

The above env vars will configure test fixtures to create regression test fixtures (i.e. reusable tenants, connections, schemas, and cred defs), if they don't already exist.

After a first test run is complete, you can set the following:

export FAIL_ON_RECREATING_FIXTURES=true
pytest  #2nd test run

This will configure the tests to fail if any fixture is re-created, because after an initial first run, we expect existing fixtures to be re-used in subsequent test runs.

The PR currently skips 3 problematic tests from running in regression mode. They can be investigated in more detail at a later stage. Apart from that, all tests are currently passing in regression mode, in the first initial run, and subsequent runs.

To-do:

implement specific tests for re-using already issued credentials, and proving a revoked credential is still revoked, etc

app/tests/regression/fixtures.py

app/tests/regression/test_issue_credentials.py

app/tests/conftest.py

app/tests/fixtures/member_connections.py

app/tests/util/connections.py

github-actions · 2024-04-30T14:15:42Z

Coverage Report

File	Stmts	Miss	Cover	Missing
app/routes
connections.py	60	39	35%	32–48, 64–76, 113–138, 159–173, 188–199
definitions.py	188	92	51%	76–137, 170–171, 238–254, 269–275, 296–305, 328–329, 346–348, 391–445, 472–473, 517–597, 605–624
issuer.py	173	38	78%	92, 128, 167–169, 198, 234–236, 244, 261, 360–370, 401–412, 445–476, 517, 530, 562
jsonld.py	60	47	22%	23–93, 104–137
messaging.py	24	11	54%	32–41, 61–71
oob.py	46	28	39%	27–68, 79–92, 116–127
verifier.py	147	33	78%	64–66, 71, 109–111, 116, 158, 166–168, 173, 207–212, 218–220, 270–272, 278, 311–313, 318, 348–350, 384–386
webhooks.py	16	4	75%	32–36, 57–61
websocket_endpoint.py	23	8	65%	24–25, 37–42, 54–57, 70–76
app/routes/wallet
credentials.py	77	52	32%	32–45, 54–66, 75–86, 95–109, 120–136, 148–162, 171–183, 192–203
dids.py	76	22	71%	28–37, 56–57, 79–80, 92–99, 107–115
jws.py	42	27	36%	35–60, 76–99
sd_jws.py	42	27	36%	36–61, 78–101
app/services
acapy_ledger.py	61	12	80%	110–111, 124–140, 196–197
acapy_wallet.py	39	4	90%	60–61, 97–98
revocation_registry.py	132	12	91%	317–321, 349, 359–361, 391–395, 420–425
webhooks.py	27	18	33%	17–25, 29–39
websocket.py	51	41	20%	19–22, 29–36, 47–91
app/services/event_handling
websocket_manager.py	73	26	64%	64–68, 87–90, 97–108, 115–125, 139
app/services/issuer
acapy_issuer_v1.py	92	14	85%	36, 76–110, 213–214
acapy_issuer_v2.py	106	22	79%	60–63, 87–127, 173, 235–236, 263
app/services/onboarding
tenants.py	58	44	24%	30–97, 107–137
verifier.py	37	3	92%	67, 83–87
app/services/onboarding/util
register_issuer_did.py	86	3	97%	100–102
set_endorser_metadata.py	69	37	46%	28–30, 50–52, 76–78, 109–128, 140–149, 161–172, 185–197
app/services/trust_registry
actors.py	107	9	92%	94–99, 109, 208–209, 211–216, 281–284
schemas.py	49	4	92%	56–61, 91–96
app/services/trust_registry/util
actor.py	31	2	94%	26–27
issuer.py	23	4	83%	39–40, 48–49
app/tests/e2e
conftest.py	23	5	78%	43–51
test_jsonld.py	59	16	73%	133–168
test_tenants.py	334	15	96%	167, 211–212, 240, 665, 699–700, 709–710, 719–720, 732–733, 742–743
test_wallet_dids.py	67	10	85%	92–107
app/tests/e2e/issuer
test_save_exchange_record.py	60	1	98%	142
app/tests/exception_handling
test_handle_model_with_validation.py	23	1	96%	22
app/tests/fixtures
credentials.py	57	1	98%	156
member_acapy_clients.py	36	4	89%	47–50, 73–74
member_connections.py	43	8	81%	80–91, 130–141
member_wallets.py	61	15	75%	29–34, 49–54, 69–74, 89–94, 111–118
app/tests/services
test_revocation_registry.py	135	2	99%	73, 106
app/tests/services/issuer
test_issuer.py	161	2	99%	316–319
app/tests/util
connections.py	85	26	69%	112–131, 140–157, 174–183, 238–260
ledger.py	49	10	80%	34, 42, 54, 62–66, 76, 82
regression_testing.py	38	17	55%	39, 47–74, 80–87
sse_listener.py	41	8	80%	50–55, 79–84
trust_registry.py	29	3	90%	24, 27–28
webhooks.py	45	4	91%	19, 74–77, 100
app/util
acapy_issuer_utils.py	18	1	94%	22
acapy_verifier_utils.py	137	5	96%	108–111, 189–192, 269
credentials.py	13	3	77%	11, 16, 19
retry_method.py	36	15	58%	20–35, 76–77, 91–103
tenants.py	45	17	62%	24–29, 44–45, 52–59, 90–91, 97, 124
endorser/services
endorsement_processor.py	137	6	96%	90, 152–162
webhooks/models
conversions.py	63	6	90%	70, 83, 89, 110, 145, 164
webhooks/services
acapy_events_processor.py	186	22	88%	98, 161–171, 219–223, 251, 279–280, 308–312, 325–329, 354–367
billing_manager.py	175	4	98%	91, 98–99, 132
sse_manager.py	235	36	85%	153, 155–168, 206–216, 245–246, 259–273, 328–332, 338–341, 343–346, 371–372, 415–417, 451, 462–463
webhooks_redis_service.py	140	19	86%	70, 237–238, 354, 378–398, 411–422
webhooks/tests/services
test_sse_manager.py	180	3	98%	211–212, 218
webhooks/web/routers
sse.py	102	3	97%	168–171
TOTAL	12983	971	93%

Tests	Skipped	Failures	Errors	Time
855	8 💤	0 ❌	0 🔥	12m 10s ⏱️

github-actions · 2024-05-02T13:49:39Z

Coverage Report

File	Stmts	Miss	Cover	Missing
app/routes
connections.py	60	39	35%	32–48, 64–76, 113–138, 159–173, 188–199
definitions.py	188	92	51%	76–137, 170–171, 238–254, 269–275, 296–305, 328–329, 346–348, 391–445, 472–473, 517–597, 605–624
issuer.py	173	38	78%	92, 128, 167–169, 198, 234–236, 244, 261, 360–370, 401–412, 445–476, 517, 530, 562
jsonld.py	60	47	22%	23–93, 104–137
messaging.py	24	11	54%	32–41, 61–71
oob.py	46	28	39%	27–68, 79–92, 116–127
verifier.py	147	33	78%	64–66, 71, 109–111, 116, 158, 166–168, 173, 207–212, 218–220, 270–272, 278, 311–313, 318, 348–350, 384–386
webhooks.py	16	4	75%	32–36, 57–61
websocket_endpoint.py	23	8	65%	24–25, 37–42, 54–57, 70–76
app/routes/wallet
credentials.py	77	52	32%	32–45, 54–66, 75–86, 95–109, 120–136, 148–162, 171–183, 192–203
dids.py	76	22	71%	28–37, 56–57, 79–80, 92–99, 107–115
jws.py	42	27	36%	35–60, 76–99
sd_jws.py	42	27	36%	36–61, 78–101
app/services
acapy_ledger.py	61	12	80%	110–111, 124–140, 196–197
acapy_wallet.py	39	4	90%	60–61, 97–98
revocation_registry.py	132	12	91%	317–321, 349, 359–361, 391–395, 420–425
webhooks.py	27	18	33%	17–25, 29–39
websocket.py	51	41	20%	19–22, 29–36, 47–91
app/services/event_handling
websocket_manager.py	73	26	64%	64–68, 87–90, 97–108, 115–125, 139
app/services/issuer
acapy_issuer_v1.py	92	14	85%	36, 76–110, 213–214
acapy_issuer_v2.py	106	22	79%	60–63, 87–127, 173, 235–236, 263
app/services/onboarding
tenants.py	58	44	24%	30–97, 107–137
verifier.py	37	3	92%	67, 83–87
app/services/onboarding/util
register_issuer_did.py	86	3	97%	100–102
set_endorser_metadata.py	69	37	46%	28–30, 50–52, 76–78, 109–128, 140–149, 161–172, 185–197
app/services/trust_registry
actors.py	107	9	92%	94–99, 109, 208–209, 211–216, 281–284
schemas.py	49	4	92%	56–61, 91–96
app/services/trust_registry/util
actor.py	31	2	94%	26–27
issuer.py	23	4	83%	39–40, 48–49
app/tests/e2e
conftest.py	23	5	78%	43–51
test_jsonld.py	59	16	73%	133–168
test_tenants.py	334	15	96%	167, 211–212, 240, 665, 699–700, 709–710, 719–720, 732–733, 742–743
test_wallet_dids.py	67	10	85%	92–107
app/tests/e2e/issuer
test_save_exchange_record.py	60	1	98%	142
app/tests/exception_handling
test_handle_model_with_validation.py	23	1	96%	22
app/tests/fixtures
credentials.py	57	1	98%	156
definitions.py	66	26	61%	29–50, 64–65, 94–124, 143–144
member_acapy_clients.py	36	4	89%	47–50, 73–74
member_connections.py	43	8	81%	80–91, 130–141
member_wallets.py	61	15	75%	29–34, 49–54, 69–74, 89–94, 111–118
app/tests/services
test_revocation_registry.py	135	2	99%	73, 106
app/tests/services/issuer
test_issuer.py	161	2	99%	316–319
app/tests/util
connections.py	85	26	69%	112–131, 140–157, 174–183, 238–260
ledger.py	49	10	80%	34, 42, 54, 62–66, 76, 82
regression_testing.py	38	17	55%	39, 47–74, 80–87
sse_listener.py	41	8	80%	50–55, 79–84
trust_registry.py	29	3	90%	24, 27–28
webhooks.py	45	4	91%	19, 74–77, 100
app/util
acapy_issuer_utils.py	18	1	94%	22
acapy_verifier_utils.py	137	5	96%	108–111, 189–192, 269
credentials.py	13	3	77%	11, 16, 19
retry_method.py	36	15	58%	20–35, 76–77, 91–103
tenants.py	45	17	62%	24–29, 44–45, 52–59, 90–91, 97, 124
endorser/services
endorsement_processor.py	137	6	96%	90, 152–162
webhooks/models
conversions.py	63	6	90%	70, 83, 89, 110, 145, 164
webhooks/services
acapy_events_processor.py	186	22	88%	98, 161–171, 219–223, 251, 279–280, 308–312, 325–329, 354–367
billing_manager.py	175	4	98%	91, 98–99, 132
sse_manager.py	235	36	85%	153, 155–168, 206–216, 245–246, 259–273, 328–332, 338–341, 343–346, 371–372, 415–417, 451, 462–463
webhooks_redis_service.py	140	19	86%	70, 237–238, 354, 378–398, 411–422
webhooks/tests/services
test_sse_manager.py	180	3	98%	211–212, 218
webhooks/web/routers
sse.py	102	3	97%	168–171
TOTAL	13008	997	92%

Tests	Skipped	Failures	Errors	Time
855	8 💤	0 ❌	0 🔥	14m 20s ⏱️

…utils module

…invite

app/tests/util/connections.py

…connections

github-actions · 2024-05-06T15:00:28Z

Coverage Report

File	Stmts	Miss	Cover	Missing
app/routes
connections.py	60	39	35%	32–48, 64–76, 113–138, 159–173, 188–199
definitions.py	188	92	51%	76–137, 170–171, 238–254, 269–275, 296–305, 328–329, 346–348, 391–445, 472–473, 517–597, 605–624
issuer.py	173	38	78%	92, 128, 167–169, 198, 234–236, 244, 261, 360–370, 401–412, 445–476, 517, 530, 562
jsonld.py	60	47	22%	23–93, 104–137
messaging.py	24	11	54%	32–41, 61–71
oob.py	46	28	39%	27–68, 79–92, 116–127
verifier.py	147	33	78%	64–66, 71, 109–111, 116, 158, 166–168, 173, 207–212, 218–220, 270–272, 278, 311–313, 318, 348–350, 384–386
webhooks.py	16	4	75%	32–36, 57–61
websocket_endpoint.py	23	8	65%	24–25, 37–42, 54–57, 70–76
app/routes/wallet
credentials.py	77	52	32%	32–45, 54–66, 75–86, 95–109, 120–136, 148–162, 171–183, 192–203
dids.py	76	22	71%	28–37, 56–57, 79–80, 92–99, 107–115
jws.py	42	27	36%	35–60, 76–99
sd_jws.py	42	27	36%	36–61, 78–101
app/services
acapy_ledger.py	61	12	80%	110–111, 124–140, 196–197
acapy_wallet.py	39	4	90%	60–61, 97–98
revocation_registry.py	132	12	91%	317–321, 349, 359–361, 391–395, 420–425
webhooks.py	27	18	33%	17–25, 29–39
websocket.py	51	41	20%	19–22, 29–36, 47–91
app/services/event_handling
websocket_manager.py	73	26	64%	64–68, 87–90, 97–108, 115–125, 139
app/services/issuer
acapy_issuer_v1.py	92	14	85%	36, 76–110, 213–214
acapy_issuer_v2.py	106	22	79%	60–63, 87–127, 173, 235–236, 263
app/services/onboarding
tenants.py	58	44	24%	30–97, 107–137
verifier.py	37	3	92%	67, 83–87
app/services/onboarding/util
register_issuer_did.py	86	3	97%	100–102
set_endorser_metadata.py	69	37	46%	28–30, 50–52, 76–78, 109–128, 140–149, 161–172, 185–197
app/services/trust_registry
actors.py	107	9	92%	94–99, 109, 208–209, 211–216, 281–284
schemas.py	49	4	92%	56–61, 91–96
app/services/trust_registry/util
actor.py	31	2	94%	26–27
issuer.py	23	4	83%	39–40, 48–49
app/tests/e2e
conftest.py	23	5	78%	43–51
test_jsonld.py	59	16	73%	134–169
test_tenants.py	334	15	96%	167, 211–212, 240, 665, 699–700, 709–710, 719–720, 732–733, 742–743
test_wallet_credentials.py	30	1	97%	55
test_wallet_dids.py	67	10	85%	92–107
app/tests/e2e/issuer
test_save_exchange_record.py	71	1	99%	162
app/tests/exception_handling
test_handle_model_with_validation.py	23	1	96%	22
app/tests/fixtures
credentials.py	63	1	98%	169
definitions.py	66	26	61%	29–50, 64–65, 94–124, 143–144
member_acapy_clients.py	36	4	89%	47–50, 73–74
member_connections.py	43	8	81%	80–91, 130–141
member_wallets.py	61	15	75%	29–34, 49–54, 69–74, 89–94, 111–118
app/tests/services
test_revocation_registry.py	135	2	99%	73, 106
app/tests/services/issuer
test_issuer.py	161	2	99%	316–319
app/tests/util
connections.py	86	27	69%	114–139, 148–165, 182–191, 246–263
ledger.py	49	10	80%	34, 42, 54, 62–66, 76, 82
regression_testing.py	38	17	55%	39, 47–74, 80–87
sse_listener.py	41	8	80%	50–55, 79–84
trust_registry.py	29	3	90%	24, 27–28
webhooks.py	45	4	91%	19, 74–77, 100
app/util
acapy_issuer_utils.py	18	1	94%	22
acapy_verifier_utils.py	137	5	96%	108–111, 189–192, 269
credentials.py	13	3	77%	11, 16, 19
retry_method.py	36	15	58%	20–35, 76–77, 91–103
tenants.py	45	17	62%	24–29, 44–45, 52–59, 90–91, 97, 124
endorser/services
endorsement_processor.py	137	6	96%	90, 152–162
webhooks/models
conversions.py	63	6	90%	70, 83, 89, 110, 145, 164
webhooks/services
acapy_events_processor.py	186	22	88%	98, 161–171, 219–223, 251, 279–280, 308–312, 325–329, 354–367
billing_manager.py	175	4	98%	91, 98–99, 132
sse_manager.py	235	36	85%	153, 155–168, 206–216, 245–246, 259–273, 328–332, 338–341, 343–346, 371–372, 415–417, 451, 462–463
webhooks_redis_service.py	140	19	86%	70, 237–238, 354, 378–398, 411–422
webhooks/tests/services
test_sse_manager.py	180	3	98%	211–212, 218
webhooks/web/routers
sse.py	102	3	97%	168–171
TOTAL	13037	999	92%

Tests	Skipped	Failures	Errors	Time
855	8 💤	0 ❌	0 🔥	14m 9s ⏱️

sonarqubecloud · 2024-05-07T13:01:26Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud

github-actions · 2024-05-07T14:28:47Z

Coverage Report

File	Stmts	Miss	Cover	Missing
app/routes
connections.py	60	39	35%	32–48, 64–76, 113–138, 159–173, 188–199
definitions.py	188	92	51%	76–137, 170–171, 238–254, 269–275, 296–305, 328–329, 346–348, 391–445, 472–473, 517–597, 605–624
issuer.py	173	38	78%	92, 128, 167–169, 198, 234–236, 244, 261, 360–370, 401–412, 445–476, 517, 530, 562
jsonld.py	60	47	22%	23–93, 104–137
messaging.py	24	11	54%	32–41, 61–71
oob.py	46	28	39%	27–68, 79–92, 116–127
verifier.py	147	33	78%	64–66, 71, 109–111, 116, 158, 166–168, 173, 207–212, 218–220, 270–272, 278, 311–313, 318, 348–350, 384–386
webhooks.py	16	4	75%	32–36, 57–61
websocket_endpoint.py	23	8	65%	24–25, 37–42, 54–57, 70–76
app/routes/wallet
credentials.py	77	52	32%	32–45, 54–66, 75–86, 95–109, 120–136, 148–162, 171–183, 192–203
dids.py	76	22	71%	28–37, 56–57, 79–80, 92–99, 107–115
jws.py	42	27	36%	35–60, 76–99
sd_jws.py	42	27	36%	36–61, 78–101
app/services
acapy_ledger.py	61	12	80%	110–111, 124–140, 196–197
acapy_wallet.py	39	4	90%	60–61, 97–98
revocation_registry.py	132	12	91%	317–321, 349, 359–361, 391–395, 420–425
webhooks.py	27	18	33%	17–25, 29–39
websocket.py	51	41	20%	19–22, 29–36, 47–91
app/services/event_handling
websocket_manager.py	73	26	64%	64–68, 87–90, 97–108, 115–125, 139
app/services/issuer
acapy_issuer_v1.py	92	14	85%	36, 76–110, 213–214
acapy_issuer_v2.py	106	22	79%	60–63, 87–127, 173, 235–236, 263
app/services/onboarding
tenants.py	58	44	24%	30–97, 107–137
verifier.py	37	3	92%	67, 83–87
app/services/onboarding/util
register_issuer_did.py	86	3	97%	100–102
set_endorser_metadata.py	69	37	46%	28–30, 50–52, 76–78, 109–128, 140–149, 161–172, 185–197
app/services/trust_registry
actors.py	107	9	92%	94–99, 109, 208–209, 211–216, 281–284
schemas.py	49	4	92%	56–61, 91–96
app/services/trust_registry/util
actor.py	31	2	94%	26–27
issuer.py	23	4	83%	39–40, 48–49
app/tests/e2e
conftest.py	23	5	78%	43–51
test_jsonld.py	59	16	73%	134–169
test_tenants.py	334	15	96%	167, 211–212, 240, 665, 699–700, 709–710, 719–720, 732–733, 742–743
test_wallet_credentials.py	30	1	97%	55
test_wallet_dids.py	67	10	85%	92–107
app/tests/e2e/issuer
test_save_exchange_record.py	72	1	99%	166
app/tests/exception_handling
test_handle_model_with_validation.py	23	1	96%	22
app/tests/fixtures
credentials.py	65	1	98%	171
definitions.py	66	26	61%	29–50, 64–65, 94–124, 143–144
member_acapy_clients.py	36	4	89%	47–50, 73–74
member_connections.py	43	8	81%	80–91, 130–141
member_wallets.py	61	15	75%	29–34, 49–54, 69–74, 89–94, 111–118
app/tests/services
test_revocation_registry.py	135	2	99%	73, 106
app/tests/services/issuer
test_issuer.py	161	2	99%	316–319
app/tests/util
connections.py	86	27	69%	114–139, 148–165, 182–191, 246–263
ledger.py	49	10	80%	34, 42, 54, 62–66, 76, 82
regression_testing.py	38	17	55%	39, 47–74, 80–87
sse_listener.py	41	8	80%	50–55, 79–84
trust_registry.py	29	1	97%	24
webhooks.py	45	4	91%	19, 74–77, 100
app/util
acapy_issuer_utils.py	18	1	94%	22
acapy_verifier_utils.py	137	5	96%	108–111, 189–192, 269
credentials.py	13	3	77%	11, 16, 19
retry_method.py	36	15	58%	20–35, 76–77, 91–103
tenants.py	45	17	62%	24–29, 44–45, 52–59, 90–91, 97, 124
endorser/services
endorsement_processor.py	137	6	96%	90, 152–162
webhooks/models
conversions.py	63	6	90%	70, 83, 89, 110, 145, 164
webhooks/services
acapy_events_processor.py	186	22	88%	98, 161–171, 219–223, 251, 279–280, 308–312, 325–329, 354–367
billing_manager.py	175	4	98%	91, 98–99, 132
sse_manager.py	235	36	85%	153, 155–168, 206–216, 245–246, 259–273, 328–332, 338–341, 343–346, 371–372, 415–417, 451, 462–463
webhooks_redis_service.py	140	19	86%	70, 237–238, 354, 378–398, 411–422
webhooks/tests/services
test_sse_manager.py	180	3	98%	211–212, 218
webhooks/web/routers
sse.py	102	3	97%	168–171
TOTAL	13059	997	92%

Tests	Skipped	Failures	Errors	Time
855	8 💤	0 ❌	0 🔥	13m 51s ⏱️

github-advanced-security bot found potential problems Apr 25, 2024

View reviewed changes

ff137 self-assigned this Apr 29, 2024

ff137 added the tests label Apr 29, 2024

ff137 force-pushed the feat/regression_tests branch from 27754ee to f8ae589 Compare April 30, 2024 12:20

github-advanced-security bot found potential problems Apr 30, 2024

View reviewed changes

ff137 marked this pull request as ready for review April 30, 2024 13:34

ff137 had a problem deploying to dev April 30, 2024 13:35 — with GitHub Actions Failure

ff137 temporarily deployed to dev April 30, 2024 13:56 — with GitHub Actions Inactive

ff137 temporarily deployed to dev May 2, 2024 13:28 — with GitHub Actions Inactive

ff137 had a problem deploying to dev May 2, 2024 13:58 — with GitHub Actions Failure

ff137 added 18 commits May 6, 2024 12:00

🎨 remove unused import

064be72

✨ implement regression test tenant fixtures

303c7c7

✨ more fixtures

f3018dd

🚧 initial revoke test with regression fixtures

7ccaac5

🔥 delete unused fixtures

0aacc1a

🎨 🚚 Deduplicate methods from ecosystem_connections and move to own …

1d9d19f

…utils module

🎨 🚚 Implement test_mode parametrization, and deduplicate methods

6fa5002

✨ Implement test_mode parametrization

7167148

✨ Define RegressionTestConfig and regression test functionality

b555c93

🔥 delete old work since we're reworking how regression testing is done

9f2bbf8

🎨 rename module

6b523a8

🎨 🚚 move fixtures to own module

7052b82

🎨 test_mode as fixture

041a961

🎨 filter connections by state completed

250742d

🎨 print num connections when failing

eb98a74

🎨 fetch access token for tenant

be33fd1

🎨

767ba24

🎨 Replace DidKey with str. It was not being used

c9a509a

ff137 added 4 commits May 6, 2024 14:10

✅ fix assertions to allow for regression testing

2542d68

🎨 fail webhook check faster

2934b5b

🐛 fix retry lookback duration

716701b

✅ fix re-using of connections established through trust registry oob …

8d72990

…invite

ff137 force-pushed the feat/regression_tests branch from 50e342d to 8d72990 Compare May 6, 2024 12:11

ff137 had a problem deploying to dev May 6, 2024 12:12 — with GitHub Actions Failure

github-advanced-security bot found potential problems May 6, 2024

View reviewed changes

app/tests/util/connections.py Fixed Show fixed Hide fixed

ff137 added 7 commits May 6, 2024 15:41

🎨 replace assert_that usage

f9659a4

✅ fix re-using of connections with manual creating and deleting temp …

9beb400

…connections

✅ fix after timeout change

dcf6b3c

🎨

5c37fe2

✅ fix re-using of connections with manual creating and deleting temp …

8ab4744

…connections

🎨

947a561

✅ add restriction that credential must be of the revocable cred def

c8837dc

ff137 temporarily deployed to dev May 6, 2024 14:39 — with GitHub Actions Inactive

ff137 added 6 commits May 6, 2024 20:30

✅ use thread_id instead of connection_id, for regression test certainty

741fba9

✅ cater for regression testing by creating temp connection for test

4b17bce

✅ clean up temp connection records

4ada4e8

🎨 change _name to name

c29cc52

🎨 remove outdated comment

f631cd1

🙈 skip select tests when running in regression mode

09f0525

ff137 had a problem deploying to dev May 7, 2024 13:01 — with GitHub Actions Failure

ff137 changed the title ~~🧪 Feat/regression_tests~~ 🧪 Initial regression testing framework May 7, 2024

ff137 temporarily deployed to dev May 7, 2024 14:08 — with GitHub Actions Inactive

ff137 merged commit 75157b8 into development May 7, 2024
44 checks passed

ff137 deleted the feat/regression_tests branch May 7, 2024 18:24

ff137 mentioned this pull request May 9, 2024

⬆️ Upgrade ACA-Py version to 0.12.1 #758

Merged

6 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

🧪 Initial regression testing framework #780

🧪 Initial regression testing framework #780

ff137 commented Apr 25, 2024 •

edited

Loading

github-actions bot commented Apr 30, 2024

github-actions bot commented May 2, 2024

github-actions bot commented May 6, 2024

sonarqubecloud bot commented May 7, 2024

github-actions bot commented May 7, 2024

🧪 Initial regression testing framework #780

🧪 Initial regression testing framework #780

Conversation

ff137 commented Apr 25, 2024 • edited Loading

github-actions bot commented Apr 30, 2024

github-actions bot commented May 2, 2024

github-actions bot commented May 6, 2024

sonarqubecloud bot commented May 7, 2024

Quality Gate passed

github-actions bot commented May 7, 2024

ff137 commented Apr 25, 2024 •

edited

Loading