Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release Blocker? Disable IPv6 tests when $ZEBRA_SKIP_IPV6_TESTS is set #2405

Merged
merged 8 commits into from
Jun 29, 2021

Conversation

teor2345
Copy link
Contributor

Motivation

Some of Zebra's new network tests fail in our main branch Google Cloud CI, but those failures are hidden due to bug #2403.

We need to fix this bug before we can stop hiding those failures.

Solution

  • disable IPv6 tests when $ZEBRA_SKIP_IPV6_TESTS is set
  • disable more network tests when $ZEBRA_SKIP_NETWORK_TESTS is set

This allows users to disable IPv6 tests in environments where IPv6 is not configured.

Review

@jvff reviewed PR #2277, which introduced these tests. I think this might be urgent, because we don't want to release broken code.

Reviewer Checklist

  • Code implements Specs and Designs
  • Tests for Expected Behaviour
  • Tests for Errors

Follow Up Work

Eventually we'll want to test in IPv6-only and non-standard IPv4 localhost environments.

This allows users to disable IPv6 tests in environments where IPv6 is not
configured.
@teor2345 teor2345 added C-bug Category: This is a bug A-rust Area: Updates to Rust code P-High I-integration-fail Continuous integration fails, including build and test failures labels Jun 28, 2021
@teor2345 teor2345 added this to the 2021 Sprint 12 milestone Jun 28, 2021
@teor2345 teor2345 requested a review from jvff June 28, 2021 08:11
@teor2345 teor2345 self-assigned this Jun 28, 2021
Copy link
Contributor

@jvff jvff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. I added one suggestion that's minor.

zebra-network/src/peer_set/initialize/tests/vectors.rs Outdated Show resolved Hide resolved
jvff
jvff previously approved these changes Jun 28, 2021
teor2345 added 5 commits June 29, 2021 10:15
fastmod '"ZEBRA_SKIP_NETWORK_TESTS"' zebra_test::net::ZEBRA_SKIP_NETWORK_TESTS
fastmod '"ZEBRA_SKIP_IPV6_TESTS"' zebra_test::net::ZEBRA_SKIP_IPV6_TESTS
fastmod --fixed-strings 'env::var_os(zebra_test::net::ZEBRA_SKIP_NETWORK_TESTS).is_some()' 'zebra_test::net::zebra_skip_network_tests()'
fastmod --fixed-strings 'env::var_os(zebra_test::net::ZEBRA_SKIP_IPV6_TESTS).is_some()' 'zebra_test::net::zebra_skip_ipv6_tests()'
zebra-test/src/net.rs Outdated Show resolved Hide resolved
zebrad/tests/acceptance.rs Outdated Show resolved Hide resolved
@teor2345 teor2345 requested a review from jvff June 29, 2021 00:37
@teor2345
Copy link
Contributor Author

This PR is ready for another review.

Since I made a larger change than @jvff might have expected, I'd like another review before we merge.

Copy link
Contributor

@jvff jvff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome! 🎉

@teor2345 teor2345 merged commit 9cb7ee4 into main Jun 29, 2021
@teor2345 teor2345 deleted the stop-assuming-ipv6 branch June 29, 2021 01:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-rust Area: Updates to Rust code C-bug Category: This is a bug I-integration-fail Continuous integration fails, including build and test failures
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants