Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-11594][tests] Remove TaskManagerRegistrationTest #7725

Closed
wants to merge 9 commits into from

Conversation

GJL
Copy link
Member

@GJL GJL commented Feb 17, 2019

What is the purpose of the change

This removes TaskManagerRegistrationTest. Tests were mostly covered already.

Test in TaskManagerRegistrationTest Covered by
testSimpleRegistration TaskExecutorTest#testImmediatelyRegistersIfLeaderIsKnown, TaskExecutorTest#testOfferSlotToJobMasterAfterTimeout, TaskExecutorTest#testHeartbeatTimeoutWithJobManager, ResourceManagerTaskExecutorTest#testRegisterTaskExecutor, TaskExecutorToResourceManagerConnectionTest
testDelayedRegistration RetryingRegistrationTest#testRetryConnectOnFailure
testShutdownAfterRegistrationDurationExpired TaskExecutor#testMaximumRegistrationDuration, TaskManagerRunnerTest#testShouldShutdownIfRegistrationWithJobManagerFails, TaskManagerRunnerTest#testShouldShutdownOnFatalError
testTaskManagerResumesConnectAfterRefusedRegistration RetryingRegistrationTest#testDecline
testTaskManagerNoExcessiveRegistrationMessages Backoff time is tested in several tests in RetryingRegistrationTest
testTaskManagerResumesConnectAfterJobManagerFailure TaskExecutorTest#testHeartbeatTimeoutWithJobManager, TaskExecutorTest#testHeartbeatTimeoutWithResourceManager, ZooKeeperLeaderElectionITCase#testJobExecutionOnClusterWithLeaderChange
testCheckForValidRegistrationSessionIDs TM does not have the logic under test anymore. It is enough to test that the TM connects to the leading JM (e.g., TaskExecutorTest#testJobLeaderDetection)

Brief change log

  • See commits

Verifying this change

This change is already covered by existing tests, such as TaskExecutorTest, RetryingRegistrationTest.

This change added tests and can be verified as follows:

  • Added unit test TaskExecutorToResourceManagerConnection to test that the correct arguments are passed in the TM -> RM registration.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
  • The serializers: (yes / no / don't know)
  • The runtime per-record code paths (performance sensitive): (yes / no / don't know)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
  • The S3 file system connector: (yes / no / don't know)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@flinkbot
Copy link
Collaborator

Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community
to review your pull request. We will use this comment to track the progress of the review.

Review Progress

  • ❌ 1. The [description] looks good.
  • ❌ 2. There is [consensus] that the contribution should go into to Flink.
  • ❔ 3. Needs [attention] from.
  • ❌ 4. The change fits into the overall [architecture].
  • ❌ 5. Overall code [quality] is good.

Please see the Pull Request Review Guide for a full explanation of the review process.

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot approve description to approve the 1st aspect (similarly, it also supports the consensus, architecture and quality keywords)
  • @flinkbot approve all to approve all aspects
  • @flinkbot attention @username1 [@username2 ..] to require somebody's attention
  • @flinkbot disapprove architecture to remove an approval

Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for opening this PR @GJL. LGTM. The only thing missing is the actual removal of the TaskManagerRegistrationTest. After adding this, +1 for merging.

@flinkbot approve all.

},
rpcService.getExecutor());

// upon failure, retry, unless this is cancelled
resourceManagerAcceptFuture.whenCompleteAsync(
rpcGatewayAcceptFuture.whenCompleteAsync(
(Void v, Throwable failure) -> {
if (failure != null && !canceled) {
final Throwable strippedFailure = ExceptionUtils.stripCompletionException(failure);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good refactorings!

@GJL
Copy link
Member Author

GJL commented Feb 18, 2019

Thanks for the review. I added a commit to remove TaskManagerRegistrationTest, and rebased to latest master. Merging as soon as build is green.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants