Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Permit more temp files in data path #74921

Merged

Conversation

DaveCTurner
Copy link
Contributor

When a node starts up it creates, then immediately deletes, files called
.es_temp_file.tmp and .es_temp_file.final. If the node is killed at
exactly the wrong moment then we may leave one of these files on disk.

When upgrading from 7.x to 8.0 we reorganise the contents of the data
path, but bail out if we encounter anything unexpected to avoid causing
damage in unexpected situations. However we don't consider the temporary
files mentioned above as expected, so their existence will cause an
upgrade to fail.

This commit adjusts the logic to permit these files to exist during the
ugprade.

Closes #74908

When a node starts up it creates, then immediately deletes, files called
`.es_temp_file.tmp` and `.es_temp_file.final`. If the node is killed at
exactly the wrong moment then we may leave one of these files on disk.

When upgrading from 7.x to 8.0 we reorganise the contents of the data
path, but bail out if we encounter anything unexpected to avoid causing
damage in unexpected situations. However we don't consider the temporary
files mentioned above as expected, so their existence will cause an
upgrade to fail.

This commit adjusts the logic to permit these files to exist during the
ugprade.

Closes elastic#74908
@DaveCTurner DaveCTurner added >test Issues or PRs that are addressing/adding tests :Core/Infra/Core Core issues without another label v8.0.0 labels Jul 5, 2021
@elasticmachine elasticmachine added the Team:Core/Infra Meta label for core/infra team label Jul 5, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (Team:Core/Infra)

Copy link
Member

@tlrx tlrx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DaveCTurner DaveCTurner merged commit 721917c into elastic:master Jul 5, 2021
@DaveCTurner DaveCTurner deleted the 2021-07-05-permit-more-temp-files branch July 5, 2021 14:17
rjernst added a commit to rjernst/elasticsearch that referenced this pull request Oct 6, 2021
This reverts commit 2dc796a.

The revert was mostly clean, but it required adjusting
NodeEnvironment.upgradeLegacyNodeFolders to retain elastic#74921.

relates elastic#78525
relates elastic#71205
rjernst added a commit that referenced this pull request Oct 7, 2021
This reverts commit 2dc796a.

The revert was mostly clean, but it required adjusting
NodeEnvironment.upgradeLegacyNodeFolders to retain #74921.

relates #78525
relates #71205
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Core/Infra/Core Core issues without another label Team:Core/Infra Meta label for core/infra team >test Issues or PRs that are addressing/adding tests v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

"unexpected file/folder encountered during data folder upgrade"
4 participants