Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use top-level file in write benchmark #613

Merged
merged 1 commit into from
Nov 18, 2023

Conversation

passaro
Copy link
Contributor

@passaro passaro commented Nov 17, 2023

The write throughput benchmarks were failing when running the second iteration because fio would not re-create the nested path for the benchmark file. This appears to have started since #584. Further investigation required to determine if there is an issue with Mountpoint.
This change only unblocks the benchmarks by configuring fio to use a file at the top-level in the mount directory, which was likely the intention in the first place (fio's --filename path is relative to --directory).


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

Signed-off-by: Alessandro Passaro <[email protected]>
@passaro passaro temporarily deployed to PR integration tests November 17, 2023 20:31 — with GitHub Actions Inactive
@passaro passaro temporarily deployed to PR integration tests November 17, 2023 20:31 — with GitHub Actions Inactive
@passaro passaro temporarily deployed to PR integration tests November 17, 2023 20:31 — with GitHub Actions Inactive
@passaro passaro temporarily deployed to PR integration tests November 17, 2023 20:31 — with GitHub Actions Inactive
@passaro passaro added the performance PRs to run benchmarks on label Nov 17, 2023
@passaro passaro marked this pull request as ready for review November 18, 2023 00:43
Copy link
Member

@jamesbornholt jamesbornholt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From the log, it looks like this is implicit directories working as intended: once the last object in the directory was unlinked, the directory went away, but fio doesn't try to recreate the entire directory hierarchy, just the file. I assume it worked before #584 because the local directory's dentry was cached forever by the kernel, so it never needed to re-lookup the directory to do the creat.

@jamesbornholt jamesbornholt added this pull request to the merge queue Nov 18, 2023
Merged via the queue into awslabs:main with commit aeb5574 Nov 18, 2023
20 checks passed
@passaro passaro deleted the benchmarks branch November 18, 2023 08:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance PRs to run benchmarks on
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants