Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Worker report 0 size of block replica to master when highly concurrent access #18705

Open
microbn opened this issue Nov 20, 2024 · 0 comments
Open
Labels
type-bug This issue is about a bug

Comments

@microbn
Copy link

microbn commented Nov 20, 2024

Alluxio Version:
What version of Alluxio are you using?
2.9.3
Describe the bug
A clear and concise description of what the bug is.
in method updateBlockWriter of class UnderFileSystemBlockReader , when method mLocalBlockStore.createBlock exe succeed but mLocalBlockStore.createBlockWriter throw exception because of temp block check , will create 0 byte replica and mBlockWriter is null.
when request end, close UnderFileSystemBlockReader, skip check replica byte because of mBlockWriter is null. then to exe commit block to master, in commitBlock method of DefaultBlockMaster add this replica to block location with only log print.
To Reproduce
Steps to reproduce the behavior (as minimally and precisely as possible)

Expected behavior
A clear and concise description of what you expected to happen.
when check temp block failed,need clean temp block meta

Urgency
Describe the impact and urgency of the bug.
this bug will cause read data fail when hit the corrupt replica.

Are you planning to fix it
Please indicate if you are already working on a PR.
yes, I had fix this and publish to online cluster.
Additional context
Add any other context about the problem here.

@microbn microbn added the type-bug This issue is about a bug label Nov 20, 2024
@microbn microbn changed the title worker report 0 size of block replica when highly concurrent access worker report 0 size of block replica to master when highly concurrent access Nov 20, 2024
@microbn microbn changed the title worker report 0 size of block replica to master when highly concurrent access Worker report 0 size of block replica to master when highly concurrent access Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-bug This issue is about a bug
Projects
None yet
Development

No branches or pull requests

1 participant