Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache shows 0% after file is read using fuse client from NFS UFS #14282

Closed
pvaldria opened this issue Oct 19, 2021 · 4 comments
Closed

Cache shows 0% after file is read using fuse client from NFS UFS #14282

pvaldria opened this issue Oct 19, 2021 · 4 comments
Assignees
Labels
area-fuse Alluxio fuse integration priority-medium stale The PR/Issue does not have recent activities and will be closed automatically type-bug This issue is about a bug

Comments

@pvaldria
Copy link

Alluxio Version:
alluxio-2.6.2]

Describe the bug
After a file is read using fuse client, alluxio shows its not cached.

To Reproduce

`[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$ time cat /mnt/fuse_client/alluxio-2.6.2-bin.tar.gz > /dev/null

real 22m17.571s
user 0m0.084s
sys 0m1.221s

Waited for 5 mins and then ran the below:

[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$ ./bin/alluxio fs ls /alluxio-2.6.2-bin.tar.gz
-rw-r--r-- opc opc 1859637604 PERSISTED 10-19-2021 15:59:59:389 0% /alluxio-2.6.2-bin.tar.gz
[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$`

Expected behavior
Should show cached 100%

Urgency
Unable to use fuse client.

Are you planning to fix it
Please indicate if you are already working on a PR.

Additional context
Add any other context about the problem here.

Did the same using Native Client and it worked.

`[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$ time ./bin/alluxio fs cat /alluxio-2.6.2-bin.tar.gz > /dev/null

real 0m7.143s
user 0m9.693s
sys 0m1.350s
[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$ ./bin/alluxio fs ls /alluxio-2.6.2-bin.tar.gz
-rw-r--r-- opc opc 1859637604 PERSISTED 10-19-2021 15:59:59:389 100% /alluxio-2.6.2-bin.tar.gz
[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$`

@pvaldria pvaldria added the type-bug This issue is about a bug label Oct 19, 2021
@yuzhu yuzhu added area-fuse Alluxio fuse integration priority-medium labels Oct 19, 2021
@yuzhu yuzhu assigned yuzhu and ssz1997 and unassigned yuzhu Oct 19, 2021
@LuQQiu
Copy link
Contributor

LuQQiu commented Oct 19, 2021

@pvaldria how you launch the Alluxio fuse process?
can you share your configuration?

@pvaldria
Copy link
Author

[opc@inst-czyk1-tough-reindeer alluxio-2.6.2]$ cat conf/alluxio-site.properties | grep -v "^#"

alluxio.master.hostname=hpc-node-1

alluxio.master.mount.table.root.ufs=/mnt/iad-ad-3-fss

alluxio.user.file.metadata.sync.interval=5

alluxio.fuse.user.group.translation.enabled=true

alluxio.worker.fuse.enabled=true
alluxio.worker.fuse.mount.alluxio.path=/
alluxio.worker.fuse.mount.point=/mnt/fuse_client
alluxio.worker.fuse.mount.options=allow_other,kernel_cache,entry_timeout=7200,attr_timeout=7200

alluxio.fuse.cached.paths.max=500

alluxio.user.metadata.cache.enabled=true
alluxio.user.metadata.cache.max.size=1000000
alluxio.user.metadata.cache.expiration.time=1h

alluxio.user.update.file.accesstime.disabled=true
alluxio.worker.block.master.client.pool.size=1024
alluxio.user.block.master.client.pool.gc.threshold=1h
alluxio.user.block.master.client.pool.size.max=1024
alluxio.user.file.master.client.pool.size.max=1024
alluxio.user.block.worker.client.pool.max=10240

@pvaldria
Copy link
Author

pvaldria commented Nov 3, 2021

I was able to fix the issue by removing all the below settings and restarting Alluxio on all nodes.

Removed:

alluxio.fuse.cached.paths.max=500

alluxio.user.metadata.cache.enabled=true
alluxio.user.metadata.cache.max.size=1000000
alluxio.user.metadata.cache.expiration.time=1h

alluxio.user.update.file.accesstime.disabled=true
alluxio.worker.block.master.client.pool.size=1024
alluxio.user.block.master.client.pool.gc.threshold=1h
alluxio.user.block.master.client.pool.size.max=1024
alluxio.user.file.master.client.pool.size.max=1024
alluxio.user.block.worker.client.pool.max=10240

@github-actions
Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale The PR/Issue does not have recent activities and will be closed automatically label Jan 27, 2023
@ssz1997 ssz1997 closed this as completed Jan 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-fuse Alluxio fuse integration priority-medium stale The PR/Issue does not have recent activities and will be closed automatically type-bug This issue is about a bug
Projects
None yet
Development

No branches or pull requests

4 participants