Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

High amount of Disk write requests in 8.0.4 #8272

Open
nitmeare opened this issue Nov 24, 2024 · 4 comments
Open

High amount of Disk write requests in 8.0.4 #8272

nitmeare opened this issue Nov 24, 2024 · 4 comments

Comments

@nitmeare
Copy link

nitmeare commented Nov 24, 2024

I found that tribler makes very high amounts of write requests to the disk, sometimes around 400-600KB/s constantly even when all Downloads are stopped this is going on.

image

Upon further investigation with Procmon i found that Tribler is doing thousands of WriteFile Requests per second inside.
C:\Users\clusterfuck\AppData\Roaming.Tribler\8.0\sqlite

image

According to Perfmon around 24.000+ write req/s average:

image

This may wear out some SSDs on the long term, cause higher CPU usage and maybe it is even slowing down the tribler process itself.

So perhaps it would be usefull if someone has a closer look on what is going on there.

@nitmeare nitmeare changed the title relatively high amount of write requests in 8.0.4 High amount of Disk write requests in 8.0.4 Nov 24, 2024
@qstokkink qstokkink added this to the 8.0.5 milestone Nov 24, 2024
@qstokkink
Copy link
Contributor

Thanks for reporting! That is not intended.

Our database (ORM library) should take care of batching writes to your disk to avoid exactly this issue. Perhaps we misconfigured it? We'll check it out.

@synctext
Copy link
Member

synctext commented Nov 24, 2024

Thnx for diving into this! Wow, 24.204 write req/s average 😱😨😱

@qstokkink Please try to reproduce this in the Tribler lab. Hopefully this can be fixed 💪

@qstokkink
Copy link
Contributor

@egbertbouman mitigated the disk writes in #8274 However, my earlier claim..

Our database (ORM library) should take care of batching writes to your disk to avoid exactly this issue.

..shockingly, did not turn out to be true. We will need to make some bigger changes in our own code base to properly solve this issue. Because this issue requires a big refactoring effort, we'll schedule this for the next stable release, 8.1.0.

@qstokkink qstokkink modified the milestones: 8.0.5, 8.1.0 Nov 27, 2024
@absolutep
Copy link

very very high disk usage still persists in version 8.0.7, hanging (freezing) the computer. especially, for torrents above 5 GB.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

4 participants