You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Nov 29, 2023. It is now read-only.
Currently, there is a lot of file I/O happening. After a single program is processed, its usages are written to disk. Once everything is processed, the usages are aggregated. This ensure that in case the program crashes we do not need to start from scratch and allows for parallelization. However, it's still really inefficient.
Alternative solution:
Have workers just return their results and continuously aggregate them. Ensure the program does not crash 🙃.
Currently, there is a lot of file I/O happening. After a single program is processed, its usages are written to disk. Once everything is processed, the usages are aggregated. This ensure that in case the program crashes we do not need to start from scratch and allows for parallelization. However, it's still really inefficient.
Alternative solution:
Have workers just return their results and continuously aggregate them. Ensure the program does not crash 🙃.
Additional Context
The text was updated successfully, but these errors were encountered: