Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] FileUtils.splitFileIntoChunks casts file size to int resulting in negative number for files > 2GB #3197

Open
maxlepikhin opened this issue Nov 3, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@maxlepikhin
Copy link
Contributor

What is the bug?
Model zip file for ONNX Llama 3.2 1b Instruct is about 2.8GB, which is under 4GB limit. Register model call succeeds, but the registration task never gets to COMPLETED state.

The model zip file is successfully downloaded to data/ml_cache/models_cache/register/task-id/version/llama-3.2-1b_onnx.zip. The chunking of the model file casts model file size to int making it a negative number in FileUtils. This results in an empty list of chunks.

How can one reproduce the bug?
Use model zip file greater than 2GB.

What is the expected behavior?
A clear and concise description of what you expected to happen.

What is your host/environment?

  • OS: Ubuntu 24.04

Do you have any screenshots?
N/A

Do you have any additional context?
Log shows download succeeded and not any other info about the task:

[2024-11-03T13:08:59,414][INFO ][o.o.m.m.MLModelManager   ] [user-laptop] create new model meta doc lw-l85IBso2zKYtHJdUD for register model task lg-l85IBso2zKYtHJNW_
[2024-11-03T13:08:59,415][DEBUG][o.o.m.e.ModelHelper      ] [user-laptop] download model to file /home/user/search/opensearch/opensearch-2.15.0/data/ml_cache/models_cache/register/lw-l85IBso2zKYtHJdUD/6/llama-3.2-1b_onnx.zip
Downloading:   0% || llama-3.2-1b_onnx.zip
Downloading:   0% || llama-3.2-1b_onnx.zipng:   0% || llama-3.2-1b_onnx.zip
Downloading: 100% |████████████████████████████████████████| llama-3.2-1b_onnx.zipg:   0% || llama-3.2-1b_onnx.zip
[2024-11-03T13:10:18,881][INFO ][o.o.j.s.JobSweeper       ] [user-laptop] Running full sweep
[2024-11-03T13:15:18,882][INFO ][o.o.j.s.JobSweeper       ] [user-laptop] Running full sweep

The task remains in CREATED state indefinitely.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: In Progress
Development

No branches or pull requests

2 participants