IOG throws errors, won't work on localhost

[davodogster]

My actions before raising this issue

Deploy Complete:

I'm running cvat and nuctl in WSL2

Expected Behaviour

IOG Works and auto segments

Current Behaviour

Throws these errors:

Some of the nuclio pre trained models inside CVAT have worked for me before so that is not the issue.

Are you able to please fix this?

Cheers,

Sam

EDIT: It throws the same error when I deploy CVAT on localhost 8080 (instead of 7080) I just tried it.

[nmanovic]

@davodogster , could you please send me logs of the IOG container? In the screenshot it is c3121fe...

[davodogster]

@nmanovic Hope this helps. Let me know if you need anymore info.

EDIT: I must note, That container just keeps restarting, as you can probably tell from the log

[nmanovic]

@davodogster , the error is shown in logs:

No such file or directory: .../IOG_PASCAL_SBD.pth

At the same time I see that in your first message the build was successful. Could you please run commands below?

docker exec -it c3121fe bash
cd /opt/nuclio/iog
du -h IOG_PASCAL_SBD.pth
conda activate iog
curl -c ./cookie -s -L "https://drive.google.com/uc?export=download&id=${fileid}"
echo "/download/ {print \$NF}" > confirm_code.awk
curl -Lb ./cookie "https://drive.google.com/uc?export=download&confirm=`awk -f confirm_code.awk ./cookie`&id=${fileid}" -o ${filename}
du -h IOG_PASCAL_SBD.pth

Send all logs after commands above. The code above has to download IOG_PASCAL_SBD.pth from google drive. I believe on your machine it will fail silently.

[davodogster]

Hi @nmanovic

The Container just keeps restarting so I am unable to bash into it. (That was a docker images command above, not docker container ls)

I will note that I had to use the curl "-k" arg for the model download in the .yaml file because otherwise I cannot download the .pth model due to a firewall/block.

Output on container deployment

[nmanovic]

@davodogster , does it mean that you solve the problem using '-k' argument? Unfortunately, firewall is a complex topic. I'm not sure that we can solve it somehow (insecure connection isn't a valid solution for mainstream code). Do you have any common solutions in your mind which will cover your case as well?

[davodogster]

hi @nmanovic I have to use -k to get the curl command to work, and the container to deploy, but it doesn't fix everything because the container just keeps restarting when I deploy it and it gives the error logs that I attached above.

[davodogster]

Hi @nmanovic
Now I can get the container running and not restarting, But in the CVAT tool it still gives the same error as previously.

Nuclio is running here:

There are no logs this time (I checked in docker desktop)

[fjean]

Any news on this issue? I have the same issue, and I found out that the error "Request failed with status code 500" happens because there is an exception KeyError at https://github.com/openvinotoolkit/cvat/blob/develop/serverless/pytorch/shiyinzhang/iog/nuclio/main.py#L23, there is no key pos_points. After verification, the only keys in data are points and image.

[nmanovic]

@fjean , you need to update your instance till develop version.

docker-compose -f docker-compose.yml -f docker-compose.dev.yml build
docker-compose up -d

[davodogster]

@nmanovic and what about me?

[omognuni]

@davodogster I had same problem. I solved it by changing localhost port. Add port number in function.yaml port: (port number except 0). i added 32001 from nuclio doc

triggers:
   myHttpTrigger:
     maxWorkers: 1
     kind: 'http'
     workerAvailabilityTimeoutMilliseconds: 10000
     attributes:
       port: 32001 <----- add this
       maxRequestBodySize: 33554432 # 32MB

i don't know the reason but docker ps -a showed function port number 0.0.0.0:5819 ->8080/tcp, but it actually was using port number 0

[nmanovic]

@davodogster , I cannot help to resolve local firewall problems. I will recommend to run commands from function.yaml without docker. If you can reproduce the issue without docker, ask your local administrator to setup your firewall properly.

[nmanovic]

I hope the issue was resolved. Let's reopen it if we know how to reproduce. IOG works in my case without any problems. We are not able to help with local firewall configurations.