Problems with using SLEAP models in Bonsai. Single instance model

[KostasTsar]

Hello everyone,

I've been facing issues trying to run SLEAP models in Bonsai. I am posting here since I expect I am doing something wrong on my end, apologies if it should be on a different forum.

I have in this example a single instance model trained in SLEAP v1.2.9, which has no problem predicting the pose of my animal when run in SLEAP. After I export the model and run it in Bonsai, I am getting no errors and inference is technically running, but the predictions are at random locations. Below is an example.

Prediction example on single frame in SLEAP:

Preciction example on single frame in Bonsai:

The nodes jitter around at random points, but never manage to find the animal.
I am simply giving to the model the same input video as was used in training, without applying any modifications and I am getting no errors, simply completely incorrect predictions.

Any ideas on how to fix this?

Thank you in advance,
Kostas

[bruno-f-cruz]

I suspect you might have the wrong color format specified. You can try to set the ColorConversion property in the PredictSinglePose to Bgr2rgb. You can also just add a ConvertColor operator and use the same conversion string.

[KostasTsar]

That was it... Thank you Bruno!