support for ar glasses

[seekever]

FreePIE is an excellent tool! Is it possible to read IMU info of ar glasses connected with a cellphone? Such as NReal light/air, rokid air.

[cyberluke]

Hello, they have only Unity SDK: https://developer.nreal.ai/download - you need to ask them to provide just DLL without Unity package and perhaps some small documentation would be nice.

Otherwise you would need to make a Unity app yourself, which would act as a simple communication bridge, connect to NReal glasses and then use additional Unity plugin for UDP or Midi or OSC and send this data to Freepie.

So two options:

1. integrate their SDK directly (but they provide only UnitySDK, they would need to provide plain C++ or C# SDK)
2. make the integration yourself in Unity and develop communication protocol of your choice (UDP, Midi, OSC, or something else).

I develop custom hardware IMU (bracelet) and have my own C++ library including machine learning gesture recognition pipeline. I have also Unity plugin. What I did was to use OSC protocol as I easily found OSC client and server for both Unity and 3rd party integrations. Then I send quaternion (4D vector) data using OSC. Underneath it is using UDP packets. It has advantage of a simple syntax, powerful custom commands and it can be also two way communication.

[seekever]

Got it. Thanks very much for your suggestion. | | seekever | | ***@***.*** |

…

---- Replied Message ---- | From | Lukas ***@***.***> | | Date | 09/11/2022 17:33 | | To | ***@***.***> | | Cc | ***@***.******@***.***> | | Subject | Re: [AndersMalmgren/FreePIE] support for ar glasses (Issue #217) | Hello, they have only Unity SDK: https://developer.nreal.ai/download - you need to ask them to provide just DLL without Unity package and perhaps some small documentation would be nice. Otherwise you would need to make a Unity app yourself, which would act as a simple communication bridge, connect to NReal glasses and then use additional Unity plugin for UDP or Midi or OSC and send this data to Freepie. So two options: integrate their SDK directly (but they provide only UnitySDK, they would need to provide plain C++ or C# SDK) make the integration yourself in Unity and develop communication protocol of your choice (UDP, Midi, OSC, or something else). I develop custom hardware IMU (bracelet) and have my own C++ library including machine learning gesture recognition pipeline. I have also Unity plugin. What I did was to use OSC protocol as I easily found OSC client and server for both Unity and 3rd party integrations. Then I send quaternion (4D vector) data using OSC. Underneath it is using UDP packets. It has advantage of a simple syntax, powerful custom commands and it can be also two way communication. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[calendulish]

the sdk and documentation is now available
https://xreal.gitbook.io/nrsdk

I was trying to do the same thing.