Announcement: Introducing the RealSense D457 GMSL/FAKRA stereo camera

[MartyG-RealSense]

Hi everyone,

Intel have introduced a new member of the RealSense stereo camera family called the D457. It is based around the D450 depth module and the new Vision Processor D4 V5.

https://www.intelrealsense.com/depth-camera-d457/

https://www.intel.com/content/www/us/en/newsroom/news/new-realsense-depth-camera-d457.html

Its listing in the official RealSense Store can be found here:

https://store.intelrealsense.com/buy-intel-realsense-depth-camera-d457.html

To quote the store page:

"The Intel® RealSense™ Depth Camera D457 is our first GMSL/FAKRA high bandwidth stereo camera. The D457 has an IP65 grade enclosure protecting it from dust ingress and projected water. D457 has an on-board Maxim serializer chip. A Maxim de-serializer is needed at host side to decode the streams".

---

Connect Tech provide support for D457 with their hardware products.

https://connecttech.com/connect-tech-offers-built-in-support-on-the-newly-announced-intel-gmsl-realsense-depth-camera-d457/

---

The RealSense Store retails an 8-pack of the D450 camera module and Vision Processor D4 V5 here:

https://store.intelrealsense.com/intelr-realsensetm-depth-module-d450-vision-processor-d4-board-v5-gmsl-fakra-8-pack.html

---

The dedicated data sheet document for the D457 can be downloaded here:

https://dev.intelrealsense.com/docs/intel-realsense-d400-series-product-family-datasheet

The official Intel CAD file for the D457 is here:

https://dev.intelrealsense.com/docs/stereo-depth-camera-d400#cad-files

[Mat198]

How long is the coax cable that comes with the camera?

How much is its bend radius?

[MartyG-RealSense]

Thanks very much @Mat198 for your questions about the D457. I have submitted them to my Intel RealSense colleagues to obtain the requested information.

[MartyG-RealSense]

Hi @Mat198 My Intel RealSense colleagues have provided the following D457 information.

1. The Fakra cable in the D457 box has a length of 1000 mm +/- 10

2. According to RG174 coax cable spec, the minimum radius is 9.9 mm.

4. Users can obtain a longer cable from the market. It is recommended to use “LEONI Dacar 302” for a 10 ~15 m long cable. An Intel RealSense colleague has tried RG174 cable on D457. The maximum length is 11 m, but Dacar 302 can reach 15 m.

[Mat198]

Thanks for your fast reply!
Does the GMSL interface need a different implementation, or it's ready to plug and play in this Syslogic computer?
https://www.syslogic.ai/jetson-agx-xavier/rugged-computer-rpc-rml-a3-e2

I saw ConnectTech products, but I'm aiming for an outdoor agriculture application that requires an IP rate of at least 65. https://connecttech.com/connect-tech-offers-built-in-support-on-the-newly-announced-intel-gmsl-realsense-depth-camera-d457/

[MartyG-RealSense]

A Maxim de-serializer is needed at host side to decode the streams. The Intel RealSense sales team can be contacted regarding the de-serializer component. A contact form for the sales team is at the link below.

https://www.intelrealsense.com/talk-to-sales/

I recommend selecting the Which Intel RealSense product option and then the Need advice sub-option.

For users who wish to perform tests with the D457, the Connect Tech product is recommended as no de-serializer is needed in a Connect Tech / D457 setup.

[Mat198]

Understood. Thanks!

[AndreV84]

do you supply interface / adapter to connect it to nvidia AGX devkit somehow?

[MartyG-RealSense]

Hi @AndreV84 If you have obtained a de-serializer to decode the D457's streams at host-side then information about how to obtain the reference driver package for AGX Xavier can be found at #11010 (comment)

In regards to cabling, a 1000 mm / 1 meter FAKRA cable is supplied with the D457, as described at #10984 (comment)

[AndreV84]

Hi @MartyG-RealSense
Thank you for following up!
However, the default Jetson AGX devkit doesn't have the GSML port for the cabling. Could you extend on how to connect the camera to the default nvidia Jetson AGX devkit hardware, please? Are there any particular cable+ adapter things or how else it could be connected?

[MartyG-RealSense]

My understanding is that the cabling connects to the de-serializer board, like the one at the link below that a RealSense user at #11010 (comment) chose for their D457.

https://www.leopardimaging.com/product/accessories/adapters-carrier-boards/li-gmsl2-ipx-deser/

In the data sheet document for the D457, it states "GMSL is based on SerDes technology, meaning using a
serializer on the transmitter side and a de-serializer on the receiver side".

[AndreV84]

so for the camera connection we nee dto procure this board [ which is out of stock]
https://www.leopardimaging.com/product/accessories/adapters-carrier-boards/li-gmsl2-ipx-deser/ ?
are there any other boards we could buy for nvidia Jetson AGX devkit default implementation?

[MartyG-RealSense]

For the initial testing stage of a D457 project, Intel recommend using Connect Tech hardware so that purchasing a separate de-serializer is not required as de-serialization is built into the Connect Tech hardware.

https://connecttech.com/connect-tech-offers-built-in-support-on-the-newly-announced-intel-gmsl-realsense-depth-camera-d457/

If you would prefer to proceed directly to using a separate de-serializer component then it can be obtained through the Intel RealSense sales team, as described at #10984 (comment)

Intel's de-serializer board can be plug onto the AGX Xavier board directly. The D457 connects to the FAKRA connector on this board through a GMSL cable.

I would not name further de-serializer products at present without confirmation that they are able to function with the D457. The RealSense user who purchased the LI-GMSL2-IPX-DESER product stated though that it contained MAX9296A technology, which should narrow down research for compatible de-serializer products.

For example, you could google for maxim deserializer "MAX9296A" (including the quotation marks so that relevant products are included in the search results).

The linked-to product listing itself confirms this particular Maxim component.

[AndreV84]

@MartyG-RealSense
Do we order a de serializer from intel realsense somehow directly through sales easily?
or we should look to order elsewhere e.g. from Leopard imaging?
The latter [LI] listed these:

We have below adapter boards and cable which can connect GMSL2 cameras to Jetson AGX Xavier, but I am sure if this deserializer adapter (with MAX9296) is compatible with Intel d457 camera.

LI-GMSL2-IPX-DESER
FAW-1233-03 cable
BLI-JXAV-MIPI-ADPT-4CAM```


But if Intel realsense can supply sale of de serializer it maybe even better option?

Also are there adapters for Jetson NX devkits by nvidia?

[MartyG-RealSense]

Contacting Intel sales regarding the Intel de-serializer product that can plug directly onto AGX Xavier would be the safest option, especially in regard to your question of how to interface the de-serializer with the AGX board.

Intel's guidance is to use a Maxim de-serializer rather than a specific model of Maxim de-serializer, indicating that if the de-serializer supports GMSL then it should be able to work.

[AndreV84]

@MartyG-RealSense
Thank you for following up
I think I have filled the contact with sales form
Maybe they will follow up sometime in the future to reach back to me regarding the procurement of the de serializer. Does it take many days to get the contact from sales?

[MartyG-RealSense]

Bearing in mind that it is December 23 at the time of writing this, if you have not had a response in a couple of weeks then let me know and I will follow it up.

[AndreV84]

@MartyG-RealSense
Will these CSI-> GSML adapters provided by Intel or LI work with Nvidia Jetson Orin devkit by Nvidia? There is no such support for NX devits, right? But there is support for AGX. How about Orin Devkits?

[MartyG-RealSense]

The D457's Jetson reference driver support is designed to work with a de-serializer on AGX Xavier at this time.

[jast1982]

Hi!

Is there any documentation for bringup? I have a Rudi-AGX and D457 cameras on my desk but realsense-viewer (v2.53.1) doesn't find them with their Jetpack & BSP 4.6.1 installed (4.6.1 was recommended by ConnectTech). I installed the base-image, do I maybe need to select any of their AR** or IMX 390 images? A USB3 D450 works fine btw with USB 3.2 connection.

Looking forward to any hints how to get them up and running...

Thanks!

[MartyG-RealSense]

Hi @jast1982 I will discuss your issue with my Intel RealSense colleagues. Thanks very much for your patience!

[MartyG-RealSense]

Hi again @jast1982 My colleagues advised that first, you need to use the latest RealSense Viewer version. I believe that you are already doing this as you are using SDK version 2.531.

Secondly, you need to obtain the D457 driver from Connect Tech. Intel unfortunately cannot help with this and you need to contact Connect Tech directly.

[AndreV84]

@MartyG-RealSense
Could you confirm if we ordering these three units for jetson AGX devkit will be able to use it for d457 connection? Thanks

LI-GMSL2-IPX-DESER x1

FAW-1233-03 cable x1

LI-JXAV-MIPI-ADPT-4CAM x1

[AndreV84]

@MartyG-RealSense
is it the deser board from intel?
842, no developers discount? :) sales yet remains silent
https://store.intelrealsense.com/buy-intel-realsense-des457.html

[MartyG-RealSense]

The de-serializer board on the store link is the Intel one, though I would recommend contacting the Intel RealSense sales team to confirm pricing. As mentioned above at #10984 (comment) - please allow another week for a response to your submitted query and I will follow it up for you if you have not received a response after that. Thanks very much for your patience!

In regard to the components list, it was confirmed by my Intel RealSense support colleagues at #11010 (comment) that LI-GMSL2-IPX-DESER could be used with D457.

in regard to a cable, my colleagues recommended at #10984 (comment) using a LEONI Dacar 302 cable or a cable that is compliant with RG174.

The D457 camera should connect onto the de-serializer board. If using Intel's de-serializer board then it should attach directly onto the AGX Xavier board, as described at #10984 (comment)

As you quoted the FAW-1233-03 cable though, it looks as though you are referring to a different kind of cable to the one that connects the D457 to the de-serializer.

Can you provide information please about the purpose that the LI-JXAV-MIPI-ADPT-4CAM and LI-JXAV-MIPI-ADPT-4CAM would have in your project, please? Thanks!

[jast1982]

Hi again @jast1982 My colleagues advised that first, you need to use the latest RealSense Viewer version. I believe that you are already doing this as you are using SDK version 2.531.

Secondly, you need to obtain the D457 driver from Connect Tech. Intel unfortunately cannot help with this and you need to contact Connect Tech directly.

Hi!

So, I was able to progress somewhat: Downloading the Realsense specific BSP from here https://connecttech.com/supported-cameras/ installing it according to the normal instructions and afterwards adding this line to /boot/extlinux/extlinux.conf:

FDT /boot/tegra194-agx-cti-AGX104-INTEL.dtb

enabled at least two out of my 4 connected realsense cameras on my system. I can see /dev/video0 to 11 and /dev/video2 and /dev/video8 play a video stream (in wrong colors) in VLC. Unfortunately the realsense-viewer outputs this:

29/12 10:34:54,968 INFO [548026171408] (context.cpp:382) Found 2 RealSense devices (mask 0xff) 29/12 10:34:55,251 INFO [548026171408] (rs.cpp:2701) Framebuffer size changed to 2688 x 756 29/12 10:34:55,252 INFO [548026171408] (rs.cpp:2701) Scale Factor is now 1 29/12 10:34:55,350 ERROR [547922886432] (librealsense-exception.h:52) xioctl(VIDIOC_S_EXT_CTRLS) failed Last Error: Invalid argument 29/12 10:34:55,356 WARNING [547922886432] (rs.cpp:310) null pointer passed for argument "device" 29/12 10:34:55,356 WARNING [547922886432] (rs.cpp:2704) Couldn't refresh devices - xioctl(VIDIOC_S_EXT_CTRLS) failed Last Error: Invalid argument
(V2.53.1, tried as user and with sudo)

Any ideas?

[AndreV84]

https://store.intelrealsense.com/buy-intel-realsense-des457.html

[AndreV84]

@MartyG-RealSense

[AndreV84]

linux-image-5.10.120 with d457 won't work as it seems due to lack of driver integration or else
following up instructions won't work
IntelRealSense/realsense_mipi_platform_driver#207

[MartyG-RealSense]

I will consult with my Intel RealSense colleagues about your issues with the official Intel deserializer board and let you know as soon as I have information.

[AndreV84]

@MartyG-RealSense Thank you for following up!
now it got green leds of that one radiates constantly then another blinks between red/green
is there


a way to read from camera without realsense sdk maybe ?

[MartyG-RealSense]

In GMSL mode it needs the MIPI reference driver.

The camera would likely work in USB mode as a D455 if you moved the mode switch in the casing to the USB position but that would not provide useful information about your GMSL problem, unfortunately.

The best place to seek support on this issue is likely to be the Zendesk support channel, which you have used before for previous D457 issues such as #10560 (comment)

[AndreV84]

@MartyG-RealSense may I know what is the url for zendesk support ticketing system, please?

[AndreV84]

The claims for verification control have not been verified.
The code has been verified. You can now continue.

that is what I got logging in

[MartyG-RealSense]

I do not have information about submitting tickets to Zendesk. From #10560 (comment) it sounds as though you have successfully contacted Intel's Zendesk channel in the past.

[AndreV84]

there was some w instruction at the url as it seems:
https://forums.intel.com/s/question/0D70P000006GkkASAS

[AndreV84]

somehow created request somewhere with zendesk realsense
thanks
(22669) request
Case#: 06237420

[MartyG-RealSense]

That's great to hear!

[AndreV84]

@MartyG-RealSense is it correct to use this script to build the sdk from sources?
https://github.com/IntelRealSense/librealsense/blob/master/scripts/libuvc_installation.sh

[MartyG-RealSense]

@AndreV84 I do not recall this build script being previously used for a MIPI connection but the script has been updated to include a MIPI version of the udev device handling rules.

https://github.com/IntelRealSense/librealsense/blob/master/scripts/libuvc_installation.sh#L43

[AndreV84]

what are the power input characteristics requirements for the board? I see 12v-13.7v is written at the board; what Ampere does it expect o nthe input port?
@MartyG-RealSense

[AndreV84]

this component seems got llost even if it was present for gmsl card so are there specific power input requirements but for 12v-13.7v range?
@MartyG-RealSense

[MartyG-RealSense]

@AndreV84 There is not any publicly available technical information about the Intel deserializer board. It will be necessary to enquire to Intel's Zendesk support channel for that information.

[AndreV84]

I asked them but there was no specific answer yet but a general reference to github repository

Is this error pointing out issue with gmsl board or with camera?
max9295 30-0042: max9295_setup_control: ERROR: ser device not found

[MartyG-RealSense]

I have communicated to my Intel RealSense colleagues about your current problems and request for information about power requirements.

[AndreV84]

folks changed the power source after that the driver issue got resolved; 2.53 sdk also worked; now the only thing is to figure out how to buld the latest sdk
thanks

[AndreV84]

seems all done; latest build from apt repo sees the camera
thank you

[MartyG-RealSense]

It's great to hear that you were completely successful in solving your issues :)

[AndreV84]

folks are asking to check:"
exactly what size stand-off we need?
To secure it to the AGX unit?"
@MartyG-RealSense

[MartyG-RealSense]

@AndreV84 I will ask my colleagues about that question too.

[MartyG-RealSense]

@AndreV84 My colleagues advised that the stack space is 11 mm. They added that there should have been 4 pieces of stand-off included in the Xavier carrier board package. Did your package have these pieces, please?

[AndreV84]

thank you for following up!
folks pointed out "We didn’t get the standoffs"

[MartyG-RealSense]

Okay, I will follow up with my colleagues about the missing stand-offs.

[MartyG-RealSense]

@AndreV84 My colleagues advised that the package should include the following items as a kit:

• Board
• Power supply
• GSML cable
• Stand offs / screws in a small ziplock bag

Can you ask your team please if they received the board, power supply and GMSL cable and whether the stand-offs and screws were the only item missing.

[tonynajjar]

Hello @MartyG-RealSense, the post mentions mostly ConnectTech's hardware. Do you have by chance a list of carrier boards that supports D457 GMSL, both hardware and software?

[MartyG-RealSense]

Hi @tonynajjar There is not a list available, unfortunately. The most compatible boards will be Jetson AGX Xavier or Orin, as Intel's D457 MIPI driver has installation instructions for those specific boards at the link below.

https://github.com/IntelRealSense/realsense_mipi_platform_driver

The MIPI driver can be converted ("ported") for other boards but you need to perform this conversion yourself as Intel are unable to provide assistance for doing so.

If you are not using Connect Tech's product then you will also need to purchase an additional deserializer board. Leopard Imaging's LI-GMSL2-IPX-DESER deserializer board is compatible with D457.

https://leopardimaging.com/product/accessories/adapters-carrier-boards/li-gmsl2-ipx-deser/

Other brands of deserializer board should also work though as long as they contain MAX9296A deserializer technology like the Leopard Imaging LI-GMSL2-IPX-DESER product does.