Problems getting X11 grabber to work on RPi 4 #131

ElectricPorcupine · 2021-10-18T02:37:22Z

ElectricPorcupine
Oct 18, 2021

Love the project and although I am doing exactly what you say not to do (run some ws2812b lights off of PWM from the same RPi) I was hoping you could help me figure out the X11 setup that I need to get HyperHDR reading the internal screen of OSMC-Kodi that is running. I am getting the X11 error "[X11_SYSTEM:AUTO] Could not find any capture device. X11 system grabber won't work if HyperHDR is run as a service due to security restrictions." but I am at a loss as to what to do to not run it as some type of service. I've installed this program in the normal user, ran with sudo, and that didn't work. So then I installed with root, double-checked with ps-ef once I got it running and I can get the lights configured correctly and run Kodi, I am just missing that screen grabber. Does X11 somehow need to be run separately? Do I need to make an executable of HyperHDR to not run it as a service? Any help you can provide would be awesome!

2021-10-18T02:16:52.735Z [MAIN] Database path: '/root/.hyperhdr/db/hyperhdr.db', readonlyMode = disabled
2021-10-18T02:16:52.735Z [MAIN] Starting HyperHdr - 18.0.0.0beta1, master (Awawa-7b8d5c3/c28ad00-1633865106), built: Oct 17 2021:14:17:37
2021-10-18T02:16:52.735Z [MAIN] Set user data path to '/root/.hyperhdr'
2021-10-18T02:16:52.767Z [DB] Database opened: /root/.hyperhdr/db/hyperhdr.db
2021-10-18T02:16:52.836Z [SETTINGSMGR] Settings database initialized
2021-10-18T02:16:52.837Z [HYPERHDR] Sound device is disabled
2021-10-18T02:16:52.855Z [V4L2:AUTO] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0 
2021-10-18T02:16:52.855Z [V4L2:AUTO] Found capture device: /dev/video15
2021-10-18T02:16:52.856Z [V4L2:AUTO] Found capture device: /dev/video14
2021-10-18T02:16:52.856Z [V4L2:AUTO] Found capture device: /dev/video19
2021-10-18T02:16:52.857Z [V4L2:AUTO] Restarting video grabber is now blocked due to reloading of the configuration
2021-10-18T02:16:52.857Z [V4L2:AUTO] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0 
2021-10-18T02:16:52.857Z [V4L2:auto] (GrabberWrapper.cpp:44) CEC keycode. Start: 0, stop: 0
2021-10-18T02:16:52.857Z [V4L2:AUTO] (Grabber.cpp:231) setBrightnessContrastSaturationHue nothing changed
2021-10-18T02:16:52.857Z [V4L2:AUTO] (V4L2Grabber.cpp:98) setHdrToneMappingMode to: Disabled
2021-10-18T02:16:52.857Z [V4L2:AUTO] (Grabber.cpp:140) setFpsSoftwareDecimation to: 1
2021-10-18T02:16:52.857Z [SIGNAL_OLD] (DetectionManual.cpp:85) Signal detection area set to: 0.250000,0.250000 x 0.750000,0.750000
2021-10-18T02:16:52.857Z [SIGNAL_OLD] (DetectionManual.cpp:75) Signal threshold set to: {12, 12, 12} and frames: 200
2021-10-18T02:16:52.858Z [SIGNAL_AUTO] (DetectionAutomatic.cpp:368) Automatic signal detection -> errorTolerance: 9, modelTolerance: 90, sleepTime: 5000, wakeTime: 1000
2021-10-18T02:16:52.858Z [V4L2:AUTO] (Grabber.cpp:336) setDeviceVideoStandard preparing to restart video grabber. Old: '' new: 'auto'
2021-10-18T02:16:52.858Z [V4L2:AUTO] Delayed restart of the grabber due to change of selected device
2021-10-18T02:16:52.858Z [V4L2:AUTO] (Grabber.cpp:158) Force encoding to: NO_CHANGE (old: NO_CHANGE)
2021-10-18T02:16:52.858Z [V4L2:AUTO] setQFrameDecimation is now: disabled
2021-10-18T02:16:52.859Z [X11_SYSTEM:AUTO] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0 
2021-10-18T02:16:52.891Z [X11_SYSTEM:AUTO] Loaded X11 proxy library for screen capturing
2021-10-18T02:16:52.892Z [X11_SYSTEM:AUTO] Restarting video grabber is now blocked due to reloading of the configuration
2021-10-18T02:16:52.892Z [X11_SYSTEM:AUTO] (Grabber.cpp:117) Set new width: 512, height: 512 for capture
2021-10-18T02:16:52.892Z [X11_SYSTEM:AUTO] (Grabber.cpp:291) setWidthHeight preparing to restarting video grabber 0
2021-10-18T02:16:52.892Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of the capturing resolution
2021-10-18T02:16:52.893Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of the framerate
2021-10-18T02:16:52.893Z [SIGNAL_OLD] (DetectionManual.cpp:85) Signal detection area set to: 0.250000,0.250000 x 0.750000,0.750000
2021-10-18T02:16:52.893Z [SIGNAL_OLD] (DetectionManual.cpp:75) Signal threshold set to: {0, 0, 0} and frames: 50
2021-10-18T02:16:52.894Z [X11_SYSTEM:AUTO] (Grabber.cpp:336) setDeviceVideoStandard preparing to restart video grabber. Old: '' new: 'auto'
2021-10-18T02:16:52.894Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of selected device
2021-10-18T02:16:52.932Z [SETTINGSMGR] Settings database initialized
2021-10-18T02:16:52.936Z [BLACKBORDER] Set mode to: default
2021-10-18T02:16:52.936Z [COMPONENTREG0] Blackborder detector: enabled
2021-10-18T02:16:52.937Z [IMAGETOLED0] (ImageProcessor.cpp:153) set user led mapping to advanced
2021-10-18T02:16:52.937Z [IMAGETOLED0] (ImageProcessor.cpp:136) setSparseProcessing to 0
2021-10-18T02:16:52.938Z [RGB_TRANSFORM0] RGB transform classic_config: 1, saturationGain: 1.000000, luminanceGain: 0.500000, backlightThreshold: 1
2021-10-18T02:16:52.939Z [RGB_TRANSFORM0] setBacklightThreshold: 1
2021-10-18T02:16:52.939Z [ADJUST_RED0] Set correction to 255
2021-10-18T02:16:52.939Z [ADJUST_BLUE0] Set correction to 255
2021-10-18T02:16:52.940Z [ADJUST_GREEN0] Set correction to 255
2021-10-18T02:16:52.957Z [JSONSERVER] (JsonServer.cpp:28) Created instance
2021-10-18T02:16:52.958Z [JSONSERVER] Started on port 19444
2021-10-18T02:16:52.943Z [DB] Database opened: /root/.hyperhdr/db/hyperhdr.db
2021-10-18T02:16:52.963Z [LEDDEVICE] Start LedDevice 'ws281x'.
2021-10-18T02:16:52.963Z [COMPONENTREG0] Smoothing: enabled
2021-10-18T02:16:52.964Z [SMOOTHING0] Creating config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 150ms, interval: 20ms (50Hz), antiFlickTres: 0, antiFlickStep: 2, antiFlickTime: 0
2021-10-18T02:16:52.964Z [SMOOTHING0] Clearing queued colors
2021-10-18T02:16:52.964Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 150ms, interval: 20ms (50Hz), antiFlickTres: 0, antiFlickStep: 2, antiFlickTime: 0
2021-10-18T02:16:52.964Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 150ms, interval: 20ms (50Hz), antiFlickTres: 0, antiFlickStep: 2, antiFlickTime: 0
2021-10-18T02:16:52.964Z [LEDDEVICE] (LedDevice.cpp:149) deviceConfig: [{"colorOrder":"grb","currentLedCount":300,"dma":5,"gpio":18,"hardwareLedCount":300,"invert":false,"latchTime":0,"leds":300,"pwmchannel":0,"rewriteTime":1000,"rgbw":false,"type":"ws281x","whiteAlgorithm":"subtract_minimum"}]
2021-10-18T02:16:52.965Z [LEDDEVICE] (LedDevice.cpp:408) LatchTime updated to 0ms
2021-10-18T02:16:52.965Z [FLATBUFCONN] Connecting to HyperHDR: 127.0.0.1:19401
2021-10-18T02:16:52.965Z [LEDDEVICE] (LedDevice.cpp:429) Refresh interval = 1000ms
2021-10-18T02:16:52.966Z [LEDDEVICE] (LedDevice.cpp:435) RewriteTime updated to 1000ms
2021-10-18T02:16:52.966Z [LEDDEVICE] (LedDeviceWS281x.cpp:59) ws281x strip type : 1050624
2021-10-18T02:16:52.967Z [EFFECTENGINE0] Run effect "Rainbow swirl" on channel 254
2021-10-18T02:16:52.968Z [FLATBUFSERVER] Started on port 19400
2021-10-18T02:16:52.968Z [PROTOSERVER] Started on port 19445
2021-10-18T02:16:52.969Z [WEBSERVER] Initialize Webserver
2021-10-18T02:16:52.972Z [WEBSERVER] Initialize Webserver
2021-10-18T02:16:52.984Z [EFFECTENGINE0] (EffectEngine.cpp:152) Start the effect: name [Rainbow swirl], smoothCfg [32]
2021-10-18T02:16:52.985Z [MUXER0] Register new input 'System/EFFECT' with priority 254 as inactive
2021-10-18T02:16:52.985Z [HYPERHDR] Initial background effect 'Rainbow swirl' started
2021-10-18T02:16:52.986Z [MUXER0] Register new input 'System/SYSTEMGRABBER' with priority 245 as inactive
2021-10-18T02:16:52.986Z [COMPONENTREG0] System capture device: enabled
2021-10-18T02:16:52.986Z [X11_SYSTEM:AUTO] (X11Grabber.cpp:122) init
2021-10-18T02:16:52.986Z [X11_SYSTEM:AUTO] (X11Grabber.cpp:141) Forcing auto discovery device
2021-10-18T02:16:52.986Z [X11_SYSTEM:AUTO] Could not find any capture device. X11 system grabber won't work if HyperHDR is run as a service due to security restrictions.
2021-10-18T02:16:52.986Z [BOBLIGHT] Instance created
2021-10-18T02:16:52.987Z [HYPERMANAGER] HyperHDR instance 'First LED instance' has been started
2021-10-18T02:16:52.987Z [DAEMON] Unload CEC
2021-10-18T02:16:52.987Z [COMPONENTREG0] LED device: enabled
2021-10-18T02:16:52.987Z [EFFECTENGINE0] Run effect "Notify blue" on channel 0
2021-10-18T02:16:52.987Z [EFFECTENGINE0] (EffectEngine.cpp:152) Start the effect: name [Notify blue], smoothCfg [2]
2021-10-18T02:16:52.987Z [MUXER0] Register new input 'System/EFFECT' with priority 0 as inactive
2021-10-18T02:16:52.987Z [HYPERHDR] Initial foreground effect 'Notify blue' started
2021-10-18T02:16:52.988Z [SMOOTHING0] Using alternative smoothing input (0)
2021-10-18T02:16:52.988Z [SMOOTHING0] Enabling timer. Now timer is active: 1, remaining time to run: 20
2021-10-18T02:16:52.989Z [EFFECT0(Notify...)] Begin playing the effect with priority: 0
2021-10-18T02:16:52.990Z [MUXER0] (PriorityMuxer.cpp:211) Priority 0 is now active
2021-10-18T02:16:52.990Z [MUXER0] Set visible priority to 0
2021-10-18T02:16:52.990Z [SMOOTHING0] Clearing queued colors
2021-10-18T02:16:52.990Z [SMOOTHING0] Selecting config (2) => type: Linear, dirMode: false, pause: false, settlingTime: 200ms, interval: 40ms (25Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2021-10-18T02:16:52.990Z [SMOOTHING0] Using linear smoothing input (2)
2021-10-18T02:16:52.990Z [SMOOTHING0] Enabling timer. Now timer is active: 1, remaining time to run: 40
2021-10-18T02:16:52.990Z [HYPERHDR0] New priority[0], previous [255]
2021-10-18T02:16:52.991Z [HYPERHDR0] New source available -> switch LED-Device on
2021-10-18T02:16:52.991Z [EFFECT0(Rainbo...)] Begin playing the effect with priority: 254
2021-10-18T02:16:52.991Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2021-10-18T02:16:52.997Z [WEBSERVER] Apply Webserver settings
2021-10-18T02:16:52.998Z [WEBSERVER] Set document root to: :/webconfig
2021-10-18T02:16:52.997Z [WEBSERVER] Apply Webserver settings
2021-10-18T02:16:52.998Z [WEBSERVER] Set document root to: :/webconfig
2021-10-18T02:16:52.999Z [WEBSERVER] Started on port 8090 name 'HyperHDR Webserver'
2021-10-18T02:16:53.016Z [WEBSERVER] Setup SSL certificate
2021-10-18T02:16:53.017Z [WEBSERVER] Setup private SSL key
2021-10-18T02:16:53.017Z [WEBSERVER] Started on port 8092 name 'HyperHDR Webserver'
2021-10-18T02:16:53.031Z [SMOOTHING0] Using linear smoothing procedure (2)
2021-10-18T02:16:55.960Z [IMAGETOLED0] Total index number is: 1200. Sparse processing: disabled, image size: 80 x 47, area number: 300
2021-10-18T02:16:56.047Z [MUXER0] Timeout clear for priority 0
2021-10-18T02:16:56.048Z [MUXER0] Set visible priority to 0
2021-10-18T02:16:56.048Z [SMOOTHING0] Clearing queued colors
2021-10-18T02:16:56.048Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 150ms, interval: 20ms (50Hz), antiFlickTres: 0, antiFlickStep: 2, antiFlickTime: 0
2021-10-18T02:16:56.048Z [SMOOTHING0] Using alternative smoothing input (0)
2021-10-18T02:16:56.048Z [SMOOTHING0] Enabling timer. Now timer is active: 1, remaining time to run: 20
2021-10-18T02:16:56.048Z [HYPERHDR0] New priority[0], previous [0]
2021-10-18T02:16:56.048Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2021-10-18T02:16:56.049Z [IMAGETOLED0] Total index number is: 1200. Sparse processing: disabled, image size: 80 x 47, area number: 300
2021-10-18T02:16:56.059Z [EFFECT0(Notify...)] The effect quits with priority: 0
2021-10-18T02:16:56.059Z [EFFECTENGINE0] Effect 'Notify blue' has finished.
2021-10-18T02:16:56.059Z [EFFECT0(Notify...)] Deleting effect named: 'Notify blue'
2021-10-18T02:16:56.069Z [SMOOTHING0] Using alternative smoothing procedure (0)
2021-10-18T02:16:56.298Z [MUXER0] Switching from color effect. Waiting till: 21:16:59
2021-10-18T02:16:59.298Z [MUXER0] Set visible priority to 255
2021-10-18T02:16:59.299Z [HYPERHDR0] New priority[255], previous [0]
2021-10-18T02:16:59.299Z [HYPERHDR0] No source left -> switch LED-Device off
2021-10-18T02:16:59.300Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2021-10-18T02:16:59.496Z [MUXER0] Priority 254 is now active
2021-10-18T02:16:59.496Z [MUXER0] Set visible priority to 254
2021-10-18T02:16:59.497Z [IMAGETOLED0] Total index number is: 1200. Sparse processing: disabled, image size: 80 x 45, area number: 300
2021-10-18T02:16:59.498Z [IMAGETOLED0] Total index number is: 1200. Sparse processing: disabled, image size: 80 x 45, area number: 300
2021-10-18T02:16:59.499Z [SMOOTHING0] Clearing queued colors
2021-10-18T02:16:59.499Z [SMOOTHING0] Selecting config (32) => type: Linear, dirMode: false, pause: false, settlingTime: 200ms, interval: 40ms (25Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2021-10-18T02:16:59.499Z [SMOOTHING0] Using linear smoothing input (32)
2021-10-18T02:16:59.499Z [SMOOTHING0] Enabling timer. Now timer is active: 1, remaining time to run: 40
2021-10-18T02:16:59.499Z [HYPERHDR0] New priority[254], previous [255]
2021-10-18T02:16:59.500Z [HYPERHDR0] New source available -> switch LED-Device on
2021-10-18T02:16:59.500Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2021-10-18T02:16:59.501Z [IMAGETOLED0] Total index number is: 1200. Sparse processing: disabled, image size: 80 x 45, area number: 300
2021-10-18T02:16:59.540Z [SMOOTHING0] Using linear smoothing procedure (32)
2021-10-18T02:17:04.959Z [WEBSOCKET] (WebSocketClient.cpp:30) New connection from ::ffff:192.168.132.170
2021-10-18T02:17:04.960Z [WEBSOCKET] (JsonAPI.cpp:89) Client '::ffff:192.168.132.170' switch to HyperHDR instance 0
2021-10-18T02:17:07.311Z [DB] Database opened: /root/.hyperhdr/db/hyperhdr.db
2021-10-18T02:17:07.494Z [WEBSOCKET] (JsonAPI.cpp:1342) log streaming activated for client ::ffff:192.168.132.170

awawa-dev · 2021-10-18T08:10:27Z

awawa-dev
Oct 18, 2021
Maintainer

Hi
The restrictions for using X11 grabber are not ours: otherwise they could pose a security threat by allowing capturing the user session by background processes. I'm not familiar with Kodi, in fact I don't even know if Kodi uses X11 at all or for example just for the its interface and the video playback is using some other graphical system. Typical usage (for example in Ubuntu) is to run HyperHDR from the menu shortcut. I guess it's not possible in Kodi, but maybe creating a shortcut in some kind of X system autostart folder (using user that Kodi runs on) could work.

1 reply

ElectricPorcupine Oct 18, 2021
Author

I will try to stumble my way through that process this week and get back to you if I make any progress.
I know this system works a lot better when using a USB grabber. If I output to something like your recommended Ezcap 320 from the Pi4, passing the HDMI to the TV, and sending the capture back to the same Pi4's USB, do you see any problems that could arise? I am at the point of chucking some money at this thing to just work.
P.S. You and your community are so helpful and supportive. Really makes my day to know projects like these are out there and a donation will come your way once this is all up and running.

awawa-dev · 2021-10-18T17:25:56Z

awawa-dev
Oct 18, 2021
Maintainer

@ElectricPorcupine

I will try to stumble my way through that process this week and get back to you if I make any progress. I know this system works a lot better when using a USB grabber. If I output to something like your recommended Ezcap 320 from the Pi4, passing the HDMI to the TV, and sending the capture back to the same Pi4's USB, do you see any problems that could arise? I am at the point of chucking some money at this thing to just work. P.S. You and your community are so helpful and supportive. Really makes my day to know projects like these are out there and a donation will come your way once this is all up and running.

There could be possible problems in such scenario.

Resources. Mainly CPU but beware if you are going to drive ws281x (trace in your logs) or sk6812 directly from Rpi: it takes even additional, the more such LEDs to drive the more additional CPU resources. That could be a quite high number but you won't see it separately (it's accounted as HyperHDR CPU usage). Usually it's forgotten...
USB grabber handling by the kernel also takes some. With Rpi4 and Ezcap320 USB3.0 based on my experience you can go below 60-80% (out of 400%). For 1280x760x60 capturing using 'quarter of frame mode' and HyperSPI (instead of driving LED strip directly) I'm around 70%. If you connect Ezcap to USB2.0 port you can even access lower&faster for processing video modes. So you must assess how much of resources Kodi takes in worst case scenario (suggest to test it using htop or top with Kodi playing some high quality 4k videos or 1080p depending on your plans). I would be comfortable with Kodi running below 250% to have a room for HyperHDR using USB capturing on the same unit.
Ezcap 320 does not have CEC pass-through if you are using it currently. it doesn't have dolby bitstream pass-through, latest firmware causes Ezcap320 to stop working with Rpi (but can be downgraded so far).

0 replies

freezir12 · 2021-12-20T19:19:54Z

freezir12
Dec 20, 2021

@awawa-dev could you make it to use the software screen grabber? i am facing the same problem. Help would be appreciated ! :) Greetz!

2 replies

ElectricPorcupine Dec 20, 2021
Author

I haven't had much time outside of work to get much farther on my workaround but for you and others, the normal RaspberryPi images do not run X11 or anything similar to more efficiently display images. This is the main hurdle to get around and why using a separate Pi dedicated to running lights off of a USB grabber may be the easier solution.

freezir12 Dec 20, 2021

Alright thx! :)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problems getting X11 grabber to work on RPi 4 #131

{{title}}

Replies: 3 comments 3 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Problems getting X11 grabber to work on RPi 4 #131

ElectricPorcupine Oct 18, 2021

Replies: 3 comments · 3 replies

awawa-dev Oct 18, 2021 Maintainer

ElectricPorcupine Oct 18, 2021 Author

awawa-dev Oct 18, 2021 Maintainer

freezir12 Dec 20, 2021

ElectricPorcupine Dec 20, 2021 Author

freezir12 Dec 20, 2021

ElectricPorcupine
Oct 18, 2021

Replies: 3 comments 3 replies

awawa-dev
Oct 18, 2021
Maintainer

ElectricPorcupine Oct 18, 2021
Author

awawa-dev
Oct 18, 2021
Maintainer

freezir12
Dec 20, 2021

ElectricPorcupine Dec 20, 2021
Author