opencv fail to open video

[ai1361720220000]

Hi,
I built audioflip with OpenCV3.4.9 in Centos7.4. However, when i run the code below, errors occurs.
Thank you!

GLOG_logtostderr=1 bazel-bin/mediapipe/examples/desktop/autoflip/run_autoflip
--calculator_graph_config_file=mediapipe/examples/desktop/autoflip/autoflip_graph.pbtxt
--input_side_packets=input_video_path=1.mp4,output_video_path=1R.mp4,aspect_ratio=9:16

I0410 21:41:19.797029 64158 simple_run_graph_main.cc:106] Get calculator graph config contents: # Autoflip graph that only renders the final cropped video. For use with

end user applications.

max_queue_size: -1

VIDEO_PREP: Decodes an input video file into images and a video header.

node {
calculator: "OpenCvVideoDecoderCalculator"
input_side_packet: "INPUT_FILE_PATH:input_video_path"
output_stream: "VIDEO:video_raw"
output_stream: "VIDEO_PRESTREAM:video_header"
output_side_packet: "SAVED_AUDIO_PATH:audio_path"
}

VIDEO_PREP: Scale the input video before feature extraction.

node {
calculator: "ScaleImageCalculator"
input_stream: "FRAMES:video_raw"
input_stream: "VIDEO_HEADER:video_header"
output_stream: "FRAMES:video_frames_scaled"
options: {
[mediapipe.ScaleImageCalculatorOptions.ext]: {
preserve_aspect_ratio: true
output_format: SRGB
target_width: 480
algorithm: DEFAULT_WITHOUT_UPSCALE
}
}
}

VIDEO_PREP: Create a low frame rate stream for feature extraction.

node {
calculator: "PacketThinnerCalculator"
input_stream: "video_frames_scaled"
output_stream: "video_frames_scaled_downsampled"
options: {
[mediapipe.PacketThinnerCalculatorOptions.ext]: {
thinner_type: ASYNC
period: 200000
}
}
}

DETECTION: find borders around the video and major background color.

node {
calculator: "BorderDetectionCalculator"
input_stream: "VIDEO:video_raw"
output_stream: "DETECTED_BORDERS:borders"
}

DETECTION: find shot/scene boundaries on the full frame rate stream.

node {
calculator: "ShotBoundaryCalculator"
input_stream: "VIDEO:video_frames_scaled"
output_stream: "IS_SHOT_CHANGE:shot_change"
options {
[mediapipe.autoflip.ShotBoundaryCalculatorOptions.ext] {
min_shot_span: 0.2
min_motion: 0.3
window_size: 15
min_shot_measure: 10
min_motion_with_shot_measure: 0.05
}
}
}

DETECTION: find faces on the down sampled stream

node {
calculator: "AutoFlipFaceDetectionSubgraph"
input_stream: "VIDEO:video_frames_scaled_downsampled"
output_stream: "DETECTIONS:face_detections"
}
node {
calculator: "FaceToRegionCalculator"
input_stream: "VIDEO:video_frames_scaled_downsampled"
input_stream: "FACES:face_detections"
output_stream: "REGIONS:face_regions"
}

DETECTION: find objects on the down sampled stream

node {
calculator: "AutoFlipObjectDetectionSubgraph"
input_stream: "VIDEO:video_frames_scaled_downsampled"
output_stream: "DETECTIONS:object_detections"
}
node {
calculator: "LocalizationToRegionCalculator"
input_stream: "DETECTIONS:object_detections"
output_stream: "REGIONS:object_regions"
options {
[mediapipe.autoflip.LocalizationToRegionCalculatorOptions.ext] {
output_all_signals: true
}
}
}

SIGNAL FUSION: Combine detections (with weights) on each frame

node {
calculator: "SignalFusingCalculator"
input_stream: "shot_change"
input_stream: "face_regions"
input_stream: "object_regions"
output_stream: "salient_regions"
options {
[mediapipe.autoflip.SignalFusingCalculatorOptions.ext] {
signal_settings {
type { standard: FACE_CORE_LANDMARKS }
min_score: 0.85
max_score: 0.9
is_required: false
}
signal_settings {
type { standard: FACE_ALL_LANDMARKS }
min_score: 0.8
max_score: 0.85
is_required: false
}
signal_settings {
type { standard: FACE_FULL }
min_score: 0.8
max_score: 0.85
is_required: false
}
signal_settings {
type: { standard: HUMAN }
min_score: 0.75
max_score: 0.8
is_required: false
}
signal_settings {
type: { standard: PET }
min_score: 0.7
max_score: 0.75
is_required: false
}
signal_settings {
type: { standard: CAR }
min_score: 0.7
max_score: 0.75
is_required: false
}
signal_settings {
type: { standard: OBJECT }
min_score: 0.1
max_score: 0.2
is_required: false
}
}
}
}

CROPPING: make decisions about how to crop each frame.

node {
calculator: "SceneCroppingCalculator"
input_side_packet: "EXTERNAL_ASPECT_RATIO:aspect_ratio"
input_stream: "VIDEO_FRAMES:video_raw"
input_stream: "KEY_FRAMES:video_frames_scaled_downsampled"
input_stream: "DETECTION_FEATURES:salient_regions"
input_stream: "STATIC_FEATURES:borders"
input_stream: "SHOT_BOUNDARIES:shot_change"
output_stream: "CROPPED_FRAMES:cropped_frames"
options: {
[mediapipe.autoflip.SceneCroppingCalculatorOptions.ext]: {
max_scene_size: 600
key_frame_crop_options: {
score_aggregation_type: CONSTANT
}
scene_camera_motion_analyzer_options: {
motion_stabilization_threshold_percent: 0.5
salient_point_bound: 0.499
}
padding_parameters: {
blur_cv_size: 200
overlay_opacity: 0.6
}
target_size_type: MAXIMIZE_TARGET_DIMENSION
}
}
}

ENCODING(required): encode the video stream for the final cropped output.

node {
calculator: "VideoPreStreamCalculator"

Fetch frame format and dimension from input frames.

input_stream: "FRAME:cropped_frames"

Copying frame rate and duration from original video.

input_stream: "VIDEO_PRESTREAM:video_header"
output_stream: "output_frames_video_header"
}

node {
calculator: "OpenCvVideoEncoderCalculator"
input_stream: "VIDEO:cropped_frames"
input_stream: "VIDEO_PRESTREAM:output_frames_video_header"
input_side_packet: "OUTPUT_FILE_PATH:output_video_path"
input_side_packet: "AUDIO_FILE_PATH:audio_path"
options: {
[mediapipe.OpenCvVideoEncoderCalculatorOptions.ext]: {
codec: "avc1"
video_format: "mp4"
}
}
}
I0410 21:41:19.798729 64158 simple_run_graph_main.cc:121] Initialize the calculator graph.
I0410 21:41:19.801228 64158 simple_run_graph_main.cc:134] Start running the calculator graph.
[ WARN:0] OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[ WARN:0] OpenCV | GStreamer warning: Embedded video playback halted; module decodebin20 reported: Your GStreamer installation is missing a plug-in.
[ WARN:0] OpenCV | GStreamer warning: unable to start pipeline
[ WARN:0] OpenCV | GStreamer warning: GStreamer: pipeline have not been created
E0410 21:41:19.825877 64158 simple_run_graph_main.cc:146] Failed to run the graph: CalculatorGraph::Run() failed in Run:
Calculator::Open() for node "[OpenCvVideoDecoderCalculator, OpenCvVideoDecoderCalculator with output stream: video_raw]" failed: ; Fail to open video file at 1.mp4

[jiuqiant]

The error message tells us that the GStreamer installation is missing a required plugin and it is unable to start the pipeline. It's more like an installation issue of gstreamer and opencv?

[ai1361720220000]

But i run the opencv example demo successfully. Also i see someone's issue about opencv version and it ensured that opencv3.4.9 is ok. I am still confused about how to deal with this problem.

[ai1361720220000]

i rebuilt ffmpeg and rebuilt opencv as well. Finally, this problem is solved. But another problem occurs.
I0413 17:32:47.392400 42090 simple_run_graph_main.cc:121] Initialize the calculator graph.
I0413 17:32:47.395223 42090 simple_run_graph_main.cc:134] Start running the calculator graph.
/tmp/filerIFqP4
I0413 17:32:49.631896 42097 shot_boundary_calculator.cc:116] Shot change at: 1.28 seconds.
E0413 17:32:49.771435 42095 scene_cropping_calculator.cc:240] ------------------------ (Breathing) Time(s): 0
E0413 17:32:49.786012 42095 scene_cropping_calculator.cc:240] ------------------------ (Breathing) Time(s): 0.52
E0413 17:32:49.811754 42096 scene_cropping_calculator.cc:240] ------------------------ (Breathing) Time(s): 0.92
I0413 17:32:50.004953 42093 shot_boundary_calculator.cc:116] Shot change at: 3.48 seconds.
E0413 17:32:50.353272 42093 scene_cropping_calculator.cc:240] ------------------------ (Breathing) Time(s): 1.32
[h264_vaapi @ 0x2af1ebdc6580] Specified pixel format yuv420p is invalid or not supported
Could not open codec 'h264_vaapi': Unspecified error
[ WARN:11] OpenCV | GStreamer warning: cannot link elements
W0413 17:32:50.371848 42090 opencv_video_decoder_calculator.cc:224] Not all the frames are decoded (total frames: 3273 vs decoded frames: 247).
mv: cannot stat ‘1R.mp4’: No such file or directory
E0413 17:32:50.455384 42090 simple_run_graph_main.cc:146] Failed to run the graph: CalculatorGraph::Run() failed in Run:
Calculator::Process() for node "[OpenCvVideoEncoderCalculator, OpenCvVideoEncoderCalculator with node ID: 25 and input streams: <cropped_frames,output_frames_video_header>]" failed: ; Fail to open file at 1R.mp4

[11676670]

if you network blocked by the Great Firewall. you can change your repositories in WORKSPACE file like this.
repositories =
[
"https://maven.aliyun.com/repository/google",
"https://maven.aliyun.com/repository/central",
"https://maven.aliyun.com/repository/public",
],
Good luck.