opencv+gstreamer+mpp库问题请教

[复制链接] · 发表于 2022-8-8 20:25:15

原本想在qt中用opencv+gstreamer实时采集摄像头并显示，发现在高分辨率下效果并不理想，于是搜了相关资料，打算先用命令行把mpp库和gstreamer测试下，
//安装了相关的库以及gstreamer的插件，相关帖子搜不到有用的答案，所以来问问下大佬们，除了plugins插件外都是apt安装的系统内的库源
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, width=1920, height=1080, framerate=30/1 ! queue! jpegparse ! queue ! mppjpegdec ! queue ! videoconvert ! queue ! rkximagesink
调用后有视频图像但是很卡，最近刚接触gstreamer相关应用，求助下是什么问题，板子是rk3399-proD，感谢！

mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
WARNING: from element /GstPipeline:pipeline0/GstXImageSink:ximagesink0: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstXImageSink:ximagesink0:
There may be a timestamping problem, or this computer is too slow.
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0

只看该作者 · 发表于 2022-8-10 16:12:44

重新编译安装了mmp库后，似乎可以正常使用了。
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, width=1920, height=1080, framerate=30/1 ! queue! mppjpegdec ! queue ! videoconvert ! queue ! rkximagesink
以上命令能正常采集显示1080P的摄像头数据，但当把rkximagesink换成ximagesink或者qt中使用appsink的时候，肉眼可见的卡顿，查看top资源占用，CPU占用300~400。请问有人知道如何能够通过opencv+gstreamer流畅采集摄像头数据吗？

只看该作者 · 发表于 2022-11-29 16:10:14

erii 发表于 2022-8-10 16:12
重新编译安装了mmp库后，似乎可以正常使用了。
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, ...

我碰见的问题是，1080p视频解码和编码同时进行时，视频播放卡顿，编码的视频丢帧

只看该作者 · 发表于 2022-12-14 15:20:19

看你这 opencv都没有调用gstreamer 的那个mpp的插件