Toybrick

标题: opencv+gstreamer+mpp库问题请教 [打印本页]

作者: erii 时间: 2022-8-8 20:25
标题: opencv+gstreamer+mpp库问题请教
原本想在qt中用opencv+gstreamer实时采集摄像头并显示，发现在高分辨率下效果并不理想，于是搜了相关资料，打算先用命令行把mpp库和gstreamer测试下，
//安装了相关的库以及gstreamer的插件，相关帖子搜不到有用的答案，所以来问问下大佬们，除了plugins插件外都是apt安装的系统内的库源
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, width=1920, height=1080, framerate=30/1 ! queue! jpegparse ! queue ! mppjpegdec ! queue ! videoconvert ! queue ! rkximagesink
调用后有视频图像但是很卡，最近刚接触gstreamer相关应用，求助下是什么问题，板子是rk3399-proD，感谢！

mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
WARNING: from element /GstPipeline:pipeline0/GstXImageSink:ximagesink0: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstXImageSink:ximagesink0:
There may be a timestamping problem, or this computer is too slow.
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0
mpp[24571]: vcodec_service: vcodec_service_reg_wr reg size mismatch wr 636 rd 736
mpp[24571]: HAL_JPEG_VDPU2: jpegd_setup_pp pp_enable 0

作者: erii 时间: 2022-8-10 16:12
重新编译安装了mmp库后，似乎可以正常使用了。
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, width=1920, height=1080, framerate=30/1 ! queue! mppjpegdec ! queue ! videoconvert ! queue ! rkximagesink
以上命令能正常采集显示1080P的摄像头数据，但当把rkximagesink换成ximagesink或者qt中使用appsink的时候，肉眼可见的卡顿，查看top资源占用，CPU占用300~400。请问有人知道如何能够通过opencv+gstreamer流畅采集摄像头数据吗？

作者: Jinkk 时间: 2022-11-29 16:10

erii 发表于 2022-8-10 16:12
重新编译安装了mmp库后，似乎可以正常使用了。
gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg, ...

我碰见的问题是，1080p视频解码和编码同时进行时，视频播放卡顿，编码的视频丢帧

作者: argo_zsj 时间: 2022-12-14 15:20
看你这 opencv都没有调用gstreamer 的那个mpp的插件

欢迎光临 Toybrick (https://t.rock-chips.com/)