Toybrick

标题: pythonSDK报错：AudioFormat is no set! please check your code! encoder= [打印本页]
作者: jackpang    时间: 2022-11-30 15:04
标题: pythonSDK报错：AudioFormat is no set! please check your code! encoder=
今天用3588的板子测试RTSP解码，使用的是python3-toybrick/stable,now 0.5.10 arm64，在摄像头没开启音频时可以正常解码，但是开启音频后就报错，具体错误如下：
toybrick@debian:~/rknn$ python3 test_multiple_rtsp.py
[11/30 11:25:50.410] T/: decode_get_frame get info changed found

[11/30 11:25:50.411] T/: decoder require buffer w:h [1920:1080] stride [1920:1088] size 4177920

[11/30 11:25:50.413] T/: decode_get_frame get info changed found

[11/30 11:25:50.414] T/: decoder require buffer w:h [1920:1080] stride [1920:1088] size 4177920

[11/30 11:25:50.414] T/: decode_get_frame get info changed found

[11/30 11:25:50.414] T/: decoder require buffer w:h [1920:1080] stride [1920:1088] size 4177920

rga_api version 1.7.5_[1]
[11/30 11:25:50.737] E/: (onTransmitIn in :35): AudioFormat is no set! please check your code! encoder=
Aborted
toybrick@debian:~/rknn$

作者: jefferyzhang    时间: 2022-11-30 15:27
jouralctl 的log发附件出来
作者: jackpang    时间: 2022-11-30 16:11
日志文件
作者: jackpang    时间: 2022-11-30 16:13
jefferyzhang 发表于 2022-11-30 15:27
jouralctl 的log发附件出来

上传了，还请看一下
作者: jefferyzhang    时间: 2022-11-30 16:31
试一下这个版本：
链接: https://pan.baidu.com/s/1osmp6i0W7EdjEitY78LfVw?pwd=6rr7 提取码: 6rr7 复制这段内容后打开百度网盘手机App，操作更方便哦
--来自百度网盘超级会员v6的分享
作者: jackpang    时间: 2022-11-30 16:52
jefferyzhang 发表于 2022-11-30 16:31
试一下这个版本：
链接: https://pan.baidu.com/s/1osmp6i0W7EdjEitY78LfVw?pwd=6rr7 提取码: 6rr7 复制这 ...

不行啊，还是报错(toRgaBuffer in :93): IMEngine: invalid buffer !
作者: jefferyzhang    时间: 2022-11-30 17:24
从这个log可以看出rtsp发送了PT为0的 buffer，而pt=0的描述是完全空白的，这个无法解析。
还有就是你是不是rtsp服务端有开QoS，如果开了QoS这个pythonsdk的简单rtsp是无法支持的。
你的rtsp服务端是什么软件？
这里只能尽量绕过不报错，但能不能解码出视频得看是否正常支持，试下这个：
链接: https://pan.baidu.com/s/1Eaogj-yggGX6BoYavU_EVA?pwd=mivj 提取码: mivj 复制这段内容后打开百度网盘手机App，操作更方便哦
--来自百度网盘超级会员v6的分享
作者: jackpang    时间: 2022-11-30 17:48
jefferyzhang 发表于 2022-11-30 17:24
从这个log可以看出rtsp发送了PT为0的 buffer，而pt=0的描述是完全空白的，这个无法解析。
还有就是你是不是 ...

我是直接从水星摄像头拉主码流
作者: jackpang    时间: 2022-11-30 17:55
jefferyzhang 发表于 2022-11-30 17:24
从这个log可以看出rtsp发送了PT为0的 buffer，而pt=0的描述是完全空白的，这个无法解析。
还有就是你是不是 ...

还是不行，难道不可以通过参数控制只解视频，不解音频吗，做AI推理也只用到帧图片而已
  1. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:  + format id: 107
  2. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:    - encoder = vnd.onvif.metadata
  3. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:    - clockrate = 90000
  4. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:    - channels = 1
  5. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:    - format parameters:
  6. Nov 30 17:50:09 debian.toybrick python3[95749]: D/:      [DecoderTag] = h3c-v3
  7. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClientUnit::startVideoRecvThread: tcp=0, isMulticast=0
  8. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClient: stopping all video recv threads (rtsp://admin:Abc_123deF@192.168.1.66:554/stream1)...
  9. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClient: stopping all video recv threads (rtsp://admin:Abc_123deF@192.168.1.66:554/stream1)... done
  10. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClientUnit::startAudioRecvThread: tcp=0, isMulticast=0
  11. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClient: stopping all audio recv threads (rtsp://admin:Abc_123deF@192.168.1.66:554/stream1)...
  12. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: RtspClient: stopping all audio recv threads (rtsp://admin:Abc_123deF@192.168.1.66:554/stream1)... done
  13. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: listening rtp port 30342
  14. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: setup 30342 , 30343, uri: rtsp://192.168.1.66/media/video1/video
  15. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: listening rtcp port 30353
  16. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: listening rtcp port 30343
  17. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: listening rtp port 30352
  18. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: Audio SSRC Changed! PT[0] 8 -> 1596829884
  19. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  20. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: Audio SSRC Changed! PT[0] 8 -> 1598168554
  21. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  22. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: Audio SSRC Changed! PT[0] 8 -> 691814805
  23. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  24. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  25. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  26. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  27. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  28. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  29. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  30. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: # Found[1] server_port: 10074 - 10075
  31. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  32. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  33. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  34. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: # Found[1] port: 10074 - 10075
  35. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  36. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  37. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  38. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: # Found[1] server_port: 10072 - 10073
  39. Nov 30 17:50:09 debian.toybrick python3[95749]: mpp_buffer: mpp_buffer_ref_dec found non-positive ref_count 0 caller try_proc_dec_task
  40. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f7c004a20] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  41. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f780045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  42. Nov 30 17:50:09 debian.toybrick python3[95749]: W/: (transmitTo in :38): [0x7f700045e0] transmitIn buffer PT_AUDIO is filter out by VDecoder_UNIT
  43. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: setup 30352 , 30353, uri: rtsp://192.168.1.66/media/video1/audio1
  44. Nov 30 17:50:09 debian.toybrick python3[95749]: D/: # Found[1] port: 10072 - 10073
  45. Nov 30 17:50:09 debian.toybrick python3[95749]: mpp_buffer: mpp_buffer_get_size invalid NULL input from MppFrameBuffer
  46. Nov 30 17:50:09 debian.toybrick python3[95749]: E/: (setValidSize in :113): Buffer setValidSize(3133440) is larger than real size(0) !
复制代码

作者: jefferyzhang    时间: 2022-11-30 18:21
不急，我慢慢给你改，我手上没这个摄像头，不知道从哪里开始报错的，我只能看到log推测哪里有问题改上去。
作者: jefferyzhang    时间: 2022-12-1 10:17
再试下这个：
链接: https://pan.baidu.com/s/1g6fwcAPiqdQ3E4oY3KWTSg?pwd=e642 提取码: e642 复制这段内容后打开百度网盘手机App，操作更方便哦
--来自百度网盘超级会员v6的分享
作者: jackpang    时间: 2022-12-1 11:58
jefferyzhang 发表于 2022-12-1 10:17
再试下这个：
链接: https://pan.baidu.com/s/1g6fwcAPiqdQ3E4oY3KWTSg?pwd=e642 提取码: e642 复制这段内 ...

感谢，没报错了。但是这个SDK用于生产环境还是风险大，毕竟市面的摄像头多。
作者: jefferyzhang    时间: 2022-12-1 12:02
本帖最后由 jefferyzhang 于 2022-12-1 12:07 编辑
jackpang 发表于 2022-12-1 11:58
感谢，没报错了。但是这个SDK用于生产环境还是风险大，毕竟市面的摄像头多。 ...

那是肯定的，这套只用于教学目的，写成python目的就是排除生产环境，快速开发和评估，谁会在嵌入式上用python做产品。。。等你产品原型出来后要去自行用底层的so去实现的。关键是你还用的是国产摄像头，国产摄像头协议很多都不标准，只能去一个个兼容，没办法，很多第三方库也都是这么兼容过来的。




欢迎光临 Toybrick (https://t.rock-chips.com/) Powered by Discuz! X3.3