Zenmuse H20 camera video stream decoding error

Completed

Follow

Hugo Tovar

• March 23, 2023 19:23

I am attempting to use the OSDK with a Raspberry Pi 4 8Gb and a Jetson Nano to control and obtain data from a Matrice M300 RTK drone with its software updated to the latest version. However, I am encountering issues when trying to run either the 'camera_stream_callback_sample' or 'camera_stream_poll_sample' functions. When I select the main camera option, the video received and displayed on the computer appears distorted, as shown in the attached image. However, when I choose the FPV camera option, there are no issues. Similarly, when I run the 'camera_h264_callback_sample' function, I receive a file from the FPV option that can be played in VLC, but the file from the main camera (H20) cannot be opened.

0

• 

  DJI Developer Support

  • March 24, 2023 04:04

  H20 H264 is based on GDR format, please use ffplay to check whether H264 is valid OSDK saves H20 video streams as H264 files, which cannot be played using ffmpeg/ffplay（https://sdk-forum.dji.net/hc/en-us/articles/900006766943）

  0

  Comment actions Permalink
• 

  Hugo Tovar

  • March 24, 2023 16:36

  The problem is more about the real time image that opencv imshow displays, since I need them to do some image procesing on them, but the images that I get aren't useful because of these problem. The recordings are a double check to verify later some other data.

  0

  Comment actions Permalink
• 

  DJI Developer Support

  • March 27, 2023 02:30

  In the sample, FFmpeg is used for real-time decoding, and the parameter -flags2 showall is added. You can refer to the decoding of the sample to process the image in real time. https://github.com/dji-sdk/Onboard-SDK/blob/master/osdk-core/advanced-sensing/camera_stream/src/dji_camera_stream_decoder.cpp

  0

  Comment actions Permalink
• 

  Hugo Tovar

  • March 27, 2023 17:33

  I'm trying to run the sample using ffmpeg version 3.4 and the latest version but get the same error.

  

  I had to update the code to be able to use the latest version of ffmpeg. But there is a problem with the linker that doesnt allow me to finish the proccess. Maybe is a problem with the architecture since its a Raspberry Pi 4? what others boards would recommend to use?

  0

  Comment actions Permalink

Please sign in to leave a comment.