Page 1 of 1

请问usb摄像头如何运行yolov5rtsp推流的示例?

Posted: 2024-08-15 9:12
by lihualihua_1
这是我的usb摄像头信息,型号为OV2659,可以正常使用

Code: Select all

[root@luckfox luckfox_rtsp_yolov5_demo]# v4l2-ctl --device=/dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'MJPG' (Motion-JPEG, compressed)
                Size: Discrete 1920x1080
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 1280x1024
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 1280x720
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 800x600
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 640x480
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 352x288
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 320x240
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 176x144
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 160x120
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 144x144
                        Interval: Discrete 0.033s (30.000 fps)
        [1]: 'YUYV' (YUYV 4:2:2)
                Size: Discrete 1920x1080
                        Interval: Discrete 0.200s (5.000 fps)
                Size: Discrete 1280x1024
                        Interval: Discrete 0.200s (5.000 fps)
                Size: Discrete 1280x720
                        Interval: Discrete 0.100s (10.000 fps)
                Size: Discrete 800x600
                        Interval: Discrete 0.067s (15.000 fps)
                Size: Discrete 640x480
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 352x288
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 320x240
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 176x144
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 160x120
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 144x144
                        Interval: Discrete 0.033s (30.000 fps)
摄像头对应设备/dev/video0,直接运行demo会发生以下错误

Code: Select all

(gdb) run
Starting program: /root/luckfox_rtsp_yolov5_demo/luckfox_rtsp_yolov5
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 255], n_elems=1632000, size=1632000, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=1, name=286, n_dims=4, dims=[1, 40, 40, 255], n_elems=408000, size=408000, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=2, name=288, n_dims=4, dims=[1, 20, 20, 255], n_elems=102000, size=102000, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
model is NHWC input fmt
model input height=640, width=640, channel=3
init rknn model success!
load lable ./model/coco_80_labels_list.txt
rkaiq log level ff0
ID: 0, sensor_name is , iqfiles is /etc/iqfiles

Program received signal SIGSEGV, Segmentation fault.
0xa6c4ef3c in ?? () from /oem/usr/lib/librkaiq.so
(gdb) bt
#0  0xa6c4ef3c in ?? () from /oem/usr/lib/librkaiq.so
#1  0x00141ec8 in SAMPLE_COMM_ISP_Init (CamId=0, WDRMode=RK_AIQ_WORKING_MODE_NORMAL, MultiCam=RK_FALSE,
    iq_file_dir=0x160424 "/etc/iqfiles")
    at /home/cro/Sdk/luckfox-pico/media/samples/common/isp3.x/sample_comm_isp.c:131
#2  0x000156b4 in main ()
(gdb)

Re: 请问usb摄像头如何运行yolov5rtsp推流的示例?

Posted: 2024-08-15 10:22
by Crocodile
您好,目前rkmpi库的VI组件只支持走MIPI来绑定管道,所以例程中的VI VPSS组件部分需要替换为其他图像捕获方式(比如V4l2 ),然后开两个线程,一个线程把图像格式转换后写入到RKNN的输入BUFFER中获取推理结果,另一个线程获取推理结果图像处理后再构建缓冲块放到VENC中进行硬件编码为H264推流。 本质上还是替换掉VI VPSS阶段的处理,使用其他的方式替换也可以,这里仅提供一个思路