LuckFox_Pico_plus Using the self trained rknn model to generate errors

2024-08-08 7:37

There is no problem running the luck_rknn instance on LuckFox_Pico_plus using the official model, but using the self trained rknn model reports an error。

Code: Select all

this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
this device is not whitelisted for capture cvi
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=48, scale=0.121512
  index=1, name=291, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=43, scale=0.104087
  index=2, name=292, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-5, scale=0.159591
model is NHWC input fmt
model input height=640, width=640, channel=3
load lable ./model/coco_80_labels_list.txt
Open ./model/coco_80_labels_list.txt fail!
[  406.631961] stream_cif_mipi_id0: s_power 1, entity use_count 1
   devpath = /dev/video11
   driver = rkisp_v7
   card = rkisp_mainpath
   bus_info = platform:rkisp-vir0
   version = 20000
   capabilities = 84201000
   device_caps = 4201000
   fmt = UYVY 4:2:2  59565955
   fmt = Y/CbCr 4:2:2  3631564e
   fmt = Y/CrCb 4:2:2  3136564e
   fmt = Y/CrCb 4:2:0  3132564e
       size = 32 x 16  ~  2304 x 1296  (+8 +8)
   fmt = Y/CbCr 4:2:0  3231564e
   fmt = Y/CrCb 4:2:0 (N-C)  31324d4e
   fmt = Y/CbCr 4:2:0 (N-C)  32314d4e
rkaiq log level ff0
[  406.905242] stream_cif_mipi_id0: open video, entity use_countt 2
[  406.905467] stream_cif_mipi_id1: open video, entity use_countt 1
/dev/video11 does not support changing fps
rga_api version 1.10.0_[2]
[  406.940851] rkisp rkisp-vir0: first params buf queue
[  406.943074] rkisp_hw ffa00000.rkisp: set isp clk = 198000000Hz
[  406.943145] rkcif-mipi-lvds: sditf_reinit_mode, mode->rdbk_mode 0, mode->name rkisp-vir0, link_mode 1
[  406.944990] rkcif-mipi-lvds: stream[0] start streaming
[  406.945154] rockchip-mipi-csi2 ffa20000.mipi-csi2: stream on, src_sd: 512f62f4, sd_name:rockchip-csi2-dphy0
[  406.945183] rockchip-mipi-csi2 ffa20000.mipi-csi2: stream ON
[  406.945369] rockchip-csi2-dphy0: dphy0, data_rate_mbps 506
[  406.945401] rockchip-csi2-dphy csi2-dphy0: csi2_dphy_s_stream stream on:1, dphy0
[  406.945497] rockchip-csi2-dphy csi2-dphy0: csi2_dphy_s_stream stream on:1, dphy0
[  407.977770] rga_mm: [tgid:880] Decrement the reference of handle[39] when the user exits
[  407.977888] rga_mm: [tgid:880] Decrement the reference of handle[40] when the user exits
[  407.978073] stream_cif_mipi_id1: close video, entity use_count 0
[  407.978182] stream_cif_mipi_id0: close video, entity use_count 1
[  407.978493] rkcif-mipi-lvds: stream[0] start stopping, total mode 0x2, cur 0Segmentation fault (core dumped)
x2
[  408.002159] rockchip-mipi-csi2 ffa20000.mipi-csi2: stream off, src_sd: 512f62f4, sd_name:rockchip-csi2-dphy0
[  408.002205] rockchip-mipi-csi2 ffa20000.mipi-csi2: str[root@luckfox tmp]# eam OFF
[  408.002957] rockchip-csi2-dphy csi2-dphy0: csi2_dphy_s_stream_stop stream stop, dphy0
[  408.002982] rockchip-csi2-dphy csi2-dphy0: csi2_dphy_s_stream stream on:0, dphy0
[  408.003025] rockchip-csi2-dphy csi2-dphy0: csi2_dphy_s_stream stream on:0, dphy0
[  408.003251] rkcif-mipi-lvds: stream[0] stopping finished, dma_en 0x0
[  408.003625] stream_cif_mipi_id0: s_power 0, entity use_count 0

2024-08-08 10:23

The message "Open ./model/coco_80_labels_list.txt fail! Please check if the file exists and whether it contains the category names you are trying to recognize.

2024-08-12 6:38

Crocodile wrote: ↑2024-08-08 10:23 The message "Open ./model/coco_80_labels_list.txt fail! Please check if the file exists and whether it contains the category names you are trying to recognize.

Yes, I added it/ model/coco_80_labels_list.txt， But now I am using my own trained model box_combinance<=thres_i8.

2024-08-12 7:35

Based on your log, I cannot determine your issue. It seems that the debug print information is not displaying correctly due to data type issues. The Yolov5 model used for training is not fixed, and any problem in the process could lead to inference failure on the Luckfox Pico. The source code has been verified to successfully perform inference with the official model. If you are using a custom model and have correctly set OBJ_CLASS_NUM and coco_80_labels_list.txt, the issue is most likely related to the model training phase.