Luckfox Forums

A short text to describe your forum
https://forums.luckfox.com/

Help required for running a custom object detection model into pico pi board

https://forums.luckfox.com/viewtopic.php?t=2127

Page 2 of 3

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-09-24 14:46
by pointer
Infitechlab1 wrote: ↑2025-09-23 9:49
Infitechlab1 wrote: ↑2025-09-15 12:54 Hi @pointer, see after doing all the process again, I have converted the model to rknn, but now i am not getting how to run it on device without adb. Many of the things are still not clear, how to run the ai on board after converting the model to rknn format. If you want to have a my rknn mode, will attach it. Kindly have a look and let me know.

Thank you.
Hi,
I have attached my rknn model in this post, if anyone from luckfor or any other user has ever runned a custom yolov5 model in the 1106/1103 based board, kindlt let me know. I am still trying what is possible. Kindly help.

Thank you.
I'm a bit confused about where you're stuck. The process should be quite straightforward: you just need to upload yolov5_rtsp_streamer, yolov5s_relu.rknn, and my.txt to the same folder on your development board, give execute permission to yolov5_rtsp_streamer, and run:
./yolov5_rtsp_streamer -m yolov5s_relu.rknn -l my.txt
Then you can view the RTSP stream using VLC. Of course, this assumes you've correctly set up RNDIS according to the official wiki: https://wiki.luckfox.com/Luckfox-Pico-Pi/CSI-Camera/.
I've tested your model and it runs without issues, though I should note the accuracy is quite poor - there are some significant false detections. For other configuration options, you can check usage details by running ./yolov5_rtsp_streamer --help.

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-09-25 5:27
by Infitechlab1
Ok, Let me summerize this for you.

1. You only pointed out this issue that we are facing, poor detection. You only told to use the rockchip yolov5 repo to train model, as it rknn optimized. But the parameters needed for accuracy, etc. not mentioned.

2. Now as you have checked that my model is working correctly, kindly mention the steps for running object detection, cause on wiki, under the pico pi section, only thing mentioned under rknn is how to setup env and run readily available examples, no source on to how to run a custom model and incorporate it with live cam feed.

3. Now i assume by RTSP stremear you are refering to live cam feed, about which, no knowledge given under the pico pi section. Here are the wiki link we are referring to: 1.https://wiki.luckfox.com/Luckfox-Pico-Pi/RKNN 2. https://wiki.luckfox.com/Luckfox-Pico-Pi/CSI-Camera 3. https://wiki.luckfox.com/Luckfox-Pico-Pi.

See as far as i am understanding, either I am not referring to some page or you are referring to some document which I haven found yet. I have went throught the pico pi wiki and I am still not getting it. My problem satatement is very simple, "How am I suppose to run a custom model of any sort, say yolov5, etc. which ever is supported by rv1106G3". Kindly look into this and guide me.

Thank you.

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-09-25 13:32
by pointer
Infitechlab1 wrote: ↑2025-09-25 5:27 Ok, Let me summerize this for you.

1. You only pointed out this issue that we are facing, poor detection. You only told to use the rockchip yolov5 repo to train model, as it rknn optimized. But the parameters needed for accuracy, etc. not mentioned.

2. Now as you have checked that my model is working correctly, kindly mention the steps for running object detection, cause on wiki, under the pico pi section, only thing mentioned under rknn is how to setup env and run readily available examples, no source on to how to run a custom model and incorporate it with live cam feed.

3. Now i assume by RTSP stremear you are refering to live cam feed, about which, no knowledge given under the pico pi section. Here are the wiki link we are referring to: 1.https://wiki.luckfox.com/Luckfox-Pico-Pi/RKNN 2. https://wiki.luckfox.com/Luckfox-Pico-Pi/CSI-Camera 3. https://wiki.luckfox.com/Luckfox-Pico-Pi.

See as far as i am understanding, either I am not referring to some page or you are referring to some document which I haven found yet. I have went throught the pico pi wiki and I am still not getting it. My problem satatement is very simple, "How am I suppose to run a custom model of any sort, say yolov5, etc. which ever is supported by rv1106G3". Kindly look into this and guide me.

Thank you.
To be honest, I'm finding it challenging to help you because you're not following the detailed steps I've already provided. There appear to be fundamental knowledge gaps that need to be addressed first. I suggest you carefully re-read my previous responses before asking further questions.

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-15 9:52
by Infitechlab1
Hi,
Now as you said, I am lacking the knowledge about board and its working. Consedring the same, I went through all your examples and ran all examples, that are readily made available by you. After understanding the working, compiletion and execution of the examples, I recreated the env, freshly cloned the the git repos and then edited the files as and where required. Still the Ai was unable to run. I am using the same rkmpi example. Here is the github link https://github.com/Infilux/luckfoxAi.git where I have put both the zip files as the forum dosen't take file more than 10MB. Kindly check and let me know whats the issue. I have followed all your step and used the rockchip yolov5 repo for training my model. All the points mentioned in the forum or in the wiki are read and considerd while creating my very own example. Kindly check all you need and let me know what the matter now.

To keep it very clear and simple I have only changed the files name and the path to it in the code before building it. I am also putting the error log from the board below, kindly check.

Give me the resolution for this quick.

Error log:

Code: Select all

[root@luckfox luckfox_pico_rtsp_yolov5_demo]# RkLunch-stop.sh
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ./luckfox_pico_rtsp_yolov5 
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003911
  index=1, name=381, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=2, name=383, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
model is NHWC input fmt
model input height=640, width=640, channel=3
init rknn model success!
load lable ./model/my.txt
Create Pool success !
rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:22
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/mis5001_CMK-OT2115-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfccffe473b
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        16:31:00-311 {dump              :064} ---------------------------------------------------------
RTVersion        16:31:00-311 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        16:31:00-311 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        16:31:00-311 {dump              :067} ---------------------------------------------------------
(null)           16:31:00-311 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           16:31:00-312 {read_log_level    :098} text is all=4
(null)           16:31:00-312 {read_log_level    :100} module is all, log_level is 4
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
(null)           16:31:00-317 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484
vi_dev_init
RKViDev          16:31:00-319 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          16:31:00-321 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceSensorV4 16:31:00-324 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=55
RTDeviceSensorV4 16:31:00-324 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=57
RTDeviceSensorV4 16:31:00-325 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 16:31:00-325 {close             :112} do RTDeviceSensorV4L2 close
RKViChn          16:31:00-326 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          16:31:00-327 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          16:31:00-327 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          16:31:00-327 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          16:31:00-327 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             16:31:00-327 {prepareRuntime    :378} mb pool create success, MBCnt= 2
RTIsp3x          16:31:00-329 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
cmpi             16:31:00-331 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             16:31:00-331 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             16:31:00-331 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             16:31:00-331 {createRuntime     :638} 	 camera id                  : 0
cmpi             16:31:00-331 {createRuntime     :639} 	 sensor name                : m00_b_mis5001 4-0031
cmpi             16:31:00-332 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             16:31:00-332 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             16:31:00-332 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             16:31:00-332 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             16:31:00-332 {createRuntime     :646} 	 sensor raw width           : 2592
cmpi             16:31:00-333 {createRuntime     :647} 	 sensor raw height          : 1944
cmpi             16:31:00-333 {createRuntime     :648} ---------------------------------------------------------
cmpi             16:31:00-333 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             16:31:00-333 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             16:31:00-333 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             16:31:00-333 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             16:31:00-334 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             16:31:00-334 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             16:31:00-334 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             16:31:00-334 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             16:31:00-334 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             16:31:00-334 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             16:31:00-335 {createRuntime     :667} 	 sensor link type         : 2
cmpi             16:31:00-335 {createRuntime     :668} 	 sensor is united         : 0
cmpi             16:31:00-335 {createRuntime     :672} ---------------------------------------------------------
cmpi             16:31:00-335 {createRuntime     :711} [non-WRAP MODE]: buff size = 518400
RTIsp3x          16:31:00-337 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceV4L2     16:31:00-339 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     16:31:00-340 {open              :143} open video name(/dev/vide[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ls -l ./model/yolov5_relu.rknn
ls: ./model/yolov5_relu.rknn: No such file or directory
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ls -l ./model/yolov5ET.rknn
-rw-rw-rw-    1 root     root      21379380 Oct 15 07:25 ./model/yolov5ET.rknn
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ./luckfox_pico_rtsp_yolov5 
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003911
  index=1, name=381, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=2, name=383, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
model is NHWC input fmt
model input height=640, width=640, channel=3
init rknn model success!
load lable ./model/my.txt
Create Pool success !
rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:22
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/mis5001_CMK-OT2115-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfccffe473b
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        16:33:16-037 {dump              :064} ---------------------------------------------------------
RTVersion        16:33:16-037 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        16:33:16-037 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        16:33:16-037 {dump              :067} ---------------------------------------------------------
(null)           16:33:16-037 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           16:33:16-038 {read_log_level    :098} text is all=4
(null)           16:33:16-038 {read_log_level    :100} module is all, log_level is 4
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
(null)           16:33:16-043 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484
vi_dev_init
RKViDev          16:33:16-045 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          16:33:16-047 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceSensorV4 16:33:16-049 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=55
RTDeviceSensorV4 16:33:16-050 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=57
RTDeviceSensorV4 16:33:16-050 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 16:33:16-050 {close             :112} do RTDeviceSensorV4L2 close
RKViChn          16:33:16-051 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          16:33:16-051 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          16:33:16-051 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          16:33:16-051 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          16:33:16-051 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             16:33:16-052 {prepareRuntime    :378} mb pool create success, MBCnt= 2
RTIsp3x          16:33:16-054 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
cmpi             16:33:16-056 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             16:33:16-056 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             16:33:16-056 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             16:33:16-056 {createRuntime     :638} 	 camera id                  : 0
cmpi             16:33:16-056 {createRuntime     :639} 	 sensor name                : m00_b_mis5001 4-0031
cmpi             16:33:16-056 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             16:33:16-056 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             16:33:16-056 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             16:33:16-056 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             16:33:16-056 {createRuntime     :646} 	 sensor raw width           : 2592
cmpi             16:33:16-057 {createRuntime     :647} 	 sensor raw height          : 1944
cmpi             16:33:16-057 {createRuntime     :648} ---------------------------------------------------------
cmpi             16:33:16-057 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             16:33:16-057 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             16:33:16-057 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             16:33:16-057 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             16:33:16-057 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             16:33:16-057 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             16:33:16-057 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             16:33:16-057 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             16:33:16-057 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             16:33:16-057 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             16:33:16-057 {createRuntime     :667} 	 sensor link type         : 2
cmpi             16:33:16-058 {createRuntime     :668} 	 sensor is united         : 0
cmpi             16:33:16-058 {createRuntime     :672} ---------------------------------------------------------
cmpi             16:33:16-058 {createRuntime     :711} [non-WRAP MODE]: buff size = 518400
RTIsp3x          16:33:16-061 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceV4L2     16:33:16-063 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     16:33:16-064 {open              :143} open video name(/dev/video11)
RKViChn          16:33:16-064 {setFrameRate      :1469} [vi] dev(0) ch(0) illegal param s32SrcFrameRate(0) s32DstFrameRate(0)
RTDeviceV4L2     16:33:16-064 {ispCameraInfo     :567} current device:/dev/video11 isn't compatible(cap:0x84201000) device,memoryType:4, retry:0
RTDeviceV4L2     16:33:16-065 {ispInitFormat     :767} ioctl VIDIOC_S_FMT OK
cmpi             16:33:16-065 {start             :1093} =========== vi Start startRuntime ===========
RTDeviceV4L2     16:33:16-065 {ispStreamOn       :458} do ispStreamOn start
CAMHW:K:camId:0, notify_isp_stream_status on
=== 0 ===
RTDeviceV4L2     16:33:16-125 {ispStreamOn       :511} do ispStreamOn done
venc_init
MpiAdapterEncode 16:33:16-126 {ma_encode_create  :1743} ringbuf buf_size 520192
MpiAdapterEncode 16:33:16-129 {ma_encode_create  :1782} mem_fd = 61
venc init success
=== 1 ===
cmpi             16:33:16-191 {mb_get_buffer_by_i:433} allocated buffer(this=0x529570, data=(nil), size=0, id=-1)
cmpi             16:33:16-192 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 520192
Segmentation fault (core dumped)
[root@luckfox luckfox_pico_rtsp_yo

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-17 5:55
by Infitechlab1
Hi @pointer We also tried your 'yolov5_rtsp_streamer' by command './yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt ', it get's execuited and then nothing, no output. It occupies 100% system memory and then unless we stop it, it does nothing. We are unable to access the VLC live stream also. I have put the logs below. Kindly look into it.



Code: Select all

Adjusted Target (for VENC & RTSP): 1280x720
Aspect Ratio is 16:9
Actual VI Capture Resolution: 1280x720
--------------------------------

--- Model & Encoder Configuration ---
Model Path: yolov5s_relu.rknn
Label Path: ./model/coco_80_labels_list.txt
Box Threshold: 0.25
NMS Threshold: 0.45
Output FPS: 25
Quality Level: 80
-----------------------------------

rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

^Z[4]+  Stopped                    ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt
[root@luckfox new]# reboot
[root@luckfox new]# (base) infilux@infilux-HP-EliteBook-Folio-9470m:~$ clear

(base) infilux@infilux-HP-EliteBook-Folio-9470m:~$ adb shell
[root@luckfox ]# cd ro
rockchip_test/  root/
[root@luckfox ]# cd root//new/
[root@luckfox new]# RkLunch-stop.sh
Stop Application ...
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
[root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt 

--- Resolution Configuration ---
User input: 1280x720
Adjusted Target (for VENC & RTSP): 1280x720
Aspect Ratio is 16:9
Actual VI Capture Resolution: 1280x720
--------------------------------

--- Model & Encoder Configuration ---
Model Path: yolov5s_relu.rknn
Label Path: ./model/coco_80_labels_list.txt
Box Threshold: 0.25
NMS Threshold: 0.45
Output FPS: 25
Quality Level: 80
-----------------------------------

rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:13
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/mis5001_CMK-OT2115-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfccffe473b
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        13:38:10-778 {dump              :064} ---------------------------------------------------------
RTVersion        13:38:10-779 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        13:38:10-779 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        13:38:10-779 {dump              :067} ---------------------------------------------------------
(null)           13:38:10-779 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           13:38:10-780 {read_log_level    :098} text is all=4
(null)           13:38:10-780 {read_log_level    :100} module is all, log_level is 4
(null)           13:38:10-785 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003905
  index=1, name=286, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003902
  index=2, name=288, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003892
model is NHWC input fmt
model input height=640, width=640, channel=3
load label ./model/coco_80_labels_list.txt
Open ./model/coco_80_labels_list.txt fail!
Load ./model/coco_80_labels_list.txt failed!
Initializing VI device with new logic...
RKViDev          13:38:10-989 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          13:38:10-991 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceSensorV4 13:38:10-994 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=53
RTDeviceSensorV4 13:38:10-994 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=55
RTDeviceSensorV4 13:38:10-994 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 13:38:10-994 {close             :112} do RTDeviceSensorV4L2 close
VI device enabled and bound to pipe 0 successfully.
Initializing VI channel 0 (1280x720)...
RKViChn          13:38:10-996 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          13:38:10-996 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          13:38:10-996 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          13:38:10-996 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          13:38:10-996 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             13:38:10-996 {prepareRuntime    :378} mb pool create success, MBCnt= 3
RTIsp3x          13:38:10-998 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
cmpi             13:38:11-000 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             13:38:11-000 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             13:38:11-001 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             13:38:11-001 {createRuntime     :638} 	 camera id                  : 0
cmpi             13:38:11-001 {createRuntime     :639} 	 sensor name                : m00_b_mis5001 4-0031
cmpi             13:38:11-001 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             13:38:11-001 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             13:38:11-001 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             13:38:11-001 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             13:38:11-001 {createRuntime     :646} 	 sensor raw width           : 2592
cmpi             13:38:11-001 {createRuntime     :647} 	 sensor raw height          : 1944
cmpi             13:38:11-002 {createRuntime     :648} ---------------------------------------------------------
cmpi             13:38:11-002 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             13:38:11-002 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             13:38:11-002 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             13:38:11-002 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             13:38:11-002 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             13:38:11-002 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             13:38:11-002 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             13:38:11-002 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             13:38:11-002 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             13:38:11-002 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             13:38:11-003 {createRuntime     :667} 	 sensor link type         : 2
cmpi             13:38:11-003 {createRuntime     :668} 	 sensor is united         : 0
cmpi             13:38:11-003 {createRuntime     :672} ---------------------------------------------------------
cmpi             13:38:11-003 {createRuntime     :711} [non-WRAP MODE]: buff size = 1382400
[root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt 

--- Resolution Configuration ---
[root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt 

--- Resolution Configuration ---
User input: 1280x720
Adjusted Target (for VENC & RTSP): 1280x720
Aspect Ratio is 16:9
Actual VI Capture Resolution: 1280x720
--------------------------------

--- Model & Encoder Configuration ---
Model Path: yolov5s_relu.rknn
Label Path: ./model/coco_80_labels_list.txt
Box Threshold: 0.25
NMS Threshold: 0.45
Output FPS: 25
Quality Level: 80
-----------------------------------

rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

^Z[3]+  Stopped                    ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt
[root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -I my.txt

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-17 7:16
by pointer
Infitechlab1 wrote: ↑2025-10-15 9:52 Hi,
Now as you said, I am lacking the knowledge about board and its working. Consedring the same, I went through all your examples and ran all examples, that are readily made available by you. After understanding the working, compiletion and execution of the examples, I recreated the env, freshly cloned the the git repos and then edited the files as and where required. Still the Ai was unable to run. I am using the same rkmpi example. Here is the github link https://github.com/Infilux/luckfoxAi.git where I have put both the zip files as the forum dosen't take file more than 10MB. Kindly check and let me know whats the issue. I have followed all your step and used the rockchip yolov5 repo for training my model. All the points mentioned in the forum or in the wiki are read and considerd while creating my very own example. Kindly check all you need and let me know what the matter now.

To keep it very clear and simple I have only changed the files name and the path to it in the code before building it. I am also putting the error log from the board below, kindly check.

Give me the resolution for this quick.

Error log:

Code: Select all

[root@luckfox luckfox_pico_rtsp_yolov5_demo]# RkLunch-stop.sh
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ./luckfox_pico_rtsp_yolov5 
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003911
  index=1, name=381, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=2, name=383, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
model is NHWC input fmt
model input height=640, width=640, channel=3
init rknn model success!
load lable ./model/my.txt
Create Pool success !
rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:22
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/mis5001_CMK-OT2115-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfccffe473b
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        16:31:00-311 {dump              :064} ---------------------------------------------------------
RTVersion        16:31:00-311 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        16:31:00-311 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        16:31:00-311 {dump              :067} ---------------------------------------------------------
(null)           16:31:00-311 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           16:31:00-312 {read_log_level    :098} text is all=4
(null)           16:31:00-312 {read_log_level    :100} module is all, log_level is 4
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
(null)           16:31:00-317 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484
vi_dev_init
RKViDev          16:31:00-319 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          16:31:00-321 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceSensorV4 16:31:00-324 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=55
RTDeviceSensorV4 16:31:00-324 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=57
RTDeviceSensorV4 16:31:00-325 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 16:31:00-325 {close             :112} do RTDeviceSensorV4L2 close
RKViChn          16:31:00-326 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          16:31:00-327 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          16:31:00-327 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          16:31:00-327 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          16:31:00-327 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             16:31:00-327 {prepareRuntime    :378} mb pool create success, MBCnt= 2
RTIsp3x          16:31:00-329 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
cmpi             16:31:00-331 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             16:31:00-331 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             16:31:00-331 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             16:31:00-331 {createRuntime     :638} 	 camera id                  : 0
cmpi             16:31:00-331 {createRuntime     :639} 	 sensor name                : m00_b_mis5001 4-0031
cmpi             16:31:00-332 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             16:31:00-332 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             16:31:00-332 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             16:31:00-332 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             16:31:00-332 {createRuntime     :646} 	 sensor raw width           : 2592
cmpi             16:31:00-333 {createRuntime     :647} 	 sensor raw height          : 1944
cmpi             16:31:00-333 {createRuntime     :648} ---------------------------------------------------------
cmpi             16:31:00-333 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             16:31:00-333 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             16:31:00-333 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             16:31:00-333 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             16:31:00-334 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             16:31:00-334 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             16:31:00-334 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             16:31:00-334 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             16:31:00-334 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             16:31:00-334 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             16:31:00-335 {createRuntime     :667} 	 sensor link type         : 2
cmpi             16:31:00-335 {createRuntime     :668} 	 sensor is united         : 0
cmpi             16:31:00-335 {createRuntime     :672} ---------------------------------------------------------
cmpi             16:31:00-335 {createRuntime     :711} [non-WRAP MODE]: buff size = 518400
RTIsp3x          16:31:00-337 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceV4L2     16:31:00-339 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     16:31:00-340 {open              :143} open video name(/dev/vide[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ls -l ./model/yolov5_relu.rknn
ls: ./model/yolov5_relu.rknn: No such file or directory
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ls -l ./model/yolov5ET.rknn
-rw-rw-rw-    1 root     root      21379380 Oct 15 07:25 ./model/yolov5ET.rknn
[root@luckfox luckfox_pico_rtsp_yolov5_demo]# ./luckfox_pico_rtsp_yolov5 
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003911
  index=1, name=381, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=2, name=383, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
model is NHWC input fmt
model input height=640, width=640, channel=3
init rknn model success!
load lable ./model/my.txt
Create Pool success !
rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_mis5001 4-0031, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:22
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/mis5001_CMK-OT2115-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfccffe473b
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        16:33:16-037 {dump              :064} ---------------------------------------------------------
RTVersion        16:33:16-037 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        16:33:16-037 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        16:33:16-037 {dump              :067} ---------------------------------------------------------
(null)           16:33:16-037 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           16:33:16-038 {read_log_level    :098} text is all=4
(null)           16:33:16-038 {read_log_level    :100} module is all, log_level is 4
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
(null)           16:33:16-043 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484
vi_dev_init
RKViDev          16:33:16-045 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          16:33:16-047 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceSensorV4 16:33:16-049 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=55
RTDeviceSensorV4 16:33:16-050 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=57
RTDeviceSensorV4 16:33:16-050 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 16:33:16-050 {close             :112} do RTDeviceSensorV4L2 close
RKViChn          16:33:16-051 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          16:33:16-051 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          16:33:16-051 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          16:33:16-051 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          16:33:16-051 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             16:33:16-052 {prepareRuntime    :378} mb pool create success, MBCnt= 2
RTIsp3x          16:33:16-054 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
cmpi             16:33:16-056 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             16:33:16-056 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             16:33:16-056 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             16:33:16-056 {createRuntime     :638} 	 camera id                  : 0
cmpi             16:33:16-056 {createRuntime     :639} 	 sensor name                : m00_b_mis5001 4-0031
cmpi             16:33:16-056 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             16:33:16-056 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             16:33:16-056 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             16:33:16-056 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             16:33:16-056 {createRuntime     :646} 	 sensor raw width           : 2592
cmpi             16:33:16-057 {createRuntime     :647} 	 sensor raw height          : 1944
cmpi             16:33:16-057 {createRuntime     :648} ---------------------------------------------------------
cmpi             16:33:16-057 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             16:33:16-057 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             16:33:16-057 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             16:33:16-057 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             16:33:16-057 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             16:33:16-057 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             16:33:16-057 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             16:33:16-057 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             16:33:16-057 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             16:33:16-057 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             16:33:16-057 {createRuntime     :667} 	 sensor link type         : 2
cmpi             16:33:16-058 {createRuntime     :668} 	 sensor is united         : 0
cmpi             16:33:16-058 {createRuntime     :672} ---------------------------------------------------------
cmpi             16:33:16-058 {createRuntime     :711} [non-WRAP MODE]: buff size = 518400
RTIsp3x          16:33:16-061 {ispInitDevice     :591} sensor name = m00_b_mis5001 4-0031
RTDeviceV4L2     16:33:16-063 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     16:33:16-064 {open              :143} open video name(/dev/video11)
RKViChn          16:33:16-064 {setFrameRate      :1469} [vi] dev(0) ch(0) illegal param s32SrcFrameRate(0) s32DstFrameRate(0)
RTDeviceV4L2     16:33:16-064 {ispCameraInfo     :567} current device:/dev/video11 isn't compatible(cap:0x84201000) device,memoryType:4, retry:0
RTDeviceV4L2     16:33:16-065 {ispInitFormat     :767} ioctl VIDIOC_S_FMT OK
cmpi             16:33:16-065 {start             :1093} =========== vi Start startRuntime ===========
RTDeviceV4L2     16:33:16-065 {ispStreamOn       :458} do ispStreamOn start
CAMHW:K:camId:0, notify_isp_stream_status on
=== 0 ===
RTDeviceV4L2     16:33:16-125 {ispStreamOn       :511} do ispStreamOn done
venc_init
MpiAdapterEncode 16:33:16-126 {ma_encode_create  :1743} ringbuf buf_size 520192
MpiAdapterEncode 16:33:16-129 {ma_encode_create  :1782} mem_fd = 61
venc init success
=== 1 ===
cmpi             16:33:16-191 {mb_get_buffer_by_i:433} allocated buffer(this=0x529570, data=(nil), size=0, id=-1)
cmpi             16:33:16-192 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 520192
Segmentation fault (core dumped)
[root@luckfox luckfox_pico_rtsp_yo
Perhaps you misunderstood the file I provided. It was actually modified by me based on the official example. You should first try to see if the file I gave you can run properly, rather than attempting to compile one yourself.

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-27 4:28
by Infitechlab1
Hi @pointer, I did that too, just forget to mention. I am putting the log below have a look. It did not detect any object

Code: Select all

[b][root@luckfox new]# RkLunch-stop.sh[/b]
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory

[b][root@luckfox new]# ls[/b]
my.txt                yolov5_rtsp_streamer  yolov5s_relu.rknn

[b][root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -l my.txt[/b]

--- Resolution Configuration ---
User input: 1280x720
Adjusted Target (for VENC & RTSP): 1280x720
Aspect Ratio is 16:9
Actual VI Capture Resolution: 1280x720
--------------------------------

--- Model & Encoder Configuration ---
Model Path: yolov5s_relu.rknn
Label Path: my.txt
Box Threshold: 0.25
NMS Threshold: 0.45
Output FPS: 25
Quality Level: 80
-----------------------------------

rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_sc3336 4-0030, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:13
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/sc3336_CMK-OT2119-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfc0ffc4739
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        12:25:12-004 {dump              :064} ---------------------------------------------------------
RTVersion        12:25:12-004 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        12:25:12-004 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        12:25:12-005 {dump              :067} ---------------------------------------------------------
(null)           12:25:12-005 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           12:25:12-006 {read_log_level    :098} text is all=4
(null)           12:25:12-006 {read_log_level    :100} module is all, log_level is 4
(null)           12:25:12-018 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003905
  index=1, name=286, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003902
  index=2, name=288, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003892
model is NHWC input fmt
model input height=640, width=640, channel=3
load label my.txt
Loaded 2 labels
Init post process: OBJ_CLASS_NUM=2, BOX_THRESH=0.25, NMS_THRESH=0.45
Initializing VI device with new logic...
RKViDev          12:25:12-054 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          12:25:12-056 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
RTDeviceSensorV4 12:25:12-058 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=53
RTDeviceSensorV4 12:25:12-058 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=55
RTDeviceSensorV4 12:25:12-059 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 12:25:12-059 {close             :112} do RTDeviceSensorV4L2 close
VI device enabled and bound to pipe 0 successfully.
Initializing VI channel 0 (1280x720)...
RKViChn          12:25:12-060 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          12:25:12-060 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          12:25:12-060 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          12:25:12-060 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          12:25:12-061 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             12:25:12-061 {prepareRuntime    :378} mb pool create success, MBCnt= 3
RTIsp3x          12:25:12-063 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
cmpi             12:25:12-064 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             12:25:12-065 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             12:25:12-065 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             12:25:12-065 {createRuntime     :638} 	 camera id                  : 0
cmpi             12:25:12-066 {createRuntime     :639} 	 sensor name                : m00_b_sc3336 4-0030
cmpi             12:25:12-066 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             12:25:12-066 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             12:25:12-066 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             12:25:12-066 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             12:25:12-067 {createRuntime     :646} 	 sensor raw width           : 2304
cmpi             12:25:12-067 {createRuntime     :647} 	 sensor raw height          : 1296
cmpi             12:25:12-067 {createRuntime     :648} ---------------------------------------------------------
cmpi             12:25:12-067 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             12:25:12-067 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             12:25:12-067 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             12:25:12-067 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             12:25:12-067 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             12:25:12-068 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             12:25:12-068 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             12:25:12-068 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             12:25:12-068 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             12:25:12-068 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             12:25:12-068 {createRuntime     :667} 	 sensor link type         : 2
cmpi             12:25:12-068 {createRuntime     :668} 	 sensor is united         : 0
cmpi             12:25:12-068 {createRuntime     :672} ---------------------------------------------------------
cmpi             12:25:12-068 {createRuntime     :711} [non-WRAP MODE]: buff size = 1382400
RTIsp3x          12:25:12-073 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
RTDeviceV4L2     12:25:12-075 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     12:25:12-076 {open              :143} open video name(/dev/video11)
RKViChn          12:25:12-076 {setFrameRate      :1469} [vi] dev(0) ch(0) illegal param s32SrcFrameRate(0) s32DstFrameRate(0)
RTDeviceV4L2     12:25:12-076 {ispCameraInfo     :567} current device:/dev/video11 isn't compatible(cap:0x84201000) device,memoryType:4, retry:0
RTDeviceV4L2     12:25:12-076 {ispInitFormat     :767} ioctl VIDIOC_S_FMT OK
cmpi             12:25:12-077 {start             :1093} =========== vi Start startRuntime ===========
RTDeviceV4L2     12:25:12-077 {ispStreamOn       :458} do ispStreamOn start
CAMHW:K:camId:0, notify_isp_stream_status on
RTDeviceV4L2     12:25:12-096 {ispStreamOn       :511} do ispStreamOn done
Initializing VENC channel 0 for 1280x720 @ 25 FPS, Quality: 80
VENC calculated [bpp: 0.0944], final bitrate: 2175 Kbps
MpiAdapterEncode 12:25:12-098 {ma_encode_create  :1743} ringbuf buf_size 2764800
=== 0 ===
MpiAdapterEncode 12:25:12-105 {ma_encode_create  :1782} mem_fd = 59
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484

--- RTSP streaming started ---
URL: rtsp://<your_board_ip>:554/live/0
Press Ctrl+C to exit.

cmpi             12:25:12-133 {mb_get_buffer_by_i:433} allocated buffer(this=0x2b6588, data=(nil), size=0, id=-1)
cmpi             12:25:12-133 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448
=== 1 ===
rga_api version 1.10.1_[0]
MpiAdapterEncode 12:25:12-237 {ma_encode_get_pack:2079} map ptr: 0xa3848000, fd 64
[DEBUG utils.c:134:rtsp_codec_data_parse_from_user_h264] sps 28
[DEBUG utils.c:142:rtsp_codec_data_parse_from_user_h264] pps 4
cmpi             12:25:12-239 {mb_get_buffer_by_i:433} allocated buffer(this=0x2b9a60, data=(nil), size=0, id=-1)
cmpi             12:25:12-239 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448
cmpi             12:25:12-432 {mb_get_buffer_by_i:433} allocated buffer(this=0x2bb298, data=(nil), size=0, id=-1)
cmpi             12:25:12-434 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-28 4:04
by pointer
Infitechlab1 wrote: ↑2025-10-27 4:28 Hi @pointer, I did that too, just forget to mention. I am putting the log below have a look. It did not detect any object

Code: Select all

[b][root@luckfox new]# RkLunch-stop.sh[/b]
Stop Application ...
killall: rkipc: no process killed
killall: udhcpc: no process killed
rkipc exit
ls: /oem/usr/etc/init.d/S??*: No such file or directory

[b][root@luckfox new]# ls[/b]
my.txt                yolov5_rtsp_streamer  yolov5s_relu.rknn

[b][root@luckfox new]# ./yolov5_rtsp_streamer -m yolov5s_relu.rknn -l my.txt[/b]

--- Resolution Configuration ---
User input: 1280x720
Adjusted Target (for VENC & RTSP): 1280x720
Aspect Ratio is 16:9
Actual VI Capture Resolution: 1280x720
--------------------------------

--- Model & Encoder Configuration ---
Model Path: yolov5s_relu.rknn
Label Path: my.txt
Box Threshold: 0.25
NMS Threshold: 0.45
Output FPS: 25
Quality Level: 80
-----------------------------------

rkaiq log level ff1
XCORE:K:rk_aiq_init_lib, ISP HW ver: 32
XCORE:K:
************************** VERSION INFOS **************************
version release date: 2024-2-18
         AIQ:       AIQ v5.0x5.0

git logs:
25bd14e RV1106: smart_door: release rga/isp/mpp for V1.3.0
99d080a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.2
6458e2a RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.1
e8dab39 RV1106: CVR: release rga/isp/mpp for V1.1.0
a021b32 RV1106/RV1103: Battery/Doorbell: release kmpp/rockit-ko for V1.3.0

************************ VERSION INFOS END ************************

ID: 0, sensor_name is m00_b_sc3336 4-0030, iqfiles is /etc/iqfiles
XCORE:K:rk_aiq_uapi_sysctl_preInit_devBufCnt: dev_ent:rkraw_rx, buf_cnt:2
XCORE:E:invalid main scene len!

IPCSERVER:K:cid[0] Process path:/tmp/UNIX.domain0, sockfd:13
XCORE:K:cid[0] rk_aiq_uapi_sysctl_init success. iq:/etc/iqfiles/sc3336_CMK-OT2119-PC1_30IRC-F16.json
XCORE:K:cid[0] rk_aiq_uapi_sysctl_prepare success. mode:0 
rk_aiq_uapi2_sysctl_init/prepare succeed
CAMHW:K:cid[0] start success. isGroup:0, isOnline:1, isMultiIsp:0, init_ens:0x1bfc0ffc4739
XCORE:K:cid[0] rk_aiq_uapi_sysctl_start success.
rk_aiq_uapi2_sysctl_start succeed
rockit log path (null), log_size = 0, can use export rt_log_path=, export rt_log_size= change
log_file = (nil) 
RTVersion        12:25:12-004 {dump              :064} ---------------------------------------------------------
RTVersion        12:25:12-004 {dump              :065} rockit version: git-4720dc10a Tue Apr 30 15:47:55 2024 +0800
RTVersion        12:25:12-004 {dump              :066} rockit building: built- 2024-04-30 15:53:43
RTVersion        12:25:12-005 {dump              :067} ---------------------------------------------------------
(null)           12:25:12-005 {log_level_init    :207} 

 please use echo name=level > /tmp/rt_log_level set log level 
	name: all cmpi mb sys vdec venc rgn vpss vgs tde avs wbc vo vi ai ao aenc adec
	log_level: 0 1 2 3 4 5 6 

rockit default level 4, can use export rt_log_level=x, x=0,1,2,3,4,5,6 change
(null)           12:25:12-006 {read_log_level    :098} text is all=4
(null)           12:25:12-006 {read_log_level    :100} module is all, log_level is 4
(null)           12:25:12-018 {monitor_log_level :149} #Start monitor_log_level thread, arg:(nil)
  index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  index=0, name=output0, n_dims=4, dims=[1, 80, 80, 21], n_elems=134400, size=134400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003905
  index=1, name=286, n_dims=4, dims=[1, 40, 40, 21], n_elems=33600, size=33600, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003902
  index=2, name=288, n_dims=4, dims=[1, 20, 20, 21], n_elems=8400, size=8400, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003892
model is NHWC input fmt
model input height=640, width=640, channel=3
load label my.txt
Loaded 2 labels
Init post process: OBJ_CLASS_NUM=2, BOX_THRESH=0.25, NMS_THRESH=0.45
Initializing VI device with new logic...
RKViDev          12:25:12-054 {vi_set_dev_attr   :612} VI_DEV_ATTR_S all parameter reserved
RTIsp3x          12:25:12-056 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
RTDeviceSensorV4 12:25:12-058 {ispOpenDevice     :502} v4l2_open(/dev/video0), handler=53
RTDeviceSensorV4 12:25:12-058 {ispOpenDevice     :502} v4l2_open(/dev/v4l-subdev2), handler=55
RTDeviceSensorV4 12:25:12-059 {close             :112} do RTDeviceSensorV4L2 close
RTDeviceSensorV4 12:25:12-059 {close             :112} do RTDeviceSensorV4L2 close
VI device enabled and bound to pipe 0 successfully.
Initializing VI channel 0 (1280x720)...
RKViChn          12:25:12-060 {prepareRuntime    :354} ---------------------------------------------------------
RKViChn          12:25:12-060 {prepareRuntime    :356} vi version: 1.22, name:vvi
RKViChn          12:25:12-060 {prepareRuntime    :357} rockit-ko version: vmpi:28ee389dbc33
RKViChn          12:25:12-060 {prepareRuntime    :358} rockit-ko building: -2024-05-24-18:15:06
RKViChn          12:25:12-061 {prepareRuntime    :359} ---------------------------------------------------------
cmpi             12:25:12-061 {prepareRuntime    :378} mb pool create success, MBCnt= 3
RTIsp3x          12:25:12-063 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
cmpi             12:25:12-064 {createRuntime     :634} >>>>>>>>> Sensor link info dump: <<<<<<<<<
cmpi             12:25:12-065 {createRuntime     :636} 	 vicap media name           : /dev/media0
cmpi             12:25:12-065 {createRuntime     :637} 	 vicap model name           : rkcif-mipi-lvds
cmpi             12:25:12-065 {createRuntime     :638} 	 camera id                  : 0
cmpi             12:25:12-066 {createRuntime     :639} 	 sensor name                : m00_b_sc3336 4-0030
cmpi             12:25:12-066 {createRuntime     :641} 	 stream_cif_mipi_id0 video name: /dev/video0
cmpi             12:25:12-066 {createRuntime     :642} 	 stream_cif_mipi_id1 video name: /dev/video1
cmpi             12:25:12-066 {createRuntime     :643} 	 stream_cif_mipi_id2 video name: /dev/video2
cmpi             12:25:12-066 {createRuntime     :644} 	 stream_cif_mipi_id3 video name: /dev/video3
cmpi             12:25:12-067 {createRuntime     :646} 	 sensor raw width           : 2304
cmpi             12:25:12-067 {createRuntime     :647} 	 sensor raw height          : 1296
cmpi             12:25:12-067 {createRuntime     :648} ---------------------------------------------------------
cmpi             12:25:12-067 {createRuntime     :654} 	 isp media name           : /dev/media1
cmpi             12:25:12-067 {createRuntime     :655} 	 isp model name           : rkisp0
cmpi             12:25:12-067 {createRuntime     :656} 	 isp driver name          : rkisp-vir0
cmpi             12:25:12-067 {createRuntime     :657} 	 isp dev name             : /dev/v4l-subdev3
cmpi             12:25:12-067 {createRuntime     :659} 	 isp rawrd0_m_path        : /dev/video17
cmpi             12:25:12-068 {createRuntime     :660} 	 isp rawrd1_l_path        : 
cmpi             12:25:12-068 {createRuntime     :661} 	 isp rawrd2_s_path        : /dev/video18
cmpi             12:25:12-068 {createRuntime     :664} 	 mainpath video name      : /dev/video11
cmpi             12:25:12-068 {createRuntime     :665} 	 selfpath video name      : /dev/video12
cmpi             12:25:12-068 {createRuntime     :666} 	 bypasspath video name    : /dev/video13
cmpi             12:25:12-068 {createRuntime     :667} 	 sensor link type         : 2
cmpi             12:25:12-068 {createRuntime     :668} 	 sensor is united         : 0
cmpi             12:25:12-068 {createRuntime     :672} ---------------------------------------------------------
cmpi             12:25:12-068 {createRuntime     :711} [non-WRAP MODE]: buff size = 1382400
RTIsp3x          12:25:12-073 {ispInitDevice     :591} sensor name = m00_b_sc3336 4-0030
RTDeviceV4L2     12:25:12-075 {open              :137} cameraIndex:0, entityName:rkisp_mainpath
RTDeviceV4L2     12:25:12-076 {open              :143} open video name(/dev/video11)
RKViChn          12:25:12-076 {setFrameRate      :1469} [vi] dev(0) ch(0) illegal param s32SrcFrameRate(0) s32DstFrameRate(0)
RTDeviceV4L2     12:25:12-076 {ispCameraInfo     :567} current device:/dev/video11 isn't compatible(cap:0x84201000) device,memoryType:4, retry:0
RTDeviceV4L2     12:25:12-076 {ispInitFormat     :767} ioctl VIDIOC_S_FMT OK
cmpi             12:25:12-077 {start             :1093} =========== vi Start startRuntime ===========
RTDeviceV4L2     12:25:12-077 {ispStreamOn       :458} do ispStreamOn start
CAMHW:K:camId:0, notify_isp_stream_status on
RTDeviceV4L2     12:25:12-096 {ispStreamOn       :511} do ispStreamOn done
Initializing VENC channel 0 for 1280x720 @ 25 FPS, Quality: 80
VENC calculated [bpp: 0.0944], final bitrate: 2175 Kbps
MpiAdapterEncode 12:25:12-098 {ma_encode_create  :1743} ringbuf buf_size 2764800
=== 0 ===
MpiAdapterEncode 12:25:12-105 {ma_encode_create  :1782} mem_fd = 59
[INFO  rtsp_demo.c:280:rtsp_new_demo] rtsp server demo starting on port 554
[DEBUG rtsp_demo.c:480:rtsp_new_session] add session path: /live/0
rtsp streamq_alloc size is 1753484

--- RTSP streaming started ---
URL: rtsp://<your_board_ip>:554/live/0
Press Ctrl+C to exit.

cmpi             12:25:12-133 {mb_get_buffer_by_i:433} allocated buffer(this=0x2b6588, data=(nil), size=0, id=-1)
cmpi             12:25:12-133 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448
=== 1 ===
rga_api version 1.10.1_[0]
MpiAdapterEncode 12:25:12-237 {ma_encode_get_pack:2079} map ptr: 0xa3848000, fd 64
[DEBUG utils.c:134:rtsp_codec_data_parse_from_user_h264] sps 28
[DEBUG utils.c:142:rtsp_codec_data_parse_from_user_h264] pps 4
cmpi             12:25:12-239 {mb_get_buffer_by_i:433} allocated buffer(this=0x2b9a60, data=(nil), size=0, id=-1)
cmpi             12:25:12-239 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448
cmpi             12:25:12-432 {mb_get_buffer_by_i:433} allocated buffer(this=0x2bb298, data=(nil), size=0, id=-1)
cmpi             12:25:12-434 {getFrameRuntime   :1347} -------------------------------vviBuf->buf_size: 1384448
Since I haven't set up print messages for detected content, wouldn't it be more straightforward for you to view the RTSP stream directly with VLC?

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-10-28 12:26
by Infitechlab1
You mean, in your model, you are not printing the object lable in the terminal? The resion i am looking at terminal rather than VLC is in some on the cases I tested the VLC, which was unable to stream. Apart from that in the postprocess.h where the BOX and NMS threshold is given, when I tried to increase the threshold to say 55 the model did not worked (its the default model which luckfox has given). Whats the matter can you explain and why is it not working cause threshold is some thing for accuracy.

Re: Help required for running a custom object detection model into pico pi board

Posted: 2025-11-03 6:36
by Infitechlab1
Kindly reply on the same. we are waiting for the responce.
All times are UTC
Page 2 of 3

Powered by phpBB® Forum Software © phpBB Limited