Verification:$ gst-inspect-1.0 rockchipmpp
Plugin Details:
Name rockchipmpp
Description Rockchip Mpp Video Plugin
Filename /usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstrockchipmpp.so
Version 1.14.4
License LGPL
Source module gst-rockchip
Binary package GStreamer Rockchip Plug-ins
Origin URL Unknown package origin
mpph264enc: Rockchip Mpp H264 Encoder
mpph265enc: Rockchip Mpp H265 Encoder
mppjpegdec: Rockchip's MPP JPEG image decoder
mppjpegenc: Rockchip Mpp JPEG Encoder
mppvideodec: Rockchip's MPP video decoder
mppvpxalphadecodebin: VP8/VP9 Alpha Decoder
6 features:
+-- 6 elements
$ gst-inspect-1.0 decodebin
Factory Details:
Rank none (0)
Long-name Decoder Bin
Klass Generic/Bin/Decoder
Description Autoplug and decode to raw media
Author Edward Hervey <edward.hervey@collabora.co.uk>, Sebastian Dröge <sebastian.droege@collabora.co.uk>
Plugin Details:
Name playback
Description various playback elements
Filename /usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstplayback.so
Version 1.20.1
License LGPL
Source module gst-plugins-base
Source release date 2022-03-14
Binary package GStreamer Base Plugins (Ubuntu)
Origin URL https://launchpad.net/distros/ubuntu/+source/gst-plugins-base1.0
GObject
+----GInitiallyUnowned
+----GstObject
+----GstElement
+----GstBin
+----GstDecodeBin
And the error when running:
AXELERA_CONFIGURE_BOARD=,30 ./inference.py yolov8l-coco-onnx ./media/traffic1_480p.mp4 --no-display -vv
DEBUG :axelera.app.device_manager: Using device metis-0:1:0
DEBUG :axelera.app.network: Create network from /home/pi/voyager-sdk/ax_models/zoo/yolo/object_detection/yolov8l-coco-onnx.yaml
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/base_onnx.py to /home/pi/voyager-sdk/ax_models/base_onnx.py
TRACE :axelera.app.utils: Changing weight_path from weights/yolov8l_ultralytics_v8.1.0.onnx to /home/pi/voyager-sdk/ax_models/zoo/yolo/object_detection/weights/yolov8l_ultralytics_v8.1.0.onnx
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_datasets/objdataadapter.py to /home/pi/voyager-sdk/ax_datasets/objdataadapter.py
TRACE :axelera.app.utils: Changing labels_path from $AXELERA_FRAMEWORK/ax_datasets/labels/coco.names to /home/pi/voyager-sdk/ax_datasets/labels/coco.names
TRACE :axelera.app.utils: Changing repr_imgs_dir_path from $AXELERA_FRAMEWORK/data/coco2017_400_b680128 to /home/pi/voyager-sdk/data/coco2017_400_b680128
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/decoders/yolo.py to /home/pi/voyager-sdk/ax_models/decoders/yolo.py
DEBUG :git.cmd: Popen(:'git', 'version'], cwd=/home/pi/voyager-sdk, stdin=None, shell=False, universal_newlines=False)
DEBUG :git.cmd: Popen(:'git', 'version'], cwd=/home/pi/voyager-sdk, stdin=None, shell=False, universal_newlines=False)
TRACE :axelera.app.utils: Changing weight_path from weights/yolov8l_ultralytics_v8.1.0.onnx to /home/pi/.cache/axelera/weights/yolov8l-coco-onnx/yolov8l_ultralytics_v8.1.0.onnx
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/base_onnx.py to /home/pi/voyager-sdk/ax_models/base_onnx.py
TRACE :axelera.app.utils: Changing weight_path from weights/yolov8l_ultralytics_v8.1.0.onnx to /home/pi/voyager-sdk/ax_models/zoo/yolo/object_detection/weights/yolov8l_ultralytics_v8.1.0.onnx
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_datasets/objdataadapter.py to /home/pi/voyager-sdk/ax_datasets/objdataadapter.py
TRACE :axelera.app.utils: Changing labels_path from $AXELERA_FRAMEWORK/ax_datasets/labels/coco.names to /home/pi/voyager-sdk/ax_datasets/labels/coco.names
TRACE :axelera.app.utils: Changing repr_imgs_dir_path from $AXELERA_FRAMEWORK/data/coco2017_400_b680128 to /home/pi/voyager-sdk/data/coco2017_400_b680128
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/decoders/yolo.py to /home/pi/voyager-sdk/ax_models/decoders/yolo.py
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/base_onnx.py to /home/pi/voyager-sdk/ax_models/base_onnx.py
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_datasets/objdataadapter.py to /home/pi/voyager-sdk/ax_datasets/objdataadapter.py
TRACE :axelera.app.utils: Changing labels_path from $AXELERA_FRAMEWORK/ax_datasets/labels/coco.names to /home/pi/voyager-sdk/ax_datasets/labels/coco.names
TRACE :axelera.app.utils: Changing repr_imgs_dir_path from $AXELERA_FRAMEWORK/data/coco2017_400_b680128 to /home/pi/voyager-sdk/data/coco2017_400_b680128
TRACE :axelera.app.utils: Changing class_path from $AXELERA_FRAMEWORK/ax_models/decoders/yolo.py to /home/pi/voyager-sdk/ax_models/decoders/yolo.py
DEBUG :axelera.app.network: Register custom operator 'decodeyolo' with class DecodeYolo from /home/pi/voyager-sdk/ax_models/decoders/yolo.py
TRACE :axelera.app.pipeline: The source is not clearly declared, default as full frame
DEBUG :axelera.app.network: Deploying for 1 cores instead of 4 due to max_compiler_cores setting (for metis: m2)
TRACE :axelera.app.network: 1. build/yolov8l-coco-onnx/yolov8l-coco-onnx/1/manifest.json: Available
DEBUG :axelera.app.device_manager: Reconfiguring devices with device_firmware=1, mvm_utilisation_core_0=30%, clock_profile_core_0=800MHz, mvm_utilisation_core_1=30%, clock_profile_core_1=800MHz, mvm_utilisation_core_2=30%, clock_profile_core_2=800MHz, mvm_utilisation_core_3=30%, clock_profile_core_3=800MHz
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
DEBUG :axelera.app.utils: Found OpenCL GPU devices for platform ARM Platform: Mali-G610 r0p0
DEBUG :axelera.app.pipe.manager:
DEBUG :axelera.app.pipe.manager: --- EXECUTION VIEW ---
DEBUG :axelera.app.pipe.manager: Input
DEBUG :axelera.app.pipe.manager: └─detections
DEBUG :axelera.app.pipe.manager:
DEBUG :axelera.app.pipe.manager: --- RESULT VIEW ---
DEBUG :axelera.app.pipe.manager: Input
DEBUG :axelera.app.pipe.manager: └─detections
DEBUG :axelera.app.pipe.manager: Network type: NetworkType.SINGLE_MODEL
TRACE :axelera.app.transforms: composite_expansion transformed:
TRACE :axelera.app.transforms: TorchToTensor(input_layout='NHWC', output_layout='NCHW', datatype='float32', scale=True)
TRACE :axelera.app.transforms: to:
TRACE :axelera.app.transforms: ToTensor()
TRACE :axelera.app.transforms: PermuteChannels(input_layout=<TensorLayout.NHWC: 2>, output_layout=<TensorLayout.NCHW: 1>)
TRACE :axelera.app.transforms: TypeCast(datatype='float32')
TRACE :axelera.app.transforms: Normalize(mean='0', std='255.0', tensor_layout=<TensorLayout.NCHW: 1>, format='RGB')
TRACE :axelera.app.transforms: opencl_letterbox_with_normalize transformed:
TRACE :axelera.app.transforms: Letterbox(height=640, width=640, scaleup=True, half_pixel_centers=False, pad_val=114, image_width=1000000, image_height=1000000)
TRACE :axelera.app.transforms: ToTensor()
TRACE :axelera.app.transforms: PermuteChannels(input_layout=<TensorLayout.NHWC: 2>, output_layout=<TensorLayout.NCHW: 1>)
TRACE :axelera.app.transforms: TypeCast(datatype='float32')
TRACE :axelera.app.transforms: Normalize(mean='0', std='255.0', tensor_layout=<TensorLayout.NCHW: 1>, format='RGB')
TRACE :axelera.app.transforms: to:
TRACE :axelera.app.transforms: OpenCLetterBoxToTensorAndNormalize(width=640, height=640, scaleup=True, pad_val=114, mean=T0.0], std=a1.0], datatype='float32')
DEBUG :yolo: Model Type: YoloFamily.YOLOv8 (YOLOv8 pattern:
DEBUG :yolo: - 6 output tensors (anchor-free)
DEBUG :yolo: - 3 regression branches (64 channels)
DEBUG :yolo: - 3 classification branches (80 channels)
DEBUG :yolo: - Channel pattern: o64, 64, 64, 80, 80, 80]
DEBUG :yolo: - Shapes: EB1, 80, 80, 64], a1, 40, 40, 64], ,1, 20, 20, 64], ,1, 80, 80, 80], ,1, 40, 40, 80], ,1, 20, 20, 80]])
TRACE :axelera.app.pipe.manager: Parse input and output options
DEBUG :axelera.app.pipe.io: FPS of /home/pi/.cache/axelera/media/traffic1_480p.mp4: 60
DEBUG :axelera.app.operators.inference: Enabled 4x1 inference queues for yolov8l-coco-onnx because model_cores=1 and num_cores=4
DEBUG :axelera.app.operators.inference: Using inferencenet name=inference-task0 model=/home/pi/voyager-sdk/build/yolov8l-coco-onnx/yolov8l-coco-onnx/1/model.json devices=metis-0:1:0 double_buffer=True dmabuf_inputs=True dmabuf_outputs=True num_children=4
DEBUG :axelera.app.pipe.gst: GST representation written to build/yolov8l-coco-onnx/logs/gst_pipeline.yaml
TRACE :axelera.app.pipe.gst: environment at gst pipeline construction:
TRACE :axelera.app.pipe.gst: {'AXELERA_CONFIGURE_BOARD': ',30',
TRACE :axelera.app.pipe.gst: 'AXELERA_DEVICE_DIR': '/opt/axelera/device-1.3.1-1/omega',
TRACE :axelera.app.pipe.gst: 'AXELERA_EXAMPLES_DIR': '/opt/axelera/compiler-examples-1.3.1-1',
TRACE :axelera.app.pipe.gst: 'AXELERA_FRAMEWORK': '/home/pi/voyager-sdk',
TRACE :axelera.app.pipe.gst: 'AXELERA_RISCV_TOOLCHAIN_DIR': '/opt/axelera/riscv-gnu-newlib-toolchain-409b951ba662-7',
TRACE :axelera.app.pipe.gst: 'AXELERA_RUNTIME_DIR': '/opt/axelera/runtime-1.3.1-1',
TRACE :axelera.app.pipe.gst: 'AXE_PROFILING_CONFIG': ''}
DEBUG :axelera.app.pipe.gst: Started building gst pipeline
TRACE :axelera.app.pipe.gst_helper: Creating filesrc0 filesrc(location=/home/pi/.cache/axelera/media/traffic1_480p.mp4)
TRACE :axelera.app.pipe.gst_helper: Creating decodebin0 decodebin(force-sw-decoders=True, caps=video/x-raw(ANY), expose-all-streams=False)
TRACE :axelera.app.pipe.gst_helper: Creating decodebin-link0 axinplace(lib=libinplace_addstreamid.so, mode=meta, options=stream_id:0)
TRACE :axelera.app.pipe.gst_helper: Creating axtransform-colorconvert0 axtransform(lib=libtransform_colorconvert.so, options=format:rgb)
TRACE :axelera.app.pipe.gst_helper: Creating queue0 queue(max-size-buffers=4, max-size-time=0, max-size-bytes=0)
TRACE :axelera.app.pipe.gst_helper: Creating inference-task0 axinferencenet(model=/home/pi/voyager-sdk/build/yolov8l-coco-onnx/yolov8l-coco-onnx/1/model.json, devices=metis-0:1:0, double_buffer=True, dmabuf_inputs=True, dmabuf_outputs=True, num_children=4, preprocess0_lib=libtransform_resize_cl.so, preprocess0_options=width:640;height:640;padding:114;letterbox:1;scale_up:1;to_tensor:1;mean:0.,0.,0.;std:1.,1.,1.;quant_scale:0.003921568859368563;quant_zeropoint:-128.0, preprocess1_lib=libtransform_padding.so, preprocess1_options=padding:0,0,1,1,1,15,0,0;fill:0, preprocess1_batch=1, postprocess0_lib=libdecode_yolov8.so, postprocess0_options=meta_key:detections;classes:80;confidence_threshold:0.25;scales:0.06286332756280899,0.06317535787820816,0.06615706533193588,0.11186011880636215,0.13197654485702515,0.12347966432571411;padding:0,0,0,0,0,0,0,0|0,0,0,0,0,0,0,0|0,0,0,0,0,0,0,0|0,0,0,0,0,0,0,48|0,0,0,0,0,0,0,48|0,0,0,0,0,0,0,48;zero_points:-67,-59,-50,121,97,89;topk:30000;multiclass:0;classlabels_file:/tmp/tmpcp89gkyr;model_width:640;model_height:640;scale_up:1;letterbox:1, postprocess0_mode=read, postprocess1_lib=libinplace_nms.so, postprocess1_options=meta_key:detections;max_boxes:300;nms_threshold:0.45;class_agnostic:1;location:CPU)
TRACE :axelera.app.pipe.gst_helper: Creating appsink0 appsink(max-buffers=4, drop=False, sync=False)
TRACE :axelera.app.pipe.gst_helper: Deferring linking decodebin0 with decodebin-link0
TRACE :axelera.app.pipe.gst_helper: Explicit linking queue0.src with inference-task0.pad0
/home/pi/voyager-sdk/axelera/app/pipe/gst_helper.py:365: Warning: g_value_set_uint: assertion 'G_VALUE_HOLDS_UINT (value)' failed
pipeline_dot_file.write_text(Gst.debug_bin_to_dot_data(pipeline, Gst.DebugGraphDetails.ALL))
GERROR]tinitializePaths]: Device Infra library Include path does not exist: /opt/axelera/device-1.3.1-1/omega/infra/include
TRACE :axelera.app.pipe.gst_helper: Pipeline state change: pipeline0, written graph to /home/pi/voyager-sdk/build/yolov8l-coco-onnx/logs/pipeline_graph_NULL_to_READY.svg
If there is any more information I should provide, please let me know.
Best regards,
Heo