Axelera Assist

Hello!I am facing some problems tring to run a network inference on the Metis M.2 with Raspberry Pi via Docker. To try the inference I have followed the steps in the guide (https://support.axelera.ai/hc/en-us/articles/26362016484114-Bring-up-Voyager-SDK-in-Raspberry-Pi-5) but after trying to run the inference.py, I face the following errors:  (venv) root@iak:/home/voyager-sdk# ./inference.py yolov8s-coco-onnx ./media/traffic1_480p.mp4INFO    : Using device metis-1:1:0WARNING : Failed to get OpenCL platforms : clGetPlatformIDs failed: PLATFORM_NOT_FOUND_KHRWARNING : Please check the documentation for installation instructionsINFO    : Default OpenGL backend gl,3,3 overridden, using gles,3,1INFO    : Network type: NetworkType.SINGLE_MODELINFO    : InputINFO    :   └─detectionsStream Paused:  57%|██████████████████████████████████████████████████████▊                                         | 4/7 [00:00<00:00,  5.56/s][ERROR][axeWaitForCommandList]: Uio wait kernel failed with return c

0000:01:00.0 : Axelera AI Metis AIPU (rev 02)ERROR:axelera.runtime:No AIPU driver found in lsmod outputERROR: AXR_ERROR_CONNECTION_ERROR: No AIPU driver found in lsmod output 

Hello,I am currently working with a lane detection model named culane_res18.onnx, and I would like to know how I can run this model on the Metis M2 device.Here are some details about the setup:The model is culane_res18.onnx, which is a lane detection model. The training dataset is from the CULane dataset, and I have the link to the dataset here. The model file can be found here.Could you kindly guide me on how to run this lane detection model on Metis M2? I would appreciate any step-by-step instructions or basic guidance on how to deploy this model, considering that I have both the ONNX model and the dataset.Looking forward to your response!Best regards,Chinmay Mulgund

Hello!!Do you have any news about support for Ubuntu 24.04? I wanted to use axelera on raspberry pi cm5 however there is no support for 22.04 and I wanted to run it on the host, not in a docker container.Thank you 😊

Hello,I’m having trouble getting my AXELERA M2 to be recognized under Linux. Until recently everything was working fine; now when I try to run an inference the SDK can’t find the board. I’ve already tried rebooting, but the issue persists.aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ source venv/bin/activate(venv) aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ ./inference.py yolov5s-v7-coco chinmay/Vehicle-CV-ADAS/assets/challenge_video.mp4 --save-output ~/Desktop/voyager-sdk/chinmay/saved_videos/yolov5s-v7-coco.mp4ERROR : No target device found in lspci outputERROR : AXR_ERROR_CONNECTION_ERROR: No target device found in lspci output 

​@Victor Labian I’m also trying to setup rpi5 with metis m2. I have question what host OS you was using and have you changed anything in config.txt?

Hi, I am also working on same thing deploying the YOLOPv2 model on to Metis M2. I have downloadded the data set from bdd100k and arranged in this manner.voyager-sdk/├── data/│   └── yolopv2_dataset/│       ├── images/│       ├── labels/│       ├── cal.txt│       ├── val.txt│       └── data.yaml├── customers/│   └── my_yolopv2/│       └── yolopv2.pt└── yolopv2-custom.yamlso when i am trying to deploy the model using yaml I am getting this error(venv) aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ ./deploy.py customers/my_yolopv2/yolopv2.yamlINFO    : Using device metis-0:1:0INFO    : Detected Metis type as pcieINFO    : Compiling network yolopv2-custom /home/aravind/Desktop/voyager-sdk/customers/my_yolopv2/yolopv2.yamlINFO    : Compile model: yolopv2-customINFO    : Imported DataAdapter ObjDataAdaptor from /home/aravind/Desktop/voyager-sdk/ax_datasets/objdataadapter.py/home/aravind/.cache/axelera/venvs/93f45ae3/lib/python3.10/site-packages/torch/serialization.py:779: UserWarning: 'to

hello I hijack this a little bit … once I type “lspci” it gave me following output on a pi 5 0001:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)0001:01:00.0 Processing accelerators: Axelera AI Metis AIPU (rev 02)0002:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)0002:01:00.0 Ethernet controller: Raspberry Pi Ltd RP1 PCIe 2.0 South Bridge how to activate the device and getting to work with my python3 script  

Hi, I followed the "Install Voyager SDK in a Docker Container" guide to try installing SDK version 1.2.5, but I encountered an error with one of the packages during the process.Could you please let me know how to resolve this issue?The attached file contains the installation log. ---    [150/193] Installing development libraries    [150/193] Install axelera_compiler    [150/193] python3 -m pip --disable-pip-version-check install --index-url XXXX@software.axelera.ai/artifactory/axelera-dev-pypi/ --no-deps -c cfg//requirements-ubuntu-2204-amd64.txt "axelera_compiler"    [150/193] Looking in indexes: XXXX:****@software.axelera.ai/artifactory/axelera-dev-pypi/    [150/193] WARNING: 401 Error, Credentials not correct for https://software.axelera.ai/artifactory/axelera-dev-pypi/axelera-compiler/(X)    [150/193] ERROR: Cannot install axelera_compiler because these package versions have conflicting dependencies.    [150/193] The conflict is caused by:    [150/193]     The user requested axeler

it ask me every time about token … yes I use my registered emailand I did not found any token in my accountwtf

Dear all,I am trying to get my hands on the Metis PCIe card on my current working PC, beingmainboard: Asus Prime X570-P CPU: AMD Ryzen 9 3900X OS: Ubuntu 24.04.2 LTS, 6.8.0-58-generic x86_64The first issue I face is that the warm-reset does not seem to work for me, i.e. if I issue a reboot without re-powering the system, the Metis device does not show up in lspci, while after a power-down (with physical PSU switching off) it is there. This is reproducible and based on my experience points to either my mainboard BIOS issuing a wrong reset sequence to the PCIe slot, or the device itself not issuing a full reset sequence on warm-boot. Since I know how to get the card detected, this is only an annoyance - but I saw that also another user of AMD64 system in the forum has similar issues and the problem might go deeper.Which leads to the second issue I am observing and which I filed already a support request but realized here would be the better place to discuss it.According to David M. to ch

Hello my name is Kevin, i am trying to work on a project that the m.2 is going to interfere with my cpu and later on maybe my gpu.is there a way, and another question whats the command to go on rtsp?  my system is:AMD 9950X3D CPUAMD 7900XTX GPU48 gb DDR5 on 8200MHZMetis Axelera AI on an m.2 port. 

This is a very interesting thread as I’m testing and M.2 card on an AMD system as well and am having what seems to be the exact same problems. Things added / tried: kernel command line includes md_iommu=off pcie_aspm=off update-pciids → resulted in card having the correct name in lspci : Axelera AI Metis AIPU (rev 02) axdevice --refresh -v results in: INFO:axelera.runtime.axdevice:Removing 0000:20:04.0INFO:axelera.runtime.axdevice:PCIE rescan0000:25:00.0 : Axelera AI Metis AIPU (rev 02)INFO:axelera.runtime:Found PCI device: 25:00.0 Processing accelerators: Axelera AI Metis AIPU (rev 02)INFO:axelera.runtime:Found AIPU driver: metis                  90112  0WARNING:axelera.runtime:4PCI device count mismatch: lspci=1, triton=0(removed the traceback) just tried rerunning install.sh which mentions at the end: building operators refreshing pcie and firmware WARNING: Failed to refresh pcie and firmware  tried removing metis-dkms / rmmod metis and reinstalling results in same warning as ab

Hello,I know that axelera does not work in the attention mechanism. For example, can we convert the attention mechanism in the yolov11 architecture to convolution? Have you done any research or read on this subject? Does Softmax structure work in Axelera? (as far as I know, no) Is there a way to turn Softmax into a working structure?

Hello, is there a detailed document where I can learn about the Axelera chip architecture and how to do the quantization in it?Thanks

Seems Ubuntu 24.04 is not supported at the moment. What are the plans for this version? Can you give some insight on what needs to be changed to get this installed on that version?

After finally getting my metis card properly accessible through PCI, it turned out I need to upgrade the FW to the latest version:(venv) root@zefir-PC:~/voyager-sdk# axdevice [libdmabuf.c:1720] Device command returned an error code.[libdmabuf.c:1721] Consider inspecting the device log via `triton_trace --slog`.[...]Device 0: metis-0:a:0 board_type=pcie fwver='v1.2.0-rc2+bl1-stage0' clock=800MHz(0-3:0MHz) mvm=0-3:-1%(venv) root@zefir-PC:~/voyager-sdk# triton_trace --slogVersion mismatch!Actual="v1.2.0-rc2+bl1" Expected="v1.2.5"Please update device firmware before continuing.I proceeded like described in FW flashing tutorial at github(venv) root@zefir-PC:~/Axelera.ai/firmware_release_public_v1.2.0# ./flash_update.sh flash_bundle.img>>> loading new AIPU runtime stage0>>> the following operations updates the flash content Make sure to only run this operation if really needed Also make sure to not power cycle the devices or it might be rendered non-functional.do y

Hi all,not sure if my issue is related to this one, but symptoms are at least similar, so I hope it matches best here. Otherwise sorry for derailing.I am trying to get my hands on the PCIe metis card on my AMD64 based system driven by an ASUS PRIME X570-P mainboard under Ubuntu-24.04 (6.8.0-58-generic x86_64). First issue was that the card did no show up under lspci, no matter which kernel boot options I tried. Then I looked into the mainboard BIOS to double-check the peripheral config and noticed that the PCIe slots are not fully independent. In fact, the board has two PCIex16 slots and three PCIex1, of whose the latter are meant for expansion cards and the former for graphic cards. They are pre-configured for ‘auto’ mode, which means that the BIOS detects how the slots are populated and splits available lanes between the two x16 slots.I changed this ‘auto’ setting to manually split the lanes to ‘x8+x8’ and after rebooting the card is now visible to the kernel:zefir@zefir-PC:~$ lspci

I am encountering issues when trying to deploy and run the YOLOv5m6 ONNX model on the Metis M.2. Below are the details of the steps I followed and the issues that arose:1. Deployment Process:I used the following command to deploy the model:./deploy.py customers/mymodels/yolov5m6-object-detection.yamlThe deployment was successful, but I encountered warnings about memory overflow during the buffer fitting process:LowerTIR failed to fit buffers into memory after iteration 0/4. Pool usage: {L1: alloc:4,195,840B avail:4,194,304B over:1,536B util:100.04%, L2: alloc:6,864,384B avail:8,077,312B over:0B util:84.98%, DDR: alloc:54,275,328B avail:260,046,848B over:0B util:20.87%}2. Inference Process:I then attempted to run inference with the following command:./inference.py c-yolov5m6-object-detection chinmay/Vehicle-CV-ADAS/assets/VID-20250208-WA0008.mp4 --save-output ~/Desktop/voyager-sdk/chinmay/saved_videos/output.mp4The model failed to run due to a ShapeInferenceError related to incompatibl

Hello,I wanted to test the Yolo11n model. But I couldn't do this because I got an error in the calibrating part. Is this because of the use of attention mechanism in Yolo11 and Yolo12?Error: ValueError: Some modules couldn’t be simplified: <… activation.Softmax> <…. matmul.MatMul>In addition, when I looked at the ready yaml files on voyager sdk github, I saw that the yolov8x model was not available. Is there a special reason for this? Because when I prepared and tried a new yolov8x yaml file, I got the similar error again. But as far as I know, the attention mechanism is not used in Yolov8x.Thanks

Hi,I know Metis can be used for ML etc. but wondering whether it’s suitable to do some more low-level operations like big matrix multiplication, FFT of data stored in Metis memory etc. - more like on CUDA (some DSP/Math library)? I assume I could use torch basic math functions? Dominik 

hey,I am an ARM enthusiast and I wanted to check if you have any compatibility list.Are you supporting NXP and MediaTek?What about the Broadcom CPU on latest Raspberry Pi?

Hey!Is there any support planned for 24.04? I don’t have a machine available with the older Ubuntu version. It says native support on 22.04 here but not that it is completely unsupported. Thanks ➜  voyager-sdk git:(release/v1.2.5) ./install.sh --all --media --user florianzaruba[at]gmail.com --token <token>Install/update prerequisite packages required by the installer itself (y/n): yInstall/update prerequisite packages required by the installer itself (y/n): yERROR: cfg/config-ubuntu-2404-amd64.yaml: File not found 

Are you planning on launching an iOS/Android app for this community? So far I’ve been on desktop but coming in from mobile would be a good option to have too.

I’m scoping out the Metis M.2 module for a compact edge AI project and wondering how capable it really is. I’m mainly interested in real-time object detection on 1080p video streams, maybe 2–4 cameras max.Can it handle multi-stream inputs in real-time, or is that better suited to the PCIe version?