Skip to main content

Axelera Assist

Dive in here for expert tips, Axelera AI product or customer support, or to get a helping hand from the community

41 Topics
Axelera CMX
Axelera Team
Axelera CMXAxelera Team
published in Support Central
New to the Community? Here's everything you need to knowBlog

🌟 Welcome Axplorers! Here’s a crash course in getting the most out of your brand new Axelera AI community. Your hub for innovation, collaboration and Axploration!You’ve just stepped into Axelera AI’s new community, where ideas thrive, connections are forged, and the future of AI is shaped. This platform is designed to help you engage, share, and discover all things Axelera and AI. What Can You Do Here?Explore: Dive into discussions, post your thoughts, and share your expertise. Support: Get help, find support, and help others to do amazing things. Learn: Discover resources, tutorials, and insider tips on Axelera’s technology. Connect: Network with AI enthusiasts, innovators, and the Axelera team. Come say hello and introduce yourself! Compete: Earn points, badges, and ranks for your activity—top the leaderboard for rewards! Creating a New PostYou’re welcome to create as many new posts in as many different places as possible. In fact, you’re encouraged to do so!Just click the “New Post

1670
Axelera CMX
Axelera Team
S
Cadet
saraCadet
asked in Voyager SDK
inference on a frame obtained from the memory space

Hi again ​@Spanner ! 😊I need to infer an image obtained from byte data stored in a memory space (https://docs.python.org/3/library/mmap.html) and after converting the bytes I get an image.I've seen the sources available for create_inference_stream and I know that I can make inferences to images (https://github.com/axelera-ai-hub/voyager-sdk/blob/release/v1.2.5/docs/tutorials/application.md), but I have to specify the/path/to/file. But in this case I won't have that information.In the code I'll have this line where I read the bytes in the memory space:        frame_size=image_width*image_height*3 //RGB        frame_bytes = mm.read(frame_size)And then I get the new image:      frame = np.frombuffer(frame_bytes,dtype=np.uint8).reshape((image_height,image_width, 3))Is there any way to infer “frame”?Thank you!

594
Spanner
Axelera Team
I
Cadet
IAKCadet
asked in Metis M.2
Problems with network inference. Uio wait kernel failed with return code -1406.

Hello!I am facing some problems tring to run a network inference on the Metis M.2 with Raspberry Pi via Docker. To try the inference I have followed the steps in the guide (https://support.axelera.ai/hc/en-us/articles/26362016484114-Bring-up-Voyager-SDK-in-Raspberry-Pi-5) but after trying to run the inference.py, I face the following errors:  (venv) root@iak:/home/voyager-sdk# ./inference.py yolov8s-coco-onnx ./media/traffic1_480p.mp4INFO    : Using device metis-1:1:0WARNING : Failed to get OpenCL platforms : clGetPlatformIDs failed: PLATFORM_NOT_FOUND_KHRWARNING : Please check the documentation for installation instructionsINFO    : Default OpenGL backend gl,3,3 overridden, using gles,3,1INFO    : Network type: NetworkType.SINGLE_MODELINFO    : InputINFO    :   └─detectionsStream Paused:  57%|██████████████████████████████████████████████████████▊                                         | 4/7 [00:00<00:00,  5.56/s][ERROR][axeWaitForCommandList]: Uio wait kernel failed with return c

12417
V
Axelera Team
M
Cadet
maximiliankirCadet
asked in Voyager SDK
Yolo Performance Issues

Hello, I try to use a YOLO model on 8 camera streams in parallel on the Metis PCIe card. 20-30 fps per camera stream is all I need. With the 548 fps end-to-end stated for YOLOv8s in https://axelera.ai/metis-aipu-benchmarks, it should be possible to reach ~68 fps per camera. As a small test I wrote a python script, which creates a inference stream with 8 videos as input:from axelera.app import config, display, inf_tracersfrom axelera.app.stream import create_inference_streamdef run(window, stream): for frame_result in stream: window.show(frame_result.image, frame_result.meta, frame_result.stream_id) fps = stream.get_all_metrics()['end_to_end_fps'] print(fps.value)def main(): tracers = inf_tracers.create_tracers('core_temp', 'end_to_end_fps', 'cpu_usage') stream = create_inference_stream( network="yolov5s-v7-coco", sources=[ str(config.env.framework / "media/traffic1_1080p.mp4"), str(config.env.framework / "media/traffic1_

785
M
Cadet
S
Cadet
sifat0433Cadet
asked in Metis M.2
Input/Output Error Running Inference with Metis M.2 on ASRock Z170 Pro4S

Hello everyone,I’m new to working with this hardware and recently installed the Metis M.2 chip (Firmware version: v1.2.0-rc2+bl1-stage0) on an ASRock Z170 Pro4S motherboard. The device was detected successfully.I’ve installed the Voyager SDK and attempted to run the following command from the Quick Start Guide:./inference.py yolov5s-v7-coco dataset --no-display However, I encountered an input/output error when executing the command. I’ve included the full error message below for reference.I would appreciate any guidance or suggestions you may have to help resolve this issue.Thank you in advance for your support. INFO    : Using default val dataset INFO    : Using device metis-0:5:0 INFO    : Network type: NetworkType.SINGLE_MODEL INFO    : Input INFO    :   └─detections INFO    : Imported DataAdapter ObjDataAdaptor from /home/tud/voyager-sdk/ax_datasets/objdataadapter.py Stream Playing:  71%|██████████████████████▏        | 5/7 [00:00<00:00,  6.26/s][AxeleraDmaBuf.cpp:234] UIO_IOCTL

775
S
Cadet
S
Cadet
saraCadet
asked in Voyager SDK
Raspberry Pi 5 - Metis inference with GStreamer Pipeline

Hi, I'm working on an RPI5 and I have the voyager SDK inside a container with ubuntu 22 and it works. I wanted to try running an inference on a stream using GStreamer. First, I tried to access the stream and I managed with the following command:GST_PLUGIN_PATH=/voyager-sdk/operators/lib AXELERA_DEVICE_DIR=../opt/axelera/device-1.2.5-1/omega LD_LIBRARY_PATH=/voyager-sdk/operators/lib:/opt/axelera/runtime-1.2.5-1/lib:$LD_LIBRARY_PATH gst-launch-1.0 rtspsrc location='rtsp://…..' latency=200 ! rtph264depay ! avdec_h264 ! videoconvert ! autovideosink Now I wanted to try the axinferencenet plugin but I'm having problems. I've tested various commands and formats, such as: GST_PLUGIN_PATH=/voyager-sdk/operators/lib AXELERA_DEVICE_DIR=../opt/axelera/device-1.2.5-1/omega LD_LIBRARY_PATH=/voyager-sdk/operators/lib:/opt/axelera/runtime-1.2.5-1/lib:$LD_LIBRARY_PATH gst-launch-1.0 rtspsrc location='rtsp://...' latency=200 ! rtph264depay ! avdec_h264 ! videoconvert ! video/x-raw,format=BGRA !  axtran

916
H
Axelera Team
Y
Cadet
yairc2223Cadet
asked in Metis PCIe
axdevice --refresh fails

0000:01:00.0 : Axelera AI Metis AIPU (rev 02)ERROR:axelera.runtime:No AIPU driver found in lsmod outputERROR: AXR_ERROR_CONNECTION_ERROR: No AIPU driver found in lsmod output 

775
V
Axelera Team
C
Ensign
ChinmayMulgundEnsign
asked in Metis M.2
Guidance on Running Lane Detection Model (culane_res18.onnx) on Metis M2

Hello,I am currently working with a lane detection model named culane_res18.onnx, and I would like to know how I can run this model on the Metis M2 device.Here are some details about the setup:The model is culane_res18.onnx, which is a lane detection model. The training dataset is from the CULane dataset, and I have the link to the dataset here. The model file can be found here.Could you kindly guide me on how to run this lane detection model on Metis M2? I would appreciate any step-by-step instructions or basic guidance on how to deploy this model, considering that I have both the ONNX model and the dataset.Looking forward to your response!Best regards,Chinmay Mulgund

33524
H
Axelera Team
K
Cadet
ku15921Cadet
asked in Metis M.2
Error installing metis-dkms

Hi,I'm having trouble installing the metis-dkms driver. Can you help me?The device is a NanoPC-T6 from Friendly Elec, and the operating system is Ubuntu 22.04, also provided by Friendly Elec.I'm leaving the error message and OS information below. If there is any more information I should provide, please let me know. Thank you. The Error:$ sudo dpkg -i metis-dkms_0.07.16_all.deb(Reading database ... 155441 files and directories currently installed.)Preparing to unpack metis-dkms_0.07.16_all.deb ...Deleting module metis-0.07.16 completely from the DKMS tree.Unpacking metis-dkms (0.07.16) over (0.07.16) ...Setting up metis-dkms (0.07.16) ...Loading new metis-0.07.16 DKMS files...Building for 6.1.99Building for architecture aarch64Building initial module for 6.1.99ERROR (dkms apport): kernel package linux-headers-6.1.99 is not supportedError! Bad return status for module build on kernel: 6.1.99 (aarch64)Consult /var/lib/dkms/metis/0.07.16/build/make.log for more information.dpkg: error pro

1015
V
Axelera Team
S
Cadet
saraCadet
posted in Metis M.2
Ubuntu 24.04 support for RPi5, no container

Hello!!Do you have any news about support for Ubuntu 24.04? I wanted to use axelera on raspberry pi cm5 however there is no support for 22.04 and I wanted to run it on the host, not in a docker container.Thank you 😊

201
Spanner
Axelera Team
C
Ensign
ChinmayMulgundEnsign
asked in Metis M.2
AXELERA M2 Not Detected – “No target device found in lspci output”

Hello,I’m having trouble getting my AXELERA M2 to be recognized under Linux. Until recently everything was working fine; now when I try to run an inference the SDK can’t find the board. I’ve already tried rebooting, but the issue persists.aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ source venv/bin/activate(venv) aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ ./inference.py yolov5s-v7-coco chinmay/Vehicle-CV-ADAS/assets/challenge_video.mp4 --save-output ~/Desktop/voyager-sdk/chinmay/saved_videos/yolov5s-v7-coco.mp4ERROR : No target device found in lspci outputERROR : AXR_ERROR_CONNECTION_ERROR: No target device found in lspci output 

623
Spanner
Axelera Team
P
Cadet
pautu227Cadet
asked in Metis M.2
Trying to setup rpi5 with metis m2

​@Victor Labian I’m also trying to setup rpi5 with metis m2. I have question what host OS you was using and have you changed anything in config.txt?

28029
Spanner
Axelera Team
S
Cadet
SaitejaCadet
asked in Metis M.2
Deploying the YOLOPv2 model on to Metis M2 for lane detection

Hi, I am also working on same thing deploying the YOLOPv2 model on to Metis M2. I have downloadded the data set from bdd100k and arranged in this manner.voyager-sdk/├── data/│   └── yolopv2_dataset/│       ├── images/│       ├── labels/│       ├── cal.txt│       ├── val.txt│       └── data.yaml├── customers/│   └── my_yolopv2/│       └── yolopv2.pt└── yolopv2-custom.yamlso when i am trying to deploy the model using yaml I am getting this error(venv) aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ ./deploy.py customers/my_yolopv2/yolopv2.yamlINFO    : Using device metis-0:1:0INFO    : Detected Metis type as pcieINFO    : Compiling network yolopv2-custom /home/aravind/Desktop/voyager-sdk/customers/my_yolopv2/yolopv2.yamlINFO    : Compile model: yolopv2-customINFO    : Imported DataAdapter ObjDataAdaptor from /home/aravind/Desktop/voyager-sdk/ax_datasets/objdataadapter.py/home/aravind/.cache/axelera/venvs/93f45ae3/lib/python3.10/site-packages/torch/serialization.py:779: UserWarning: 'to

886
B
Axelera Team
F
Cadet
floritCadet
asked in Metis M.2
Metis M.2 on Raspberry Pi 5 - Driver Installation and Docker Setup Issues

hello I hijack this a little bit … once I type “lspci” it gave me following output on a pi 5 0001:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)0001:01:00.0 Processing accelerators: Axelera AI Metis AIPU (rev 02)0002:00:00.0 PCI bridge: Broadcom Inc. and subsidiaries BCM2712 PCIe Bridge (rev 30)0002:01:00.0 Ethernet controller: Raspberry Pi Ltd RP1 PCIe 2.0 South Bridge how to activate the device and getting to work with my python3 script  

19031
F
Cadet
M
Cadet
MehmetYigitCadet
asked in Metis M.2
Metis M.2 Accelerator Can't Recognized by Jetson AGX Orin

Hello.I recently received the m.2 metis accelerators and did a test on the boards provided by Axelera and got results close to the published benchmarks. It was succesful.I then connected these accelerators to the Orin (via the m.2 slot) in order to use them also for the my Jetson AGX Orin environment. But in the voyager-sdk installation i got “WARNING: Failed to refresh pcie and firmware” error. The installation completes but the accelerator device does not show up on my system. In lspci -tv command I get the output attached to this post. Can’t see metis there.I didn't see any information about the compatibility of these accelerators with Jetson systems (my m2 slot is M-key). If they are compatible, can you help me to fix the installation?Thanks :)

1188
Spanner
Axelera Team
H
Cadet
Hiroyuki KojimaCadet
asked in Voyager SDK
Error Installing Voyager SDK 1.2.5 in Docker

Hi, I followed the "Install Voyager SDK in a Docker Container" guide to try installing SDK version 1.2.5, but I encountered an error with one of the packages during the process.Could you please let me know how to resolve this issue?The attached file contains the installation log. ---    [150/193] Installing development libraries    [150/193] Install axelera_compiler    [150/193] python3 -m pip --disable-pip-version-check install --index-url XXXX@software.axelera.ai/artifactory/axelera-dev-pypi/ --no-deps -c cfg//requirements-ubuntu-2204-amd64.txt "axelera_compiler"    [150/193] Looking in indexes: XXXX:****@software.axelera.ai/artifactory/axelera-dev-pypi/    [150/193] WARNING: 401 Error, Credentials not correct for https://software.axelera.ai/artifactory/axelera-dev-pypi/axelera-compiler/(X)    [150/193] ERROR: Cannot install axelera_compiler because these package versions have conflicting dependencies.    [150/193] The conflict is caused by:    [150/193]     The user requested axeler

846
Spanner
Axelera Team
F
Cadet
floritCadet
asked in Voyager SDK
voyager token

it ask me every time about token … yes I use my registered emailand I did not found any token in my accountwtf

111
Spanner
Axelera Team
Z
Cadet
zefirCadet
asked in Voyager SDK
Is graphical video output expected to work from within the docker SDK?

Hi all,I’m a docker noob, so please bear with me if this is a stupid question.To get the SDK operational on my Ubuntu-24.04 system I followed the Install Voyager SDK in a Docker Container and can make it up to test-running some inferences. Alas, while I expected the videos to be displayed in a dedicated window at full resolution, for me they are shown in the active text-console (ncurses-based I assume), obviously coarse and slow.I tried to learn how to activate graphics output from within docker, but all I got was that docker essentially is meant to be text-only and graphics usually is provided via web-browser of pages served from within docker.So to put it bluntly: those videos showing Voyager SDK performing object detection at exhibitions at full-resolution and full-framerate, are those from within docker or are they run from a native ubuntu-22 system?If it is possible to tune docker to have that video output, a mini-howto would help a lot. 

242
Spanner
Axelera Team
Z
Cadet
zefirCadet
asked in Metis PCIe
Reset and resource allocation failures on Metis PCIe device on AMD64 system

Dear all,I am trying to get my hands on the Metis PCIe card on my current working PC, beingmainboard: Asus Prime X570-P CPU: AMD Ryzen 9 3900X OS: Ubuntu 24.04.2 LTS, 6.8.0-58-generic x86_64The first issue I face is that the warm-reset does not seem to work for me, i.e. if I issue a reboot without re-powering the system, the Metis device does not show up in lspci, while after a power-down (with physical PSU switching off) it is there. This is reproducible and based on my experience points to either my mainboard BIOS issuing a wrong reset sequence to the PCIe slot, or the device itself not issuing a full reset sequence on warm-boot. Since I know how to get the card detected, this is only an annoyance - but I saw that also another user of AMD64 system in the forum has similar issues and the problem might go deeper.Which leads to the second issue I am observing and which I filed already a support request but realized here would be the better place to discuss it.According to David M. to ch

11116
Spanner
Axelera Team
D
Cadet
DrouenCadet
asked in Metis M.2
Troubleshooting installation

Hello my name is Kevin, i am trying to work on a project that the m.2 is going to interfere with my cpu and later on maybe my gpu.is there a way, and another question whats the command to go on rtsp?  my system is:AMD 9950X3D CPUAMD 7900XTX GPU48 gb DDR5 on 8200MHZMetis Axelera AI on an m.2 port. 

7912
Dr Data
Ensign
M
Cadet
MartianCadet
posted in Metis M.2
Testing and M.2 card on an AMD system, not recognized by lspci

This is a very interesting thread as I’m testing and M.2 card on an AMD system as well and am having what seems to be the exact same problems. Things added / tried: kernel command line includes md_iommu=off pcie_aspm=off update-pciids → resulted in card having the correct name in lspci : Axelera AI Metis AIPU (rev 02) axdevice --refresh -v results in: INFO:axelera.runtime.axdevice:Removing 0000:20:04.0INFO:axelera.runtime.axdevice:PCIE rescan0000:25:00.0 : Axelera AI Metis AIPU (rev 02)INFO:axelera.runtime:Found PCI device: 25:00.0 Processing accelerators: Axelera AI Metis AIPU (rev 02)INFO:axelera.runtime:Found AIPU driver: metis                  90112  0WARNING:axelera.runtime:4PCI device count mismatch: lspci=1, triton=0(removed the traceback) just tried rerunning install.sh which mentions at the end: building operators refreshing pcie and firmware WARNING: Failed to refresh pcie and firmware  tried removing metis-dkms / rmmod metis and reinstalling results in same warning as ab

744
D
Cadet
O
Ensign
oguzEnsign
asked in Metis M.2
Transforming the Attention mechanism into Convolutional

Hello,I know that axelera does not work in the attention mechanism. For example, can we convert the attention mechanism in the yolov11 architecture to convolution? Have you done any research or read on this subject? Does Softmax structure work in Axelera? (as far as I know, no) Is there a way to turn Softmax into a working structure?

672
B
Axelera Team
O
Ensign
oguzEnsign
asked in Metis M.2
How does Axelera speed up models?

Hello, is there a detailed document where I can learn about the Axelera chip architecture and how to do the quantization in it?Thanks

492
B
Axelera Team
quant.geek
Cadet
quant.geekCadet
asked in Voyager SDK
Ubuntu 24.04 support, and Docker containers

Seems Ubuntu 24.04 is not supported at the moment. What are the plans for this version? Can you give some insight on what needs to be changed to get this installed on that version?

25921
quant.geek
Cadet
Z
Cadet
zefirCadet
asked in Metis PCIe
Flashing PCIe Metis with the latest FW version

After finally getting my metis card properly accessible through PCI, it turned out I need to upgrade the FW to the latest version:(venv) root@zefir-PC:~/voyager-sdk# axdevice [libdmabuf.c:1720] Device command returned an error code.[libdmabuf.c:1721] Consider inspecting the device log via `triton_trace --slog`.[...]Device 0: metis-0:a:0 board_type=pcie fwver='v1.2.0-rc2+bl1-stage0' clock=800MHz(0-3:0MHz) mvm=0-3:-1%(venv) root@zefir-PC:~/voyager-sdk# triton_trace --slogVersion mismatch!Actual="v1.2.0-rc2+bl1" Expected="v1.2.5"Please update device firmware before continuing.I proceeded like described in FW flashing tutorial at github(venv) root@zefir-PC:~/Axelera.ai/firmware_release_public_v1.2.0# ./flash_update.sh flash_bundle.img>>> loading new AIPU runtime stage0>>> the following operations updates the flash content Make sure to only run this operation if really needed Also make sure to not power cycle the devices or it might be rendered non-functional.do y

534
Spanner
Axelera Team

Badge Winners

Show all badges
Code of Conduct

Address

HTC5, High Tech Campus
5656 AE Eindhoven
The Netherlands
Email: info@axelera.ai

Menu

AI Accelerators

AI Software

Metis Evaluation Systems

Partners

Product Inquiry

Company

Our Story

Our Team

Careers

News

Contact

Reducing CO₂ with
Axelera’s Forest

Follow Us

LinkedIn

Twitter

Sign Up for Our Newsletter

EU flag Axelera AI is co-funded by the European Union’s Horizon research and innovation programme.

Privacy Policy  |  Cookie Policy  |  Terms of Sale  |  Vulnerability Disclosure Policy

Copyright 2025 © All rights Reserved.