Metis M.2

Hello.I recently received the m.2 metis accelerators and did a test on the boards provided by Axelera and got results close to the published benchmarks. It was succesful.I then connected these accelerators to the Orin (via the m.2 slot) in order to use them also for the my Jetson AGX Orin environment. But in the voyager-sdk installation i got “WARNING: Failed to refresh pcie and firmware” error. The installation completes but the accelerator device does not show up on my system. In lspci -tv command I get the output attached to this post. Can’t see metis there.I didn't see any information about the compatibility of these accelerators with Jetson systems (my m2 slot is M-key). If they are compatible, can you help me to fix the installation?Thanks :)

Non c’è modo di aggiungere RAM a questa bellezza 😁?E’ perfetta per il mio Laptop o su Orange PI ( Embedded ).PCIe 5.0 ? LLM non gira su M.2 ? 😣Leggendo l’SDK… Interessante… 🤔

I wanna use axelera metis on alinx board and I wonder that is there any yocto support? 

Hello,My team just received and opened a Metis Dev System with Arduino Portenta X8.We followed the “Getting Started with Metis Dev System with Arduino Portenta X8”,but could not go though; In installing the SDK;          “docker run -it --privileged -v /tmp:/tmp -v /axelera:/axelera -v /lib/modules:/lib/modules -v /run:/run -v /dev:/dev --group-add video -e DISPLAY=$DISPLAY --name=voyager-sdk-1.4.0 --network=host --entrypoint=/bin/bash axelera-sdk-ubuntu-2204-arm64-prebuid-llm:1.4.0”    failed with           “docker: Error response from daemon: pull access denied for axelera-sdk-ubuntu-2204-arm64-prebuild-llm, repository does not exist or may require ‘docketr login’: denied: requested access to the resource is denied” message          What is the default login ID/PASS of the docker image ?    2. Then, we tried the alternative ; after loading the downloaded docker image,          w

Hi! My name is Salvador and I’ve been trying to integrate the Metis M.2 on a Jetson Orin NX 16GB to perform Computer vision tasks.Recently the Axelera team shared a guide to Bring up Metis M.2 on Jetson Orin, where they explain the steps required to modify the kernel to use the Metis Accelerator.For me these changes were not enough, so I had to perform additional steps to make it work, I hope this post is useful for anybody trying to accomplish the same. The following steps build upon the instructions provided by the Axelera team.Prepare the Nvidia files necessaryWe will use a host machine running Ubuntu 20.04 or 22.04 (newer versions are not compatible with some Nvidia tools) where we will run all the described process, download the kernel sources, the Jetson Sam

Hi guys, new to the conversation here.Just wondering whether there is a software compatibility matrix available somewhere?I’ve been trying to get the METIS M2 chip running on my Jetson Orin NX. Thing is, I’m running a custom YOCTO build (based on Jetpack 6) and want to run the voyager-sdk in a Docker container, but I just can’t seem to get the drivers to properly match. So what driver versions match with which voyager-sdk versions?The main error I’m getting is the one below:root@hw00001aaa-24050002:/workspace# axdevice --pcie-scan0007:01:00.0 : Axelera AI Metis AIPU (rev 02)[libtriton_linux.c:799] Failed to open '/dev/metis-7:1:0': No such device[AxeleraDevice.cpp:71] Device not found: metis-7:1:0WARNING: Failed to open device 0(metis-7:1:0)[libtriton_linux.c:799] Failed to open '/dev/metis-7:1:0': No such device[AxeleraDevice.cpp:71] Device not found: metis-7:1:0ERROR: Failed to open device metis-7:1:

Hi,I'm having trouble installing the metis-dkms driver. Can you help me?The device is a NanoPC-T6 from Friendly Elec, and the operating system is Ubuntu 22.04, also provided by Friendly Elec.I'm leaving the error message and OS information below. If there is any more information I should provide, please let me know. Thank you. The Error:$ sudo dpkg -i metis-dkms_0.07.16_all.deb(Reading database ... 155441 files and directories currently installed.)Preparing to unpack metis-dkms_0.07.16_all.deb ...Deleting module metis-0.07.16 completely from the DKMS tree.Unpacking metis-dkms (0.07.16) over (0.07.16) ...Setting up metis-dkms (0.07.16) ...Loading new m

Hello,I’m running inference with model  unet_fcn_512-cityscapes with pipe torch-aipu on the aetina eval board. It runs at 1.8 fps system and with 500ms of latency although device fps shows  11.5 fps capability. In the doc it is also mentioned that it should reach 18fps. I originally thought it was an issue with time wasted to load and decode png images from the SD card so I put them in shared memory but result are identical.I also tested yolov5s-v7-coco that should reach 805 fps but I can only achieve 214fps. Here are the output of: AXELERA_USE_CL_DOUBLE_BUFFER=0 ./inference.py yolov5s-v7-coco media/traffic3_720p.mp4 --show-stats --no-displayINFO : Deploying model yolov5s-v7-coco for 4 cores. This may take a while...|████████████████████████████████████████| 12:41.1 arm_release_ver: g13p0-01eac0, rk_so_ver: 9========================================================================

Hello guys;I did not follow the instructions in the link below on the Orangepi 5 device, but it does not see the device.“ERR DEVCICE NOT FOUND”help! https://support.axelera.ai/hc/en-us/articles/27059519168146-Bring-up-Voyager-SDK-in-Orange-Pi-5-Plus

Hi there,i´m working with an Axelera M.2 chip at uni. For some research on green AI i´m doing i want to track the power usage of the chip. As far as i know i need to track the power through the PCIe connection. Is there a way to track it with the AIPU directly or do i need to use the PCIe? And if there is a way can i save the usage in an array easily or is this a rather tricky situation?Thanks in advance Morruebe

Will Metis M.2 ( AXE-BME20M1AR01B02) work with QNAP NAS?

Hello everyone!I am Luca Gessi, from Italy. I am a (lucky) owner of Aetina board with M2 Axelera Metis. Unfortunatly the board arrived without the SDK installed. I installed it using the github guide. The procedure faced several issues and broken packages. I had to run it several time but at the end the installation completed.From this I tried to run simple command for testing the board (as suggested on the getting started guide):./inference.py --no-display yolov5s-v7-coco dataset However the inference failed: (venv) aetina@aetina:~/voyager-sdk$ ./inference.py --no-display yolov5s-v7-coco datasetERROR   : timeout for querying an inferencearm_release_ver: g13p0-01eac0, rk_so_ver: 9INFO    : Using dataset valINFO    : Dataset 'COCO2017' split 'val' downloaded successfully to /home/aetina/.cache/axelera/data/cocoINFO    : Dataset 'COCO2017' split 'labels' downl

I'm evaluating your devices. I really love both the European heart and the great TOPS/Watt ratio.It would be amazing for edge computing.On the other side, our company is waiting for a GX10 from ASUS/NVidia with 128Gb of shared memory.The reason why I think that the Metis form factor is more interesting than the pci-ex would need a very long document :-)I read that your SDK is supporting off-load but reading on the forum I think that your off-loading support is limited only to data and not the core of the model.You know that when you use CUDA+torch you're able to off-load some part of the model out of the GPU memory and execute it running a small part of the model at once swapping coefficients from the GPU memory to the host RAM and vice versa.Are you planning to improve your off-loading system in your SDK?Are you planning to introduce a Metis with more RAM? 

Hi ​@emustafa, please I need some helpI tried to upgrade firmware of Metis M2 but system (metis installed on orangepi 5 plus) gave me some errors and now after a few of reboots I obtain always same bad response from axdevice: libtriton_linux.c:1082] Device communication timed out: device did not respond within 1 seconds. (0)WARNING: Failed to get valid board type for device metis-0:1:0 got 6Device 0: metis-0:1:0 board_type=unknown (not responding) have I some possibilities to recover it? can I run some tools to diagnose bettere situation?thank in advance

I’ve read a number of posts and am not sure. I have a Minisforum um890 pro with Ryzen 9 8845s and 64gb ram. Windows. I’m experimenting with various hardware and setup and am wondering if this would help inference speed if used in my M.2 slot. I have USB4 and Oculink ports so I could use an external PCIe adapter. Is it plug n play or do I need to use the SDK to configure it? TIA!

I am using the Metis M.2 Card on my host PC. It is detected using `lspci` and `axdevice`. I am able to run inference using `./inference.py yolov5m-v7-coco-tracker usb:0`. However when I try to use the AxRuntime API (Python) I get the following: from axelera.runtime import Context,context = Context()model_path = "/home/user/axelera/testing/data/yolov5/compile/compiled_model/model.json"model = context.load_model(model_path)batch_size = 1connection = context.device_connect(None, batch_size)instance = connection.load_model_instance(model, num_sub_devices=batch_size, aipu_cores=batch_size)[ERROR][axeDeviceMemoryAllocate]: Not enough memory: free memory 1531904, request memory 16520704.[ERROR][axeDeviceMemAlloc]: Device memory allocate failed: size 16520704.[ERROR][axeMemAllocDevice]: Device memory allocate failed: 0x70010001.Error at zeMemAllocDevice(context, &

Hi again ​@Spanner  😊I'm doing other tests and I want to use the inference.py script to detect persons in a stream via rtsp.I’m using the command “ ./inference.py yolov8s-coco-onnx ‘rtsp….’ --pipe gst --frame-rate 0 --rtsp-latency 0 --show-stream-timing”.With the command ‘--show-stream-timing’ I get a latency of almost 2000 ms.I'd like to know if this latency is just in the stream or if it involves the inference time and what I can do to have the stream in real time. Thank you!

Hi! I'm testing the Metis M2 on a Rapsberry Pi 5 using the Ubuntu 22.04 container. I can successfully get results using the inference test suggested by the article:./inference.py yolov8s-coco-onnx ./media/traffic1_480p.mp4 Unfortunately, I get around 4FPS. Is this expected? If I profile the device and the host separately (using --show-host-fps and --show-device-fps) I see that the device is running at ~800FPS while the host is the one bottlenecking at ~4FPS.I tried enabling GLES processing using export AXELERA_OPENGL_BACKEND=gles,3,1but, unfortunately, it makes not much of a difference. I also tried setting the PCI to gen3 by setting the following in the /boot/firmware/config.txt, without any luck:dtparam=pciex1_

Solved

Un’altra domanda 😅:Forse leggendo… comunque:Funzionano in parallelo ? 😁 Grazie

I am having a problem while updating the firmware version to 1.3.0, which is present in the release of voyager-sdk 1.3.1 on GitHub (branch - release/v1.3). I am using the Aetina RK3588 Evaluation Kit. Here is the filename containing the firmware:firmware_release_public_v1.3.0.tar.gzThe output of axdevice command is : Device 0: metis-0:1:0 1GiB m2 flver=1.3.0-rc3 bcver=1.4 clock=800MHz(0-3:800MHz) mvm=0-3:100%Here is the error I am facing:(venv) aetina@aetina:~/devel/axelera/firmware/firmware_release_public_v1.3.0$ ./flash_update.sh --fw-update>>> Metis Firmware update>>> the following operations updates the flash content Make sure to only run this operation if really needed Also make sure to not power cycle the devices or it might be rendered non-functional.Do you want to continue? [y/n] y>>> loading new AIPU runtime stage0

Hello! I’ve been trying to connect and use the Axelera Metis M.2 card with no success. The same M.2 on a different PC was recognized correctly by using:lspci | grep AxeleraBut now the card cannot be recognized at all on the new system. Here are some specs of the current host:Dell 5820 CPU: Intel(R) Core(TM) i7-7820X CPU @ 3.60GHz RAM: 32 GB GPU: 2 Quadro RTX 5000 OS: Ubuntu 24.04 I’ve also tried lspci | grep 1f9d with no success. The Metis driver is already installed and loaded with modprobe.I'd appreciate any help or insight on additional steps I could try.Additionally, this is the adapter I’m using for the Axelera card: 

Hi, We are considering adding an AI Accelerator for our board (i.MX8, yocto).Do you support yocto OS?Is there any reference design or example that runs Metis on yocto platform? Thanks,Afik

How can I deploy WASB model on metis m2?

Have you seen our fruit demo? If not, ​@David explains it amazingly here.Basically, it is running 3 different yolov8 models on a single chip to process 4k camera input to segment fruit, while only using 640x640 models!I love this demo and use it to evaluate any system that comes across my desk! So, obviously, when ​@Victor Labian posted the setup for the Orange Pi here, I just had to try it out! And it works perfectly straight after following the instructions!I shaded the fruit to look different from the original to show the accuracy of the segmentation.