Blog
Launchpad
Documentation
Axelera Website
Store

🎉 The Pioneer 10 Have Been Selected! 🚀

1 month ago

Home
CONNECT Home Page
Axelera Assist
Metis M.2

Metis M.2

Maximise your Metis M.2 – connect, ask, and share to optimise your AI projects with this powerful edge accelerator

34 Topics
260 Replies

When you subscribe we will email you when there is a new topic in this category

34 Topics

MehmetYigitCadet

Metis M.2 Accelerator Can't Recognized by Jetson AGX Orin

Hello.I recently received the m.2 metis accelerators and did a test on the boards provided by Axelera and got results close to the published benchmarks. It was succesful.I then connected these accelerators to the Orin (via the m.2 slot) in order to use them also for the my Jetson AGX Orin environment. But in the voyager-sdk installation i got “WARNING: Failed to refresh pcie and firmware” error. The installation completes but the accelerator device does not show up on my system. In lspci -tv command I get the output attached to this post. Can’t see metis there.I didn't see any information about the compatibility of these accelerators with Jetson systems (my m2 slot is M-key). If they are compatible, can you help me to fix the installation?Thanks :)

18211

1 day ago

ku15921Cadet

asked in Metis M.2

Error installing metis-dkms

Hi,I'm having trouble installing the metis-dkms driver. Can you help me?The device is a NanoPC-T6 from Friendly Elec, and the operating system is Ubuntu 22.04, also provided by Friendly Elec.I'm leaving the error message and OS information below. If there is any more information I should provide, please let me know. Thank you. The Error:$ sudo dpkg -i metis-dkms_0.07.16_all.deb(Reading database ... 155441 files and directories currently installed.)Preparing to unpack metis-dkms_0.07.16_all.deb ...Deleting module metis-0.07.16 completely from the DKMS tree.Unpacking metis-dkms (0.07.16) over (0.07.16) ...Setting up metis-dkms (0.07.16) ...Loading new metis-0.07.16 DKMS files...Building for 6.1.99Building for architecture aarch64Building initial module for 6.1.99ERROR (dkms apport): kernel package linux-headers-6.1.99 is not supportedError! Bad return status for module build on kernel: 6.1.99 (aarch64)Consult /var/lib/dkms/metis/0.07.16/build/make.log for more information.dpkg: error pro

25615

9 days ago

brogersaoCadet

asked in Metis M.2

Newbie question: Does the M.2 card offer plug n play improvements to running a local LLM?

I’ve read a number of posts and am not sure. I have a Minisforum um890 pro with Ryzen 9 8845s and 64gb ram. Windows. I’m experimenting with various hardware and setup and am wondering if this would help inference speed if used in my M.2 slot. I have USB4 and Oculink ports so I could use an external PCIe adapter. Is it plug n play or do I need to use the SDK to configure it? TIA!

521

15 days ago

SiegfriedCadet

asked in Metis M.2

Not enough memory using AxRuntime and M.2 Card on host PC

I am using the Metis M.2 Card on my host PC. It is detected using `lspci` and `axdevice`. I am able to run inference using `./inference.py yolov5m-v7-coco-tracker usb:0`. However when I try to use the AxRuntime API (Python) I get the following: from axelera.runtime import Context,context = Context()model_path = "/home/user/axelera/testing/data/yolov5/compile/compiled_model/model.json"model = context.load_model(model_path)batch_size = 1connection = context.device_connect(None, batch_size)instance = connection.load_model_instance(model, num_sub_devices=batch_size, aipu_cores=batch_size)[ERROR][axeDeviceMemoryAllocate]: Not enough memory: free memory 1531904, request memory 16520704.[ERROR][axeDeviceMemAlloc]: Device memory allocate failed: size 16520704.[ERROR][axeMemAllocDevice]: Device memory allocate failed: 0x70010001.Error at zeMemAllocDevice(context, &desc, size, alignment, device, &addr): mem_alloc_device: 249: Exit with error code: 0x70010001 : ZE_RESULT_ERROR_NOT_AVAILAB

465

18 days ago

manovellaCadet

posted in Metis M.2

Metis M.2 Firmware Update on Orange Pi 5 Plus

Hi @emustafa, please I need some helpI tried to upgrade firmware of Metis M2 but system (metis installed on orangepi 5 plus) gave me some errors and now after a few of reboots I obtain always same bad response from axdevice: libtriton_linux.c:1082] Device communication timed out: device did not respond within 1 seconds. (0)WARNING: Failed to get valid board type for device metis-0:1:0 got 6Device 0: metis-0:1:0 board_type=unknown (not responding) have I some possibilities to recover it? can I run some tools to diagnose bettere situation?thank in advance

283

26 days ago

saraEnsign

asked in Metis M.2

Inferece.py - RTSP Stream

Hi again @Spanner 😊I'm doing other tests and I want to use the inference.py script to detect persons in a stream via rtsp.I’m using the command “ ./inference.py yolov8s-coco-onnx ‘rtsp….’ --pipe gst --frame-rate 0 --rtsp-latency 0 --show-stream-timing”.With the command ‘--show-stream-timing’ I get a latency of almost 2000 ms.I'd like to know if this latency is just in the stream or if it involves the inference time and what I can do to have the stream in real time. Thank you!

9211

29 days ago

mgrunerCadet

asked in Metis M.2

Low performance of the Metis M2 on the Raspberry Pi5

Hi! I'm testing the Metis M2 on a Rapsberry Pi 5 using the Ubuntu 22.04 container. I can successfully get results using the inference test suggested by the article:./inference.py yolov8s-coco-onnx ./media/traffic1_480p.mp4 Unfortunately, I get around 4FPS. Is this expected? If I profile the device and the host separately (using --show-host-fps and --show-device-fps) I see that the device is running at ~800FPS while the host is the one bottlenecking at ~4FPS.I tried enabling GLES processing using export AXELERA_OPENGL_BACKEND=gles,3,1but, unfortunately, it makes not much of a difference. I also tried setting the PCI to gen3 by setting the following in the /boot/firmware/config.txt, without any luck:dtparam=pciex1_gen=3As a reference: these are the instructions I'm following:- https://support.axelera.ai/hc/en-us/articles/26362016484114-Bring-up-Voyager-SDK-in-Raspberry-Pi-5- https://support.axelera.ai/hc/en-us/articles/25953148201362-Install-Voyager-SDK-in-a-Docker-ContainerIs this perfo

795

1 month ago

GiodstCadet

asked in Metis M.2

Failed to get valid board type

Solved

1 month ago

Falcon9Cadet

asked in Metis M.2

M.2 AI Inference Acceleration card

Non c’è modo di aggiungere RAM a questa bellezza 😁?E’ perfetta per il mio Laptop o su Orange PI ( Embedded ).PCIe 5.0 ? LLM non gira su M.2 ? 😣Leggendo l’SDK… Interessante… 🤔

Falcon9Cadet

Un’altra domanda 😅:Forse leggendo… comunque:Funzionano in parallelo ? 😁 Grazie

1 month ago

mcunhaEnsign

asked in Metis M.2

Firmware update

I am having a problem while updating the firmware version to 1.3.0, which is present in the release of voyager-sdk 1.3.1 on GitHub (branch - release/v1.3). I am using the Aetina RK3588 Evaluation Kit. Here is the filename containing the firmware:firmware_release_public_v1.3.0.tar.gzThe output of axdevice command is : Device 0: metis-0:1:0 1GiB m2 flver=1.3.0-rc3 bcver=1.4 clock=800MHz(0-3:800MHz) mvm=0-3:100%Here is the error I am facing:(venv) aetina@aetina:~/devel/axelera/firmware/firmware_release_public_v1.3.0$ ./flash_update.sh --fw-update>>> Metis Firmware update>>> the following operations updates the flash content Make sure to only run this operation if really needed Also make sure to not power cycle the devices or it might be rendered non-functional.Do you want to continue? [y/n] y>>> loading new AIPU runtime stage0[00:15:56.989,227] <inf> app: Start pcie check thread 0x833a00>>> set flash force flag>>> flash firmware[

782

1 month ago

dbrenesCadet

asked in Metis M.2

Metis M.2 Not Recognized by lspci on Intel system

Hello! I’ve been trying to connect and use the Axelera Metis M.2 card with no success. The same M.2 on a different PC was recognized correctly by using:lspci | grep AxeleraBut now the card cannot be recognized at all on the new system. Here are some specs of the current host:Dell 5820 CPU: Intel(R) Core(TM) i7-7820X CPU @ 3.60GHz RAM: 32 GB GPU: 2 Quadro RTX 5000 OS: Ubuntu 24.04 I’ve also tried lspci | grep 1f9d with no success. The Metis driver is already installed and loaded with modprobe.I'd appreciate any help or insight on additional steps I could try.Additionally, this is the adapter I’m using for the Axelera card:

756

1 month ago

AfikCadet

asked in Metis M.2

Yocto Driver\Layer for Metis

Hi, We are considering adding an AI Accelerator for our board (i.MX8, yocto).Do you support yocto OS?Is there any reference design or example that runs Metis on yocto platform? Thanks,Afik

333

1 month ago

negredoCadet

asked in Metis M.2

QNAP NAS compatibility

Will Metis M.2 ( AXE-BME20M1AR01B02) work with QNAP NAS?

1 month ago

GiodstCadet

asked in Metis M.2

WASB model for tennis ball detection

How can I deploy WASB model on metis m2?

272

1 month ago

Steven HunscheAxelera Team

posted in Metis M.2

4k fruit detection using Orange Pi

Have you seen our fruit demo? If not, @David explains it amazingly here.Basically, it is running 3 different yolov8 models on a single chip to process 4k camera input to segment fruit, while only using 640x640 models!I love this demo and use it to evaluate any system that comes across my desk! So, obviously, when @Victor Labian posted the setup for the Orange Pi here, I just had to try it out! And it works perfectly straight after following the instructions!I shaded the fruit to look different from the original to show the accuracy of the segmentation.If you want to run this demo for yourself, you can! It’s available in the examples folder of your SDK, called fruit_demo.py. Let me know what you think! Or, as @Spanner suggestedA Fruitful and A-peel-ing Orange Pi Experiment that Didn't Go Pear-ShapedHere's what's current on the Axelera grapevine - a core functionality of the Orange Pi with Metis is detecting fruit in real time! Super smoothie AI pipe-lime with bananas and apples being

611

1 month ago

ma926Cadet

asked in Metis M.2

Metis M.2 1.3.0 firmware upgrade

Hi! I wanted to upgrade my M.2 card with latest firmware 1.3.0 but when trying to invoke command from instruction https://github.com/axelera-ai-hub/voyager-sdk/blob/release/v1.3/docs/tutorials/firmware_flash_update.md#flash-the-board-controller-firmware, I got an error:Do you know how this can be resolved? I’m using Intel i5 processor.

571

1 month ago

doggenshozenCadet

asked in Metis M.2

Can I use my GPU memory with Metis M.2 for local LLM?

This may not be possible because of how the software and hardware work together. I’m new here, and not traditionally a SW engineer, but I have a question/ suggestion. I noticed when I attempted to run the example local LLM inference scripts in the SDK that I can’t run them with only 1GB of DDR memory on the card. I think the example needs to be edited so that the model can be run on 1 GB of DDR (a model like tinyllama or similar that’ll actually fit in the 1GB of space.)After thinking about it, I do have an intel Raptor Lake integrated GPU, and an external NVIDIA A500 from Adlink Technologies. Is there any way to use the memory in the integrated CPU or the thunderbolt connected A500 GPU to run the LLM inference demos by using the DDR memory in the other devices? That would be very very useful!

250

1 month ago

saravananEnsign

asked in Metis M.2

Blank screen issue with Metis M.2 Eval System with Aetina RK3588 Industrial Motherboard

i am using Metis M.2 Eval System with Aetina RK3588 Industrial Motherboard . i connected everything to it keyboard, monitor and mouse and power supply . the monitor is showing blank screen . but yesterday it is working . why it is not working now . is there any solution.

33329

1 month ago

sifat0433Cadet

asked in Metis M.2

Input/Output Error Running Inference with Metis M.2 on ASRock Z170 Pro4S

Hello everyone,I’m new to working with this hardware and recently installed the Metis M.2 chip (Firmware version: v1.2.0-rc2+bl1-stage0) on an ASRock Z170 Pro4S motherboard. The device was detected successfully.I’ve installed the Voyager SDK and attempted to run the following command from the Quick Start Guide:./inference.py yolov5s-v7-coco dataset --no-display However, I encountered an input/output error when executing the command. I’ve included the full error message below for reference.I would appreciate any guidance or suggestions you may have to help resolve this issue.Thank you in advance for your support. INFO : Using default val dataset INFO : Using device metis-0:5:0 INFO : Network type: NetworkType.SINGLE_MODEL INFO : Input INFO : └─detections INFO : Imported DataAdapter ObjDataAdaptor from /home/tud/voyager-sdk/ax_datasets/objdataadapter.py Stream Playing: 71%|██████████████████████▏ | 5/7 [00:00<00:00, 6.26/s][AxeleraDmaBuf.cpp:234] UIO_IOCTL

12310

1 month ago

IAKCadet

asked in Metis M.2

Problems with network inference. Uio wait kernel failed with return code -1406.

Hello!I am facing some problems tring to run a network inference on the Metis M.2 with Raspberry Pi via Docker. To try the inference I have followed the steps in the guide (https://support.axelera.ai/hc/en-us/articles/26362016484114-Bring-up-Voyager-SDK-in-Raspberry-Pi-5) but after trying to run the inference.py, I face the following errors: (venv) root@iak:/home/voyager-sdk# ./inference.py yolov8s-coco-onnx ./media/traffic1_480p.mp4INFO : Using device metis-1:1:0WARNING : Failed to get OpenCL platforms : clGetPlatformIDs failed: PLATFORM_NOT_FOUND_KHRWARNING : Please check the documentation for installation instructionsINFO : Default OpenGL backend gl,3,3 overridden, using gles,3,1INFO : Network type: NetworkType.SINGLE_MODELINFO : InputINFO : └─detectionsStream Paused: 57%|██████████████████████████████████████████████████████▊ | 4/7 [00:00<00:00, 5.56/s][ERROR][axeWaitForCommandList]: Uio wait kernel failed with return c

16920

1 month ago

ChinmayMulgundEnsign

asked in Metis M.2

Guidance on Running Lane Detection Model (culane_res18.onnx) on Metis M2

Hello,I am currently working with a lane detection model named culane_res18.onnx, and I would like to know how I can run this model on the Metis M2 device.Here are some details about the setup:The model is culane_res18.onnx, which is a lane detection model. The training dataset is from the CULane dataset, and I have the link to the dataset here. The model file can be found here.Could you kindly guide me on how to run this lane detection model on Metis M2? I would appreciate any step-by-step instructions or basic guidance on how to deploy this model, considering that I have both the ONNX model and the dataset.Looking forward to your response!Best regards,Chinmay Mulgund

36924

2 months ago

saraEnsign

posted in Metis M.2

Ubuntu 24.04 support for RPi5, no container

Hello!!Do you have any news about support for Ubuntu 24.04? I wanted to use axelera on raspberry pi cm5 however there is no support for 22.04 and I wanted to run it on the host, not in a docker container.Thank you 😊

331

2 months ago

ChinmayMulgundEnsign

asked in Metis M.2

AXELERA M2 Not Detected – “No target device found in lspci output”

Hello,I’m having trouble getting my AXELERA M2 to be recognized under Linux. Until recently everything was working fine; now when I try to run an inference the SDK can’t find the board. I’ve already tried rebooting, but the issue persists.aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ source venv/bin/activate(venv) aravind@aravind-H610M-H-V2:~/Desktop/voyager-sdk$ ./inference.py yolov5s-v7-coco chinmay/Vehicle-CV-ADAS/assets/challenge_video.mp4 --save-output ~/Desktop/voyager-sdk/chinmay/saved_videos/yolov5s-v7-coco.mp4ERROR : No target device found in lspci outputERROR : AXR_ERROR_CONNECTION_ERROR: No target device found in lspci output

923

2 months ago

pautu227Cadet

asked in Metis M.2

Trying to setup rpi5 with metis m2

@Victor Labian I’m also trying to setup rpi5 with metis m2. I have question what host OS you was using and have you changed anything in config.txt?

36429

3 months ago

Page 1 / 2

Badge Winners

Siegfriedearned Pioneer Signal
shabazearned System Sensei
mcunhaearned System Sensei
Victor Labianearned Hailing Frequencies
saadtiwanaearned Pioneer Signal

Show all badges

Code of Conduct

Sign up

Already have an account? Login

Log in, or create an Axelera AI account

Login to the community

Log in, or create an Axelera AI account

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

Address

HTC5, High Tech Campus
5656 AE Eindhoven
The Netherlands
Email: info@axelera.ai

Company

Reducing CO₂ with
Axelera’s Forest

Twitter

Sign Up for Our Newsletter

Axelera AI is co-funded by the European Union’s Horizon research and innovation programme.