Skip to main content

AI Lounge

Dive into the world of AI. Discuss trends, share insights, and explore everything from neural networks to industry innovations

23 Topics
Spanner
Axelera Team
SpannerAxelera Team
posted in The Axelera Forum
👋 Say Hello – Introduce Yourself to the Axelera AI Community

Welcome to the Axelera AI Community – we’re so glad you’re here.This is a space for everyone from hardware engineers and AI devs to makers, enthusiasts, onlookers and partners, so don’t be shy. Whether you’re working with AI every day or just getting started, we’d love to know more about you.To get things going, let’s have a big round of hellos:Who you are and what you’re working on Your experience or interest in the AI/edge AI world What you’re hoping to learn, share or achieve in this communityCan’t wait to get to know you all, and to build something great together.Now – who’s going first? 👇

34210
Spanner
Axelera Team
Spanner
Axelera Team
SpannerAxelera Team
posted in The Axelera Forum
Anyone else tried running AI on an Orange Pi 5 Plus?

Have you seen that ​@Victor Labian’s successfully brought up the Voyager SDK on the Orange Pi 5 Plus with a Metis M.2 module? It took a bit of work—Ubuntu flashing, driver rebuilds, and tweaking the PCIe device tree—but it’s running, and it’s fast. 😃This setup is seriously impressive for something so compact and affordable. Inference runs smoothly, and with some tuning, it could potentially be running advanced models like YOLOv8 without trouble.It’s just an experiment and a test at this point. No big plans around the Orange Pi, but it looks like a really promising start.If you’re experimenting with AI on SBCs—or thinking about it—I’d love to hear what you’re working on. Orange Pi, Raspberry Pi, custom boards, anything edge. 👍 

260
Spanner
Axelera Team
Steven Hunsche
Axelera Team
Steven HunscheAxelera Team
published in LLMs, NLP, Neural Networks
Llama 3.2B Chatbot Demo on Metis - Fully Offline

I just built a quick demo showing the Llama 3.2B chatbot running on our Metis platform, totally offline. This model packs 3 billion parameters and runs smoothly on both a standard Lenovo P360 with our PCIe card and even on an Arduino-based dev board (Portenta X8).We hit 6+ tokens/sec per core – which means real-time chat. Perfect for smart customer support bot, digital concierge systems, any edge AI assistant application really, all running fully on-device. No cloud needed.Check out the video and let me know what you think. Any projects you can think of where you could use a self-contained, power-efficient, offline AI chatbot like this? //EDIT I am aware that the youtube link is currently broken. I will reupload it soon. 

2387
Spanner
Axelera Team
jonask-ai
Axelera Team
jonask-aiAxelera Team
posted in The Axelera Forum
🎥 Your First Inference on Metis with Voyager SDK: Step-by-Step Video Guide

Hey everyone,Excited to share a brand-new video I put together for anyone getting started with the Metis card and Voyager SDK. Whether you're setting up your eval kit or just curious about how inference works on Metis, this walkthrough is for you.🛠️ What’s inside:Setting up your environment and verifying camera input Running YOLOv5s-v7-COCO on a live camera stream Using download_prebuilt for faster setup Running inference on media files and datasets Benchmarking performance Measuring accuracy with mAP and more📺 You can find this tutorial, and more, on our YouTube ChannelThis guide is based on SDK version 1.2.5 and follows the official Quick Start Guide, but with some extra tips and tricks to get you up and running even faster.💬 Have you tried running inference on Metis yet?Drop your thoughts, questions, or your own setup experiences in the comments, I'd love to hear how it's going for you or help troubleshoot if you're stuck!See you there,Jonas 

290
jonask-ai
Axelera Team
A
Anonymous
posted in The Axelera Forum
Which demos would best showcase the strengths of our product?

We frequently attend trade shows and aim to stand out from the competition. Showcasing compelling demos is a key strategy to achieve this. Which demos would most effectively highlight the unique strengths of our product?

381
Cherryland120
Cadet
jonask-ai
Axelera Team
jonask-aiAxelera Team
published in The Axelera Forum
Getting Started with Voyager® SDK – A Quick IntroductionTutorial

Hi everyone,I’ve just published a quick walkthrough of the Voyager SDK, our all-in-one platform for building and deploying AI applications at the edge. If you’re working on computer vision tasks or just curious about what makes Metis and Voyager such a powerful combo, this video is for you.In it, we’ll cover the basics:🔹 What Voyager SDK is and how it simplifies AI development🔹 How to use the Model Zoo or bring your own model🔹 Performance, quantization, pipelines, and real-time inference🔹 A peek at cascading models and what’s possible with our quad-core Metis AIPUWhether you’re building a demo, proof of concept, or production deployment, this will help you get started with confidence. Let me know what you think!Looking forward to seeing what you build with it!

1350
jonask-ai
Axelera Team
F
Cadet
floritCadet
posted in LLMs, NLP, Neural Networks
Outsource the Learning process of an LLM from system to Metis

how let run a LLM learning process driven by system ram and cpu model outsource to metis device?or better say how to load 4,7GB into metis m.2 with 1GB

332
F
Cadet
Spanner
Axelera Team
SpannerAxelera Team
posted in AI Trends and Innovations
Have you seen any projects combining CNC and AI?

About 40m of 2020 aluminium profile just arrived for the CNC machine I’m building! I suddenly feel like this might be a bigger job than I initially planned…Anyway, that’s for another day. What’s crossed my mind now is whether anyone’s seen any projects that combine CNC with vision AI? I’m thinking it’d be cool if I could combine the two, since I’m building one machine anyway.Predictive maintenance, maybe? Although this is a homemade machine, so that’s not a huge issue.Perhaps positioning and alignment could be something AI could get involved with? That could potentially be useful and reduce waste. Any other ideas of existing projects anyone’s seen in this area? 

240
Spanner
Axelera Team
S
Cadet
Semih_Cadet
posted in The Axelera Forum
Legal Issues and Axelera

Hi everyone,I am Semih. I am a PhD researcher at University of Tuebingen on Open Source and AI. I am trying to understand Axelera’s hardware and in future I am planning to research legal and regulatory issues related to AI hardware, role of open source hardware, licensing contracts, regulatory compliance especially with Cyber Resilience Act, GDPR and AI Act. I was wondering if anyone is conducting a similar research or are there any pain points or interesting discussions under these themes?Thanks in advance

210
S
Cadet
Spanner
Axelera Team
SpannerAxelera Team
asked in LLMs, NLP, Neural Networks
May the Source (Code) be With You!

May 4th is almost upon us, so naturally we’re thinking about AI… in space. More specifically: the AI and droid legends of the Star Wars universe.From multilingual protocol units to rogue assassin bots with surprising moral compasses, Star Wars has given us some of the most iconic (and occasionally chaotic) artificial intelligences in sci-fi.So here’s the question...

390
Spanner
Axelera Team
Spanner
Axelera Team
SpannerAxelera Team
posted in AI Trends and Innovations
What Real-Time 8K Inference Looks Like

Check out our own ​@jonask-ai showing real-time, high-precision 8K object detection demo at Embedded World. An Aetina box, four Metis cards, and a whole lot of tile-based inference.What’s cool is it runs YOLOv8l across 380 overlapping tiles per second—no downscaling—at just 57% compute. And it’s not a one-off: same setup anyone can build with Voyager SDK + a YAML file.Noice!You can find out a bit more about this in ​@Doug’s blog post, too.

710
Spanner
Axelera Team
S
Ensign
saravananEnsign
asked in The Axelera Forum
Deploying lane dection model (yolopv2.onnx) on metis M2

Hello,I am currently working on lane detection model (YOLOv2) which is in .pt format I have converted to ONNX format.Here are the terminal responses I have got..root@aetina:/voyager-sdk# cd YOLOPv2root@aetina:/voyager-sdk/YOLOPv2# lsLICENSE    data     demo2.py        models            runs   yolopv2-envREADME.md  demo.py  export-onnx.py  requirements.txt  utilsroot@aetina:/voyager-sdk/YOLOPv2# cd modelsroot@aetina:/voyager-sdk/YOLOPv2/models# ls__pycache__  common.py  experimental.py  yolopv2.onnx  yolopv2.ptroot@aetina:/voyager-sdk/YOLOPv2/models# I am having the ONNX format of the model so now I want to deploy the model onto Metis M2. When I am trying to compile the yolopv2.onnx model but i am encountering this issue.root@aetina:/voyager-sdk# /voyager-sdk/bin/voyager-compile models/yolopv2.onnx --output-dir build/yolopv2 --input-shape "1,3,640,640"bash: /voyager-sdk/bin/voyager-compile: No such file or directoryI request to guide me to successfully deploy the model.Note; I am using

674
S
Ensign
Spanner
Axelera Team
SpannerAxelera Team
posted in LLMs, NLP, Neural Networks
Built-In AI or Subscription-Based?

This new survey suggests people (Apple fans, that is) are very open to the idea of paying a subscription for “Apple Intelligence” features. Which raises the question as to whether AI tools are going to become just another line on your monthly bill.We’ve moved quickly from “AI is cool” to “you might need it just to keep up.” And if it’s locked behind paywalls? That could become a problem once it’s a necessity rather than a nice-to-have.Curious what you all think – will AI be a must-have, or a paid perk for you?https://www.macrumors.com/2025/04/22/apple-intelligence-payment-survey/

110
Spanner
Axelera Team
Axelera CMX
Axelera Team
Axelera CMXAxelera Team
posted in The Axelera Forum
We have our first Ensigns! 🥇🥈🥉 Report to the bridge! 📯

This is a quick shoutout out to ​@ChinmayMulgund and ​@oguz for becoming the first members of Axelera AI’s community to earn the rank of Ensign! And practially at the same time (close enough that I can’t tell who got there first).Every activity on the community earns you points, and helps you climb the ranks. The opening rank is a Cadet, which you receive after your first action on the community. But it takes effort to climb the ranks, so a big congratulations to our first two Ensigns for getting there so quickly!Who’s going to be the first Lieutenant, I wonder? 

260
Axelera CMX
Axelera Team
Spanner
Axelera Team
SpannerAxelera Team
posted in AI Trends and Innovations
Hugging Face is getting in on the robotics game

Gugging face just snapped up a humanoid robotics startup (Pollen Robotics, the folks behind Reachy 2). Open source robots are officially happening. Imagine a robot that serves coffee and critiques your model training while it’s doing it. I’d buy that!In all seriousness, it does actually feel like a big moment for open robotics.https://techcrunch.com/2025/04/14/hugging-face-buys-a-humanoid-robotics-startup/ 

60
Spanner
Axelera Team
Spanner
Axelera Team
SpannerAxelera Team
posted in The Axelera Forum
Did you see the Metis Compute Board is open for pre-orders?

Heads-up if you’re building a new AI project from scratch – the new Metis Compute Board is now up for pre-order!It’s a compact SBC with the Metis AI accelerator baked right in, powered by the ARM-based RK3588. And it runs the Voyager SDK out of the box. Loads of interfaces, solid memory specs, tiny footprint (170x170mm), and very dev-friendly.Integrated Metis AIPU with 214 TOPS for multi-stream, multi-model AI workloads 16 GB RAM for the CPU + 4 GB for the AIPU, with storage and connectivity for almost any setup Comes with Voyager SDK and BSP for fast prototyping and deploymentThere’s a product brief attached if you want to see a few more details, too.Bonus: pre-orders get 15% off. Shipping is slated to begin in June 2025, and you get 15% off for pre-ordering.Check it out: https://store.axelera.ai/products/metis-compute-board-with-arm-based-rk3588 

860
Spanner
Axelera Team
C
Cadet
carloCadet
posted in The Axelera Forum
wanted: collaborators for art&ai on edge

hi there,i am currently writing up an application with friends for a grant on “ai&art” which is due by tomorrow.we want to do music reactive visuals on edge with multimodal inputs and want to use the Metis for live inference. i think of visuals being an interesting playground since they allow to very freely construct the loads for the chip. if you are interested in collaborating please feel free to reach out! there is no requirement on expertise.  ideas only are also very much welcome.(as well as additional sources for funding or sponsors)hope to have caught your interestbest carlo 

301
Spanner
Axelera Team
gurumeditation
Ensign
gurumeditationEnsign
posted in AI Trends and Innovations
AI agents raising money for charity

TechCrunch piece about a nonprofit that had GPT and Claude models run a fundraising op on their own—no human help except setup. The AIs picked a charity (Helen Keller Intl), made docs, set up socials, emailed people, and ended up raising $257 in a week!Can’t tell if this is good or bad...https://techcrunch.com/2025/04/08/a-nonprofit-is-using-ai-agents-to-raise-money-for-charity/ 

190
gurumeditation
Ensign
Spanner
Axelera Team
SpannerAxelera Team
posted in The Axelera Forum
Check out the Axelera Metis PCIe running on an Arduino Portenta X8

As part of the recent Arduino Day celebrations, our very own ​@Steven Hunsche joined with the Arduino team to demo the Metis PCIe running on a Portenta X8!This is an unmodified LLM, running in real-time, and completely offline.It doesn’t get much more edge than these two device working in combo 😄 And there’s an early access program in the works for anyone who’s interested in getting a closer look at Arduino’s and Axelera AI’s devices in action together: https://axelera.ai/development-systems/arduinoIn the meantime, check out the project on the Arduino Day live stream: 

1350
Spanner
Axelera Team
T
Cadet
Tinkers RucksackCadet
posted in LLMs, NLP, Neural Networks
Are multimodal models the way forward?

There’s a lot of new hype everyday around new models that can do language + images + audio etc all at once. There’s a convenience to it, but is it the best way? Can’t help but think ”jack of all trades” when a new one is announced.I suppose it could be because of the chase towards the first AGI, but if you’re building an AI tool or platform, don’t you want a specialized model rather than a general one?Would be interested to hear if anyone here has actually built something on top of this — or tried and hit a wall.

471
Spanner
Axelera Team
V
Axelera Team
Victor LabianAxelera Team
posted in The Axelera Forum
Early demo: Metis M.2 running YOLOv8 on a Raspberry Pi 5

Wanted to share a quick demo we’ve been playing around with — we’ve got the Metis M.2 up and running on a Raspberry Pi 5, doing real-time vehicle detection using an unmodified YOLOv8 model.Pretty smooth experience, getting them working together. Definitely still early days, so no promises yet on timelines or any kind of future support, but figured it was worth showing that it can be done!Curious — would people here be interested in standalone edge AI running on something like a Pi5? Any particular use cases that come to mind?

1944
Spanner
Axelera Team
Spanner
Axelera Team
SpannerAxelera Team
published in The Axelera Forum
Axelera Community Gamification: Points, Ranks and BadgesTutorial

🏅 What Is Gamification on the Axelera Community?Gamification is a simple idea: it turns everyday actions into opportunities to earn points, rewards, and recognition. In the Axelera AI Community, it means your contributions—big or small—don’t go unnoticed. Whether you’re asking questions, sharing answers, or reacting to posts, you’re building up your profile as an active, valued member of the edge AI community. 🥇🥈🥉 The LeaderboardThe leaderboard serves as a dynamic scoreboard, showcasing the most active and helpful members based on the points they’ve accumulated. It’s a transparent way to recognize top contributors and inspire friendly competition. Points Accumulation: As you engage in various community activities—such as posting answers, initiating discussions, or receiving likes—you earn points. Real-Time Rankings: The leaderboard updates in real-time, reflecting the current standings of members based on their point totals. This means your position can change as you and others con

820
Spanner
Axelera Team
T
Cadet
Tinkers RucksackCadet
posted in AI Trends and Innovations
Databricks Test-time Adaptive Optimization thing

Just read a piece about Databricks working on this idea called TAO (Test-time Adaptive Optimization). Supposedly helps models improve themselves without clean labelled data — sort of like RL with synthetic practice rounds?Sounds clever, but also feels like one of those things that might work great in theory and fall apart in the wild. Anyone come across it in more detail or seen use cases outside research circles?

260
T
Cadet

Badge Winners

Show all badges
Code of Conduct

Address

HTC5, High Tech Campus
5656 AE Eindhoven
The Netherlands
Email: info@axelera.ai

Menu

AI Accelerators

AI Software

Metis Evaluation Systems

Partners

Product Inquiry

Company

Our Story

Our Team

Careers

News

Contact

Reducing CO₂ with
Axelera’s Forest

Follow Us

LinkedIn

Twitter

Sign Up for Our Newsletter

EU flag Axelera AI is co-funded by the European Union’s Horizon research and innovation programme.

Privacy Policy  |  Cookie Policy  |  Terms of Sale  |  Vulnerability Disclosure Policy

Copyright 2025 © All rights Reserved.