Skip to main content

Project Gaius - Gesture AI User System

  • December 1, 2025
  • 4 replies
  • 110 views

Forum|alt.badge.img

Hi community!

I’m David Katus and I'm incredibly excited to share that my project has been selected as one of the 10.

I will be building a fully offline, multi-camera, gesture-controlled smart home interface.
The goal is to control everyday devices—TV, lights, speakers—using only intuitive hand gestures and pointing motions. By combining edge AI gesture recognition with simple device actions, I aim to create an interaction experience that feels natural, seamless, and futuristic.

This project matters to me because I’ve always been fascinated by natural human–machine interfaces. Ever since I first saw Iron Man controlling his workshop with mid-air gestures, I’ve wanted to bring a small part of that experience into real life. With edge AI, this finally becomes practical—while keeping all processing private and completely local.

Most smart devices today rely on remotes, apps, menus, or voice assistants. They work, but they are not always intuitive.
My system aims to improve this through:
• Hands-free control from anywhere in the room
• A unified gesture language across all supported devices
• Object selection by pointing, enabled through multi-camera spatial understanding
• 100% offline processing, ensuring full privacy

This approach is ideal for living rooms, studios, workshops, or any environment where people interact with multiple devices and want a more natural, hands-free control method.

My first steps will be getting familiar with the Axelera DevKit and testing basic camera + inference performance.

I’m thrilled to begin this journey with Project Gaius and will keep you updated on my progress.

4 replies

Spanner
Axelera Team
Forum|alt.badge.img+3
  • Axelera Team
  • December 2, 2025

Love this idea! Congratulations and welcome, ​@David!

I’m a big home automation user too! Everything in my house is hooked up to Home Assistant, even if it doesn’t need to be 😄 One of the things I think about a lot is that there are actually two sides to it - the automation side, where things happen automatically based on  triggers, and the remote control side, where you activate devices in different ways (smartphone, voice, etc). So gesture controls are something I’m really interested in from a personal point of view! Can’t wait to see how it progresses!

What’s the first step for this project once the kit arrives?


  • Ensign
  • December 8, 2025

wow, sounds great! looking forward to your project. had funnily proposed sth quite similar, since also wanted to experiment with gesture control. if you run into troubles or want to chat about the project feel free to reach out(: 


  • Ensign
  • December 9, 2025

This is amazing 
hand sign to turn on AC while lounging on couch  is my kinda jam! 
 

 


Spanner
Axelera Team
Forum|alt.badge.img+3
  • Axelera Team
  • December 10, 2025

This is amazing 
hand sign to turn on AC while lounging on couch  is my kinda jam! 

I know right! 😄 I’m picturing Ultraman’s Specium beam!