Hello together we are Sebastian Krödel and Lorenzo Gualniera  and we are super excited to having been selected for the Pioneer 10 Project Challenge. Sebastian is a machine learning engineer and Lorenzo is an embedded machine learning engineer, both with a background in the biomedical field. 

What are we Building?

We will build See & Hear, a table-top companion for two-to-four–person meetings.
The headphone wearer receives a private, noise-reduced feed of the talker they are looking at – and can instantly switch sides by simply raising the matching hand (left hand → left seat, right hand → right seat).
This gives interpreters, note-takers and non-native speakers a fatigue-free, captioned audio channel while the room conversation remains untouched.

Why Does This Project Matter to Us?

For seven years Sebastian developed beam-forming and noise-reduction systems that help people with hearing loss follow conversations.  Users, and even perfectly normal-hearing colleagues, sink into fatigue during fast, multilingual meetings because they can’t isolate the voice that matters.

See & Hear is supposed to solve these issues with no custom earbuds, no cloud, just look or lift a hand and listen. 

First Steps

Once the board arrives we will start to work on running the vision models we need (YOLO and Retinaface) before we look into the audio chain and integration topics.