I’m glad to finally announce that the polished version of Brobot is ready!
Overview
Brobot is a AI powered gym buddy, to analyze workout form, evaluate range of motion and count reps for a workout.
This system is designed with a server/client architecture - I could foresee this type of use case for gyms across multiple machines so I wanted to have a clear distinction of who does what. A Gym might use this to induct new members to the gym, offer personalized training or just in general constantly monitor for safety and equipment misuse.
Backend
A very simple (~250 lines) Socket.io server which wraps up the Voyager SDK output into JSON, and compresses the video frames from the SDK into compressed JPEG encoded as base 64. If not to use for Brobot, this might be a nice familiar way for some devs start using the Voyager SDK.
Frontend
This was built with React to allow for user defined values such as target reps.
Description
The Voyager SDK made this job very simple, I’m just using the largest Yolo model that is supported out the box, with some model parameters tuned because i’m only targeting one person right now, so don’t need to worry about iou and the like.
Ideas for the future
- Gamify the frontend some more
- Have dual cameras to check from the side
- Audio prompts with tips, or encouragement
Demonstration
Thank you so much for the Axelera team for organizing this task - it’s been a pleasure to work with this technology and it leaves me motivated to learn more and keep pushing forward. Also a worthy thank you to the fellow competitors, who have helped in the forums. I look forward to checking out your awesome looking projects.
Good Luck everyone. Wish you all the best - Liam.