Third-year electronics, electrical engineering and control student at Sorbonne University, with a mathematics minor. I design circuits and robotic prototypes, from sensors to embedded software. I also share my photography and 3D work.
Electronics, robotics and software: my projects, design choices and current progress.
Photography
3D modelling
About
I am Benjamin Piras, a third-year student at Sorbonne University, majoring in electronics, electrical engineering and control (EEA), with a mathematics minor. I am interested in the complete system: sensors, circuits, acquisition, programming and control.
StudiesThird-year EEA major, mathematics minor — Sorbonne University
During my internship at the Institute of Intelligent Systems and Robotics (ISIR), I worked on an instrumented robotic hand prototype. From component selection and PCB design to sensor processing, this experience brought electronics and robotics together in one project.
Gesture detection and mapping gestures to music controls.
Technologies
Python · MediaPipe · hand tracking · Apple Music
1. Presentation
In this new project, after seeing people on Instagram controlling all sorts of things, such as photos and waves, with their hands, I did some research on the subject and discovered MediaPipe, a library that uses machine learning to track the position of hands, faces, and the human body with a more or less accurate point cloud. That’s when I had the idea of controlling music with my hands, from the volume to changing songs. With a little help, I was able to write a Python script that allows me to do this. Called Apple Music Hand Tracker, in my case, I did it with Apple Music because that’s my music platform. It would have worked just as well with Spotify, provided you have Premium, as remote music control requires payment. For the code, all you need to do is create a developer account. I refer you to my first project, which explains it: Here.
I hope you like this project. In the coming days, I’ll try to create a clean interface to make it more enjoyable than compiling Python code!
What’s more, you can have fun with all sorts of things, such as controlling the angle of a servo motor with your hand (but I find that rather basic). I’d like to take the use of MediaPipe a step further, for example by associating a password with a facial expression, like Apple’s new authentication keys for those in the know ^^…