Play snake by moving your head
source link: https://github.com/paruby/snake-face
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Snake face
Keyboards are for losers -- play snake by moving your head!
Play live: https://paruby.github.io/snake-face/
How does this work?
I use the tensorflow.js model MediaPipe Facemesh to estimate the head pose in real time using the device's camera. When the game starts, the direction in which the head is pointing is estimated as a reference point. Subsequent estimates during game play are compared to this to decide which direction to steer the snake.
The head direction is estimated by calculating the vectors connecting the centre of the lips to the left and right cheeks. These two vectors lie on a plane that approximates the surface of the face. The cross product of these vectors is normal to this plane and thus points approximately in the direction of the head.
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK