This project aims to create an intuitive and engaging virtual painting experience using machine learning and hand gesture recognition with ml5.handPose.

The right hand will function as the primary painting tool. Users can create brushstrokes by pinching their thumb and index finger together, controlling the flow and placement of the paint. By pinching the thumb and middle finger together, users can erase. The left hand will act as a tool palette. Different fingers will change the color, and opening and close the hand (open hand vs fist) will change the brush thickness.

Melody Painter with HandPose by Jack B. Du.

Screenshot 2024-11-20 at 8.37.56 PM.png

HandPose - Particles by Jack Du

image.png

Untitled_Artwork 20.png

Untitled.mov

IMG_1660.jpeg

IMG_1662.jpeg