Virtual Canvas

Sketch Link

https://editor.p5js.org/ava.auffret/sketches/mwJDG4YDP

One sentence description

An interactive painting app using ml5.handPose that allows users to paint on-screen by moving their hands.

Project summary

This project aims to create an intuitive and engaging virtual painting experience using machine learning and hand gesture recognition with ml5.handPose.

The drawing hand will function as the painting tool. Users can create brushstrokes by pinching their thumb and index finger together, controlling the flow and placement of the paint. By pinching the thumb and middle finger together, users can erase all strokes. The ring finger increases painting size, and the pinky decreases the size.

The non drawing hand is the tool palette. Different fingers will filter through different color palettes: primary, pastel, neutral, and greyscale.

Inspiration

My inspiration for this project was a combination of different digital art platforms and different ml5.handPose projects, but specifically Melody Painter with HandPose by Jack B. Du.

image.png

image.png

Screenshot 2024-12-17 at 3.22.23 PM.png

Untitled_Artwork 20.png

Here is a quick sketch of my first version.

Process