Hot Chocolate
Making music without owning an instrument
An AR music experience built for Snap Spectacles at the Stanford XR Hackathon. Look at any surface to place a chocolate-themed keyboard and play it with your hands, no gear or lessons required.
Overview · Challenge · Concept · Interaction · Reflection
Hot Chocolate AR demo, with sound. Press play, or watch on youtube.com/watch?v=jHm1j4TOQJ8 ↗
Overview
Hot Chocolate lowers the barrier to making music through playful AR. Built for Snap Spectacles in Lens Studio, it lets you look at any flat surface and drop a chocolate-themed keyboard, ready to play by tapping. A table, desk, or floor becomes an instrument, pairing visual delight with responsive sound so beginners can start playing in seconds.
The Challenge
Making the first note effortless
Instrument learning has a steep entry cost: gear, setup, and theory scare beginners off before they ever play. In a time-boxed hackathon, the team set out to remove every barrier between a curious person and their first satisfying sound.
The Concept
Any surface becomes an instrument
Look at a surface and a placement ring locks a chocolate-themed keyboard onto it. White keys and chocolate-bar black keys sit in real space, and tapping them triggers responsive sound and playful chocolate visuals. The theme and instant feedback make the first minute feel like play, not practice.
Interaction
Two gestures: pinch and tap
Once the chocolate instruments appear on a surface, the whole experience runs on two natural hand gestures, no controllers, menus, or tutorials to learn first.
Play it
Try the chocolate keyboard
The whole point was a first note that feels good, so here is a small taste right in the browser. Play the piano, then hit the chocolate bar below, an electronic drum pad, for beats. It runs on the project's own piano and drum samples. Tap, or use your keyboard.
Chocolate drum pad
Piano: A S D F G H J K (white keys), W E T Y U (chocolate blacks). Drum pad: number keys 1 2 3 4 5 6 7 8 9 0 - = across the bar.
Reflection
Constraints made the idea sharper
A 48-hour hackathon forced ruthless focus on one delightful interaction instead of a full product. The lesson that stuck: for beginners, emotional payoff in the first ten seconds matters more than depth of features. Given more time, user testing would check whether the joy of the first tap converts into continued practice, and hand-tracking accuracy across varied surfaces would be the next thing to harden.
Next
Prism Catch: draw a line and catch the light