Hot Chocolate

Making music without owning an instrument

An AR music experience built for Snap Spectacles at the Stanford XR Hackathon. Look at any surface to place a chocolate-themed keyboard and play it with your hands, no gear or lessons required.


Overview · Challenge · Concept · Interaction · Reflection

Hot Chocolate AR demo, with sound. Press play, or watch on youtube.com/watch?v=jHm1j4TOQJ8 ↗

Overview

Hot Chocolate lowers the barrier to making music through playful AR. Built for Snap Spectacles in Lens Studio, it lets you look at any flat surface and drop a chocolate-themed keyboard, ready to play by tapping. A table, desk, or floor becomes an instrument, pairing visual delight with responsive sound so beginners can start playing in seconds.


Role

UX, interaction & AR prototyping

Tools

Lens Studio · 3D models

Event

Stanford XR Hackathon

Platform

Snap Spectacles · AR glasses

The Challenge

Making the first note effortless

Instrument learning has a steep entry cost: gear, setup, and theory scare beginners off before they ever play. In a time-boxed hackathon, the team set out to remove every barrier between a curious person and their first satisfying sound.

The Concept

Any surface becomes an instrument

Look at a surface and a placement ring locks a chocolate-themed keyboard onto it. White keys and chocolate-bar black keys sit in real space, and tapping them triggers responsive sound and playful chocolate visuals. The theme and instant feedback make the first minute feel like play, not practice.

Interaction

Two gestures: pinch and tap

Once the chocolate instruments appear on a surface, the whole experience runs on two natural hand gestures, no controllers, menus, or tutorials to learn first.

Pinching a chocolate instrument to separate it from the set and move it in AR space
Pinch Separate & arrange Pinch an instrument to pull it out of the set and reposition it anywhere in the room. Spread the pieces across a table, wall, or floor to build a layout that fits how you want to play.
Tapping the chocolate keyboard keys to trigger sound in AR
Tap Play the sound Tap the keys and chocolate pads to play. Each surface triggers its own note with a visual pop, so you can perform with both hands in real space.
Watch the full demo on YouTube ↗

Play it

Try the chocolate keyboard

The whole point was a first note that feels good, so here is a small taste right in the browser. Play the piano, then hit the chocolate bar below, an electronic drum pad, for beats. It runs on the project's own piano and drum samples. Tap, or use your keyboard.

A
S
D
F
G
H
J
K

Chocolate drum pad

Kick
Snare
HH
HH open
Tom
Crash
Ride
Rim
Clap
Cowbell
808
Perc

Piano: A S D F G H J K (white keys), W E T Y U (chocolate blacks). Drum pad: number keys 1 2 3 4 5 6 7 8 9 0 - = across the bar.

Reflection

Constraints made the idea sharper

A 48-hour hackathon forced ruthless focus on one delightful interaction instead of a full product. The lesson that stuck: for beginners, emotional payoff in the first ten seconds matters more than depth of features. Given more time, user testing would check whether the joy of the first tap converts into continued practice, and hand-tracking accuracy across varied surfaces would be the next thing to harden.