Prototype

Muscle Memory

Motion tracking and visual feedback for sports and dance

Play
Dance workflow prototype: extract poses from a reference video, practise each movement and download a recording with music and graphics.

Muscle Memory explores motion tracking as a way to see and practise movement, through a series of sports and dance prototypes.

See where a swing differs

The backhand prototype compares a recorded swing with a reference movement. Tracked body landmarks make differences in positioning visible alongside the original footage.

Two photographic backhand captures labelled REFERENCE and YOUR SWING. The participant has tracked body landmarks and a yellow elbow marker. The supporting label reads Compare the movement.

Compare a recorded backhand

The recorded-video prototype puts a reference swing and the participant's movement side by side. Body landmarks show how their positions differ as the swing unfolds.

Backhand comparison prototype: track a recorded swing and compare its movement with a reference.

Track racket-sport poses in VR

A separate Quest experiment uses body tracking to classify racket-sport poses, including forearm, lob and backhand swings. It explores recognising the player's pose in VR alongside the recorded-video comparison.

Quest body-tracking experiment: classify racket-sport poses including forearm, lob and backhand swings.

Learn a dance step by step

The dance prototype extracts poses from a reference video, waits for each match and colours the limbs to give feedback. A QR code then lets you download your recording with music and graphics.

A tracked red-jacket dancer labelled REFERENCE leads to the dance prototype labelled PRACTISE, then to a hand-held phone labelled YOUR VIDEO. The central scene compares player and reference skeletons; its supporting label reads Match each pose.

Take the practice home

The dance experiment turns the practice session into a recording. After following the reference poses, the player can scan a QR code to download their video with music and graphics. This short demo follows that flow.

A short cut of the dance prototype, from reference movement to a downloadable recording.