Stack
Python · OpenCV · MediaPipe · FluidSynth · MIDI
A webcam instrument for learning chord theory by playing it.
How it works
A webcam feed runs through MediaPipe hand tracking in OpenCV. Each pointer fingertip controls one of two on-screen wheels. The left wheel selects the root note and the right wheel selects the chord type, and FluidSynth plays the chord those two produce. In sync mode the app sends MIDI over an IAC channel instead of generating the audio itself, so the chords play through Logic Pro using whatever instruments are loaded there.
Impact
More than a hundred progressions are playable without a keyboard. A theory mode covers two-five-ones, extensions, and jazz voicings, and explains each one as you play it.