SCC de SnaijerSander de Snaijer
Loading Light/Dark Toggle

Gesture recognition

Gesture recognition experiments: detecting head tilts, eyebrow raises, and hand positions with MediaPipe to replace traditional game controls.

Gesture recognition projects

  1. Screen recording of the map gesture control demo showing an OpenLayers map with a small webcam preview in the corner. A user pans the map by making a fist and moving their hand, then zooms by spreading two open hands apart. All hand tracking and gesture detection runs in the browser using MediaPipe WASM with no backend.

    Open Source Hand Gesture Controls for Maps in the Browser

    3 Apr 2026

    Ever wanted to pan, zoom, rotate, and reset a map without touching anything? I built an open-source library that lets you control web maps using just your hands. No mouse, no touchscreen, no backend. ...

  2. Face-controlled Tetris game where a player moves pieces by raising eyebrows and opening their mouth using webcam face detection.

    Eyebrow Tetris: Face Controlled Browser Game

    15 Mar 2026

    A browser-based game that uses MediaPipe face mesh tracking to control falling Tetris blocks with head movements. Tilt your head left or right to move pieces, look up to rotate. Runs entirely in the b...

Gesture recognition articles

  1. Gesture Controls for OpenLayers, Google Maps & Leaflet

    Gesture Controls for OpenLayers, Google Maps & Leaflet

    12 Apr 2026

    Add hand gesture controls to OpenLayers, Google Maps, or Leaflet using MediaPipe hand tracking. Pan, zoom, and rotate maps with just a webcam. Open source, runs entirely in the browser, no backend needed. Includes CDN setup and JavaScript examples

  2. MediaPipe Hand Tracking & Face Detection in JavaScript

    MediaPipe Hand Tracking & Face Detection in JavaScript

    22 Mar 2026

    A beginner MediaPipe JavaScript tutorial: build a real-time hand tracking and face detection app in one HTML file. Draw rainbow trails, burst star particles with a peace sign, and trigger Spongebob face effects by opening your mouth. No npm, no backend, runs entirely in the browser using your webcam.