SCC de SnaijerSander de Snaijer
Loading Light/Dark Toggle

Gesture recognition

Gesture recognition experiments: detecting head tilts, eyebrow raises, and hand positions with MediaPipe to replace traditional game controls.

Gesture recognition projects

  1. 3 Apr 2026

    Screen recording of the map gesture control demo showing an OpenLayers map with a small webcam preview in the corner. A user pans the map by making a fist and moving their hand, then zooms by spreading two open hands apart. All hand tracking and gesture detection runs in the browser using MediaPipe WASM with no backend.

    Open Source Hand Gesture Controls for Maps in the Browser

    Open source library for controlling OpenLayers, Google Maps, and Leaflet with hand gestures. Pan, zoom, and rotate maps without touching the screen.

  2. 15 Mar 2026

    Face-controlled Tetris game where a player moves pieces by raising eyebrows and opening their mouth using webcam face detection.

    Eyebrow Tetris: Face Controlled Browser Game

    A browser Tetris game controlled by your face. Raise your eyebrows to rotate, tilt your head to move pieces. Built with MediaPipe face mesh tracking.

Gesture recognition articles

  1. 12 Apr 2026

    Gesture Controls for OpenLayers, Google Maps & Leaflet

    Gesture Controls for OpenLayers, Google Maps & Leaflet

    Add open source hand gesture controls to OpenLayers, Google Maps and Leaflet with MediaPipe hand tracking. Pan, zoom and rotate maps by webcam.

  2. 22 Mar 2026

    MediaPipe Hand Tracking & Face Detection in JavaScript

    MediaPipe Hand Tracking & Face Detection in JavaScript

    Beginner MediaPipe JavaScript tutorial: build a real-time hand tracking and face detection app in one HTML file with rainbow trails, particles and webcam effects.