AR / VR / XR 2024 Completed

Dynamic Projector Mapper

Real-time 3D dynamic projection mapping system that tracks multiple rigid objects via Optitrack motion capture and maps media onto them from a fixed 4K projector.

UnityProjection MappingOptitrackMotion CaptureC#CMU School of DesignReal-time
Dynamic Projector Mapper

Overview

A real-time dynamic projection mapping system developed at the CMU School of Design. The system uses an Optitrack motion capture setup to track the 6-DOF position and rotation of multiple rigid objects simultaneously, then uses that data to project media onto them with pixel-perfect alignment from a fixed high-FOV 4K projector — even as the objects move.

My Role

Co-developed with Daniel Munoz Rosenberg. Designed the Optitrack-to-Unity pipeline, real-time projection frustum math, and multi-object tracking architecture.

Key Features

  • Sub-millimeter accurate projection alignment using Optitrack rigid body tracking
  • Supports multiple independently moving objects simultaneously
  • Fixed projector — no need to move the projector as objects move
  • 4K output for high-resolution media projection
  • Unity-based real-time rendering pipeline