← Back to Projects

Thermal Fusion in Mixed Reality

Inspired by the movie Predator, I made this prototype system that enables users to see heat directly in their field of view.

The temperature data is obtained via a low-resolution thermal camera. Since thermal and RGB cameras have different intrinsic and extrinsic parameters, the thermal image won't automatically align with the RGB image. Thus, to overlay the thermal on the RGB with pixel-level accuracy, a point-cloud reconstruction of the scene is carried out to restore the depth information in the field of view.