Perceptually-based compensation of light pollution in display systems

Jeroen van Baar¹ Steven Poulakos² Wojciech Jarosz¹ Derek Nowrouzezahrai¹ Rasmus Tamstorf³ Markus Gross^1,2

¹Disney Research Zürich ²ETH Zürich ³Walt Disney Animation Studios

In Proceedings of the 2011 ACM Symposium on Applied Perception in Graphics and Visualization, 2011

Using our perceptual framework we can compensate for light pollution due to ghosting in 3D stereo (left) and indirect scattering when projecting onto concave screens (right). Current subtractive solutions fail in areas where the input image is dark (by either retaining some residual ghost or eliminating important surface detail). Our solution automatically solves for a perceptually optimal compensation that diminishes the appearance of ghosts and reveals more detail in these problem regions. Note: All deghosting results in this paper have been captured with a camera through a polarizing filter; All descattering results are simulations.

Abstract Downloads Videos Cite Related

Abstract

This paper addresses the problem of unintended light contributions due to physical properties of display systems. An example of such unintended contribution is crosstalk in stereoscopic 3D display systems, often referred to as ghosting. Ghosting results in a reduction of visual quality, and may lead to an uncomfortable viewing experience. The latter is due to conflicting (depth) edge cues, which can hinder the human visual system (HVS) proper fusion of stereo images (stereopsis). We propose an automatic, perceptually-based computational compensation framework, which formulates pollution elimination as a minimization problem. Our method aims to distribute the error introduced by the pollution in a perceptually optimal manner. As a consequence ghost edges are smoothed locally, resulting in a more comfortable stereo viewing experience. We show how to make the computation tractable by exploiting the structure of the resulting problem, and also propose a perceptually-based pollution prediction. We show that our general framework is applicable to other light pollution problems, such as descattering.

Downloads

Videos

Video (full-quality)

Video (iPhone)

Cite

Jeroen van Baar, Steven Poulakos, Wojciech Jarosz, Derek Nowrouzezahrai, Rasmus Tamstorf, Markus Gross. Perceptually-based compensation of light pollution in display systems. Proceedings of the 2011 ACM Symposium on Applied Perception in Graphics and Visualization, August 2011.

@inproceedings{vanbaar11perceptually,
    author    = {van Baar, Jeroen and Poulakos, Steven and Jarosz, Wojciech and Nowrouzezahrai, Derek and Tamstorf,
                 Rasmus and Gross, Markus},
    title     = {Perceptually-Based Compensation of Light Pollution in Display Systems},
    booktitle = {Proceedings of the 2011 ACM Symposium on Applied Perception in Graphics and Visualization},
    month     = aug,
    year      = {2011},
    publisher = {ACM},
    address   = {New York, NY, USA},
    doi       = {10/b9z7b2}
}

2013 Patent: Compensation for self-scattering on concave screens