Remote photoplethysmography (rPPG) techniques can measure cardiac activity by detecting pulse-induced colour variations on human skin using an RGB camera. State-of-theart rPPG methods are sensitive to subject body motions (e.g., motion-induced colour distortions). This study proposes a novel framework to improve the motion robustness of rPPG. The basic idea of this work originates from the observation that a camera can simultaneously sample multiple skin regions in parallel, and each of them can be treated as an independent sensor for pulse measurement. The spatial-redundancy of an image sensor can thus be exploited to distinguish the pulsesignal from motion-induced noise. To this end, the pixel-based rPPG sensors are constructed to estimate a robust pulse-signal using motion-compensated pixel-to-pixel pulse extraction, spatial pruning, and temporal filtering. The evaluation of this strategy is not based on a full clinical trial, but on 36 challenging benchmark videos consisting of subjects that differ in gender, skin-types and performed motion-categories. Experimental results show that the proposed method improves the SNR of the state-of-the-art rPPG technique from 3.34dB to 6.76dB, and the agreement (1:96) with instantaneous reference pulse-rate from 55% to 80% correct. ANOVA with post-hoc comparison shows that the improvement on motion robustness is significant. The rPPG method developed in this study has a performance that is very close to that of the contact-based sensor under realistic situations, while its computational efficiency allows real-time processing on an off-the-shelf computer.
Exploiting spatial-redundancy of image sensor for motion robust rPPG
2015-01-01
Wang , W , Stuijk , S & Haan, de , G 2015 , ' Exploiting spatial-redundancy of image sensor for motion robust rPPG ' , IEEE Transactions on Biomedical Engineering , vol. 62 , no. 2 , pp. 415-425 . https://doi.org/10.1109/TBME.2014.2356291
Article (Journal)
Electronic Resource
English
DDC: | 629 |
On exploiting channel code redundancy
IEEE | 1997
|On Exploiting Channel Code Redundancy
British Library Conference Proceedings | 1997
|Faster Motion on Cartesian Paths Exploiting Robot Redundancy at the Acceleration Level
BASE | 2018
|