New spectrum ratio properties and features for shadow detection

Abstract

Successfully detecting shadows in still images is challenging yet has wide applications. Shadow properties and features are very important for shadow detection and processing. The aim of this work is to find some new physical properties of shadows and use them as shadow features to design an effective shadow detection method for outdoor color images. We observe that although the spectral power distribution (SPD) of daylight and that of skylight are quite different, in each channel, the spectrum ratio of the point-wise product of daylight SPD with sRGB color matching functions (CMFs) to the point-wise product of skylight SPD with sRGB CMFs roughly approximates a constant. This further leads to that the ratios of linear sRGB pixel values of surfaces illuminated by daylight (in non-shadow regions) to those illuminated by skylight (in shadow regions) equal to a constant in each channel. Following this observation, we calculated the spectrum ratios under various Sun angles and further found out four new shadow properties. With these properties as shadow features, we developed a simple shadow detection method to quickly locate shadows in single still images. In our method, we classify an edge as a shadow or non-shadow edge by verifying whether the pixel values on both sides of the Canny edges satisfy the three shadow verification criteria derived from the shadow properties. Extensive experiments and comparison show that our method outperforms state-of-the-art shadow detection methods.