Abstract
Visual effects such as shadows and highlights appear in photographs due to variations in lighting conditions. Although these effects add more meaning to the images, they pose various problems to specific computer vision algorithms. Hence, the removal of shadows and highlights is often considered as a prerequisite to such algorithms. This paper presents an interactive technique for shadow elimination from images. Our method requires user input in the form of rough strokes on the shadow region and its corresponding non-shadow region in the image. We further use quaternion rotation in the YCbCr color space to derive an image that is invariant to shadows. The actual colors of the image are finally recovered by color transfer from the original shadow image. The proposed method takes less time to generate the shadow-free image and does not necessitate the detection of shadows prior to its removal. Also, unlike the existing shadow-removal techniques, our method generates invariant image with minor texture loss. Experimental findings are reported to demonstrate the performance of our shadow-removal technique.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Murali, S., Govindan, V.K., Kalady, S.: A survey on shadow removal techniques for single image. Int. J. Image Graph. Signal Process. 8(12), 38–46 (2016)
Finlayson, G.D., Drew, M.S., Lu, C.: Intrinsic images by entropy minimization. In: European Conference on Computer Vision, pp. 582–595. Springer (2004)
Finlayson, G.D., Hordley, S.D., Lu, C., Drew, M.S.: On the removal of shadows from images. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 59–68 (2006)
Qu, L., Tian, J., Han, Z., Tang, Y.: Pixel-wise orthogonal decomposition for color illumination invariant and shadow-free image. Opt. Express 23(3), 2220–2239 (2015)
Sasi, R.K., Govindan, V.: Shadow removal using sparse representation over local dictionaries. Int. J. Eng. Sci. Technol. 19(2), 1067–1075 (2016)
Guo, R., Dai, Q., Hoiem, D.: Paired regions for shadow detection and removal. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2956–2967 (2013)
Zhang, L., Zhang, Q., Xiao, C.: Shadow remover: image shadow removal based on illumination recovering optimization. IEEE Trans. Image Process. 24(11), 4623–4636 (2015)
Yu, X., Li, G., Ying, Z., Guo, X.: A new shadow removal method using color-lines. In: International Conference on Computer Analysis of Images and Patterns, pp. 307–319. Springer (2017)
Xiao, C., Xiao, D., Zhang, L., Chen, L.: Efficient shadow removal using subregion matching illumination transfer. In: Computer Graphics Forum, vol. 32, pp. 421–430. Wiley Online Library (2013)
Zhang, L., Yan, Q., Zhu, Y., Zhang, X., Xiao, C.: Effective shadow removal via multi-scale image decomposition. Vis. Comput. 35(6–8), 1091–1104 (2019)
Fan, X., Wu, W., Zhang, L., Yan, Q., Fu, G., Chen, Z., Long, C., Xiao, C.: Shading-aware shadow detection and removal from a single image. Vis. Comput. 36(10), 2175–2188 (2020)
Murali, S., Govindan, V., Kalady, S.: Single image shadow removal by optimization using non-shadow anchor values. Comput. Vis. Med. 5(3), 311–324 (2019)
Murali, S., Govindan, V.K.: Shadow detection and removal from a single image using LAB color space. Cybern. Inf. Technol. 13(1), 95–103 (2013)
Gong, H., Cosker, D.: Interactive removal and ground truth for difficult shadow scenes. JOSA A 33(9), 1798–1811 (2016)
Su, Y.-F., Chen, H.H.: A three-stage approach to shadow field estimation from partial boundary information. IEEE Trans. Image Process. 19(10), 2749–2760 (2010)
Gong, H., Cosker, D.: User-assisted image shadow removal. Image Vis. Comput. 62, 19–27 (2017)
Evans, C.J., Sangwine, S.J., Ell, T.A.: Hypercomplex color-sensitive smoothing filters. In: Proceedings 2000 International Conference on Image Processing (Cat. No. 00CH37101), vol. 1, pp. 541–544. IEEE (2000)
Shi, L., Funt, B.: Quaternion color texture segmentation. Comput. Vis. Image Underst. 107(1–2), 88–96 (2007)
Subakan, Ö.N., Vemuri, B.C.: A quaternion framework for color image smoothing and segmentation. Int. J. Comput. Vis. 91(3), 233–250 (2011)
Chen, B., Shu, H., Zhang, H., Chen, G., Toumoulin, C., Dillenseger, J.-L., Luo, L.: Quaternion zernike moments and their invariants for color image analysis and object recognition. Signal Process. 92(2), 308–318 (2012)
Hiary, H., Zaghloul, R., Al-Zoubi, M.B.: Single-image shadow detection using quaternion cues. Comput. J. 61(3), 459–468 (2018)
Goldman, R.: Rethinking quaternions. Synth. Lect. Comput. Graph. Anim. 4(1), 1–157 (2010)
Wang, J., Li, X., Yang, J.: Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1788–1797 (2018)
Vicente, T.F.Y., Hou, L., Yu, C.-P., Hoai, M., Samaras, D.: Large-scale training of shadow detectors with noisily-annotated shadow examples. In: European Conference on Computer Vision, pp. 816–832. Springer (2016)
Gryka, M., Terry, M., Brostow, G.J.: Learning to remove soft shadows. ACM Trans. Graph. (TOG) 34(5), 153 (2015)
Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. IEEE Comput. Graph. Appl. 21(5), 34–41 (2001)
Yang, Q., Tan, K.-H., Ahuja, N.: Shadow removal using bilateral filtering. IEEE Trans. Image Process. 21(10), 4361–4368 (2012)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Murali, S., Govindan, V.K. & Kalady, S. Quaternion-based image shadow removal. Vis Comput 38, 1527–1538 (2022). https://doi.org/10.1007/s00371-021-02086-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-021-02086-6