Thermal and Visible Image Fusion for Ear Recognition


  • Syed Mohd Zahid Syed Zainal Ariffin Digital Image, Audio and Speech Technology Research Group, Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA, Shah Alam, Selangor, Malaysia.
  • Nursuriati Jamil Digital Image, Audio and Speech Technology Research Group, Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA, Shah Alam, Selangor, Malaysia.
  • Puteri Norhashimah Megat Abdul Rahman Universiti Teknologi MARA, Tapah Campus, Perak, Malaysia


Image Fusion, Ear Recognition, Ear Biometrics,


This paper discusses the possibility of fusing thermal and visible images to improve ear recognition ability in images of varying illuminations. Since thermal image is known to remain invariant to lighting changes and visible images are able to capture feature details, image fusion is proposed to accentuate the strengths of both spectra for ear recognition. Two popular image fusion techniques, weighted average (WA) and discrete wavelet transform (DWT) are used as a preliminary investigation. Eigenvectors are extracted from the fused image and recognition is performed using metric distance measure. With 67.5% recognition rate, DWT fused images performed better than WA fused images (63.75%). Thermal images, on the other hand, achieved 68.75% recognition rate. Even though thermal images performed slightly better than DWT fused images by 1.25%, the difference is deemed as insignificance due to the small dataset used and the primitive fusion rules employed. Further studies on the fusion techniques need to be done to improve fusion method.


Iannarelli, A. V., 1989. Ear Identification, in Forensic Identification Series, Freemont, California.: Paramont Publishing Company.

Kong, S. G., Heo, J., Boughorbel, F., Zheng, Y., Abidi, B. R., Koschan, A., Yi, M. and Abidi, M.A., 2007. Multiscale Fusion Of Visible And Thermal IR Images For Illumination- Invariant Face Recognition, International Journal of Computer Vision. 71(2):215–233.

Abaza, A. and Bourlai, T., 2012. Human Ear Detection In The Thermal Infrared Spectrum, in Thermosence : Thermal Infrared Application XXXIV. 8354:83540X.

Abaza, A. and Bourlai, T., 2013.On Ear-Based Human Identification In The Mid-Wave Infrared Spectrum, Image and Vision Computing. 31(9):640–648.

Arbab-Zavar, B. and Nixon, M. S., 2008. Robust Log-Gabor Filter For Ear Biometrics, 2008 19th International Conference on Pattern Recognition.1–4.

Kumar, A. and Wu C., 2012. Automated Human Identification Using Ear Imaging, Pattern Recognition. 45(3):956–968.

Hanif, M. and Ali, U. , Optimized Visual And Thermal Image Fusion For Efficient Face Recognition, 2006 9th International Conference on Information Fusion, FUSION, 2006.

Bebis, G., Gyaourova, A., Singh, S. and Pavlidis, I., 2006. Face Recognition By Fusing Thermal Infrared And Visible Imagery, Image Vision Computing. 24(7):727–742,

Moon, S., Kong, S. G., Yoo J.-H. and Chung, K., 2006. Face Recognition with Multiscale Data Fusion of Visible and Thermal Images, in IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety.16–17.

Singh, R., Vatsa M. and Noore, A., 2008. Hierarchical Fusion Of MultiSpectral Face Images For Improved Recognition Performance, Information Fusion. 9(2):200–210.

Rockinger, O. and Fechner, T., 1998. Pixel-Level Image Fusion: The Case Of Image Sequences, Proceeding SPIE. 3374:378–388.

Kayani, B. N., Mirza A. M., Bangash, A., and Iftikhar, H. 2007. Pixel & Feature Level Multiresolution Image Fusion Based On Fuzzy Logic, in Innovations and Advanced Techniques in Computer and Information Sciences and Engineering, Netherland: Springer, 129–132.

Yang, B., Jing, Z. L., and Zhao, H. T. 2010. Review Of Pixel-Level Image Fusion, Journal of. Shanghai Jiaotong University. 15 (1): 6–12.

Nanni, L. and Lumini, A., 2007. A Multi-Matcher For Ear Authentication, Pattern Recognition Letter. 28(16):2219–2226.

Turk, M.A. and Pentland, A. P., 1991. Face Recognition Using Eigenfaces, Journal of Cognitive Neuroscience. 3(1).




How to Cite

Syed Zainal Ariffin, S. M. Z., Jamil, N., & Megat Abdul Rahman, P. N. (2017). Thermal and Visible Image Fusion for Ear Recognition. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-3), 49–53. Retrieved from