The Use of Attention-RNN and Dense Layer Combinations and The Performance Metrics Achieved in Palm Vein Recognition

Authors

  • Indriani Indriani Widyatama University
  • Yenie Syukriyah Widyatama University

DOI:

https://doi.org/10.26555/jiteki.v11i1.30517

Keywords:

Palm vein recognition, Deep learning, RNN, Attention RNN, Dense Layer

Abstract

The utilization of palm veins in vascular biometrics is widely recognized, offering significant potential and challenges for advancing individual recognition technology. Deep learning has played a crucial role in enhancing the accuracy of these recognition systems. In this study, we proposed combining Attention-RNN and Dense Layer. To validate this proposed method, three deep learning model scenarios were implemented: (1) a combined Dense Layer with RNN, (2) an Attention-RNN model, and (3) a combined Attention-RNN with a Dense Layer for palm vein recognition. Experimental results demonstrated that the Attention-RNN combined with the Dense Layer achieved the highest accuracy, outperforming the other two models. The model’s performance was evaluated on two datasets, achieving 95% accuracy on the Kaggle dataset and 83% on the CASIA dataset, confirming its effectiveness in palm vein recognition.

References

[1] A. De Keyser, Y. Bart, X. Gu, S. Q. Liu, S. G. Robinson, and P. K. Kannan, “Opportunities and challenges of using biometrics for business: Developing a research agenda,” J. Bus. Res., vol. 136, pp. 52–62, Nov. 2021, https://doi.org/10.1016/j.jbusres.2021.07.028.

[2] C.-W. Lien and S. Vhaduri, “Challenges and Opportunities of Biometric User Authentication in the Age of IoT: A Survey,” ACM Comput. Surv., vol. 56, no. 1, pp. 1–37, Jan. 2024, https://doi.org/10.1145/3603705.

[3] Y. Zhang, B. Liao, and R. Lei, “Challenges and principled responses to privacy protection from biometric technology in China,” Acta Bioethica, vol. 29, no. 2, pp. 249–258, Oct. 2023, https://doi.org/10.4067/S1726-569X2023000200249.

[4] M. Gomez-Barrero et al., “Biometrics in the Era of COVID-19: Challenges and Opportunities,” IEEE Trans. Technol. Soc., vol. 3, no. 4, pp. 307–322, Dec. 2022, https://doi.org/10.1109/TTS.2022.3203571.

[5] S. Kodituwakku, “Biometric Authentication: A Review,” Int. J. Trend Res. Dev., vol. 2, pp. 113–123, Aug. 2015.

[6] C. Wilson, Vein pattern recognition: a privacy-enhancing biometric. Boca Raton: Taylor & Francis, 2010. https://doi.org/10.1201/9781439821381.

[7] B. Mróz-Gorgoń, W. Wodo, A. Andrych, K. Caban-Piaskowska, and C. Kozyra, “Biometrics Innovation and Payment Sector Perception,” Sustainability, vol. 14, no. 15, p. 9424, Aug. 2022, https://doi.org/10.3390/su14159424.

[8] G. K. O. Michael, T. Connie, and A. Teoh Beng Jin, “An innovative contactless palm print and knuckle print recognition system,” Pattern Recognit. Lett., vol. 31, no. 12, pp. 1708–1719, Sep. 2010, https://doi.org/10.1016/j.patrec.2010.05.021.

[9] “The Daily News 1924,” The Daily News 1924. [Online]. Available: http://nla.gov.au/nla.news-article82562896.

[10] T. Shinzaki, “Use Case of Palm Vein Authentication,” in Advances in Computer Vision and Pattern Recognition, pp. 145–158, 2020, https://doi.org/10.1007/978-3-030-27731-4_5.

[11] H. Qin, M. A. El Yacoubi, “End-to-End Generative Adversarial Network for Palm-Vein Recognition,” in Lecture Notes in Computer Science, pp. 714–724, 2020, https://doi.org/10.1007/978-3-030-59830-3_62.

[12] W. Wu, S. J. Elliott, S. Lin, S. Sun, and Y. Tang, “Review of palm vein recognition,” IET Biom., vol. 9, no. 1, pp. 1–10, Jan. 2020, https://doi.org/10.1049/iet-bmt.2019.0034.

[13] X. Yang, “An Overview of the Attention Mechanisms in Computer Vision,” J. Phys. Conf. Ser., vol. 1693, no. 1, p. 012173, Dec. 2020, https://doi.org/10.1088/1742-6596/1693/1/012173.

[14] J. Lou, J. zou, and B. Wang, “Palm Vein Recognition via Multi-task Loss Function and Attention Layer,” arXiv: arXiv:2211.05970, 2022, https://doi.org/10.48550/arXiv.2211.05970.

[15] H. I. Abdulrazzaq and R. D. Al-Dabbagh, “Biometric Identification System Based on Contactless Palm-Vein Using Residual Attention Network,” Iraqi J. Sci., pp. 1802–1810, Apr. 2022, https://doi.org/10.24996/ijs.2022.63.4.37.

[16] H. Liao, X. Jin, H. Zhu, Y. Fu, M. A. El Yacoubi, and H. Qin, “GAN et: Gabor Attention Aggregation Network for Palmvein Identification,” in 16th International Conference on Human System Interaction (HSI), pp. 1–6, 2024, https://doi.org/10.1109/hsi61632.2024.10613571.

[17] A. S. M. Htet and H. J. Lee, “Contactless Palm Vein Recognition Based on Attention-Gated Residual U-Net and ECA-ResNet,” Appl. Sci., vol. 13, no. 11, p. 6363, May 2023, https://doi.org/10.3390/app13116363.

[18] P. Wang and H. Qin, “Palm-vein verification based on U-Net,” IOP Conf. Ser. Mater. Sci. Eng., vol. 806, no. 1, p. 012043, Apr. 2020, https://doi.org/10.1088/1757-899x/806/1/012043.

[19] G. R. Nayar and T. Thomas, “Partial palm vein based biometric authentication,” J. Inf. Secur. Appl., vol. 72, p. 103390, Feb. 2023, https://doi.org/10.1016/j.jisa.2022.103390.

[20] S. Sun, X. Cong, P. Zhang, B. Sun, and X. Guo, “Palm Vein Recognition Based on NPE and KELM,” IEEE Access, vol. 9, pp. 71778–71783, 2021, https://doi.org/10.1109/ACCESS.2021.3079458.

[21] S. Khandelwal and L. Sigal, “AttentionRNN: A Structured Spatial Attention Mechanism,” in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 3424–3433, 2019, https://doi.org/10.1109/iccv.2019.00352.

[22] G. K. Ong Michael, T. Connie, and A. B. Jin Teoh, “A Contactless Biometric System Using Palm Print and Palm Vein Features,” in Advanced Biometric Technologies, pp. 155-177, 2011. https://doi.org/10.5772/19337.

[23] M. K. O. Goh, C. Tee, and A. B. J. Teoh, “Bi-Modal Palm Print And Knuckle Print Recognition System,” J. IT Asia, vol. 3, no. 1, pp. 85–106, Apr. 2016, https://doi.org/10.33736/jita.37.2010.

[24] G. K. O. Michael, T. Connie, T. C. Chin, N. H. Foon, and A. T. B. Jin, “Realizing Hand-Based Biometrics Based on Visible and Infrared Imagery,” in Neural Information Processing. Models and Applications, pp. 606–615, 2010, https://doi.org/10.1007/978-3-642-17534-3_75.

[25] “CASIA-MS-PalmprintV1.” [Online]. Available: http://biometrics.idealtest.org/.

[26] Y. Hao, Z. Sun, T. Tan, and C. Ren, “Multispectral palm image fusion for accurate contact-free palmprint recognition,” in 15th IEEE International Conference on Image Processing, pp. 281–284, 2008, https://doi.org/10.1109/ICIP.2008.4711746.

[27] Y. Hao, Z. Sun, T. Tan, “Comparative Studies on Multispectral Palm Image Fusion for Biometrics,” in Lecture Notes in Computer Science, pp. 12–21, 2007, https://doi.org/10.1007/978-3-540-76390-1_2.

[28] D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning representations by back-propagating errors,” Nature, vol. 323, no. 6088, pp. 533–536, Oct. 1986, https://doi.org/10.1038/323533a0.

[29] J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities.,” Proc. Natl. Acad. Sci., vol. 79, no. 8, pp. 2554–2558, Apr. 1982, https://doi.org/10.1073/pnas.79.8.2554.

[30] J. L. Elman, “Distributed representations, simple recurrent networks, and grammatical structure,” Mach. Learn., vol. 7, no. 2–3, pp. 195–225, Sep. 1991, https://doi.org/10.1007/bf00114844.

[31] S. Das, A. Tariq, T. Santos, S. S. Kantareddy, I. Banerjee, “Recurrent Neural Networks (RNNs): Architectures, Training Tricks, and Introduction to Influential Research,” in Neuromethods, pp. 117–138, 2023, https://doi.org/10.1007/978-1-0716-3195-9_4.

[32] X. Li et al., “Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds,” Int. J. Netw. Dyn. Intell., pp. 93–116, Mar. 2023, https://doi.org/10.53941/ijndi0201006.

[33] P. K. Sekharamantry, F. Melgani, and J. Malacarne, “Deep Learning-Based Apple Detection with Attention Module and Improved Loss Function in YOLO,” Remote Sens., vol. 15, no. 6, p. 1516, Mar. 2023, https://doi.org/10.3390/rs15061516.

[34] M. Samo, J. M. Mafeni Mase, and G. Figueredo, “Deep Learning with Attention Mechanisms for Road Weather Detection,” Sensors, vol. 23, no. 2, p. 798, Jan. 2023, https://doi.org/10.3390/s23020798.

[35] S. P. Ramya and R. Eswari, “Attention-Based Deep Learning Models for Detection of Fake News in Social Networks,” Int. J. Cogn. Inform. Nat. Intell., vol. 15, no. 4, pp. 1–25, Jan. 2022, https://doi.org/10.4018/ijcini.295809.

[36] D. Bahdanau, K. Cho, and Y. Bengio, “Neural Machine Translation by Jointly Learning to Align and Translate,” arXiv: arXiv:1409.0473, 2016, https://doi.org/10.48550/arXiv.1409.0473.

[37] A. Vaswani et al., “Attention Is All You Need,” arXiv: arXiv:1706.03762, 2023, https://doi.org/10.48550/arXiv.1706.03762.

[38] F. Rosenblatt, The Perceptron, a Perceiving and Recognizing Automaton Project Para. in Report: Cornell Aeronautical Laboratory. Cornell Aeronautical Laboratory, 1957. [Online]. Available: https://books.google.co.id/books?id=P_XGPgAACAAJ.

[39] F. Rosenblatt, “The perceptron: A probabilistic model for information storage and organization in the brain.,” Psychol. Rev., vol. 65, no. 6, pp. 386–408, 1958, https://doi.org/10.1037/h0042519.

[40] N. Gupta, B. Kaushik, M. Khalid Imam Rahmani, and S. Anwar Lashari, “Performance Evaluation of Deep Dense Layer Neural Network for Diabetes Prediction,” Comput. Mater. Contin., vol. 76, no. 1, pp. 347–366, 2023, https://doi.org/10.32604/cmc.2023.038864.

[41] V. Krasteva, I. Christov, S. Naydenov, T. Stoyanov, and I. Jekova, “Application of Dense Neural Networks for Detection of Atrial Fibrillation and Ranking of Augmented ECG Feature Set,” Sensors, vol. 21, no. 20, p. 6848, Oct. 2021, https://doi.org/10.3390/s21206848.

[42] V. L. Helen Josephine, A. P. Nirmala, and V. L. Alluri, “Impact of Hidden Dense Layers in Convolutional Neural Network to enhance Performance of Classification Model,” IOP Conf. Ser. Mater. Sci. Eng., vol. 1131, no. 1, p. 012007, Apr. 2021, https://doi.org/10.1088/1757-899x/1131/1/012007.

[43] “Confusion Matrix,” in Encyclopedia of Machine Learning, Boston, MA: Springer US, pp. 209–209, 2011, https://doi.org/10.1007/978-0-387-30164-8_157.

[44] A. Gumaei, R. Sammouda, A. Al-Salman, and A. Alsanad, “An Effective Palmprint Recognition Approach for Visible and Multispectral Sensor Images,” Sensors, vol. 18, no. 5, p. 1575, May 2018, https://doi.org/10.3390/s18051575.

[45] E. Thamri, K. Aloui, and M. S. Naceur, “Improving Palmprint based Biometric System Performance using Novel Multispectral Image Fusion Scheme,” Int. J. Adv. Comput. Sci. Appl., vol. 11, 2020, [Online]. Available: https://api.semanticscholar.org/CorpusID:222130875.

[46] A. Kumar and K. V. Prathyusha, “Personal Authentication Using Hand Vein Triangulation and Knuckle Shape,” IEEE Trans. Image Process., vol. 18, pp. 2127–2136, 2009, https://doi.org/10.1109/TIP.2009.2023153.

[47] A. Kumari, B. Alankar, and J. Grover, “Feature Level Fusion of Multispectral Palmprint,” Int. J. Comput. Appl., vol. 144, no. 3, pp. 41–46, Jun. 2016, https://doi.org/10.5120/ijca2016910175.

Downloads

Published

2025-03-05

How to Cite

[1]
I. Indriani and Y. Syukriyah, “The Use of Attention-RNN and Dense Layer Combinations and The Performance Metrics Achieved in Palm Vein Recognition”, J. Ilm. Tek. Elektro Komput. Dan Inform, vol. 11, no. 1, pp. 12–26, Mar. 2025.

Issue

Section

Articles

Similar Articles

<< < 1 2 3 > >> 

You may also start an advanced similarity search for this article.