AI-Driven Forgery Detection in Offline Handwriting Signatures: Advances, Challenges, and the Role of Generative Adversarial Networks

Safura Adeela Sukiman; Nor Azura Husin; Hazlina Hamdan; Masrah Azrifah Azmi Murad

doi:10.24191/jcrinn.v10i2.532

AI-Driven Forgery Detection in Offline Handwriting Signatures: Advances, Challenges, and the Role of Generative Adversarial Networks

Authors

Safura Adeela Sukiman Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA Johor Branch, Segamat Campus, 85000, Segamat, Malaysia.
Nor Azura Husin Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Malaysia.
Hazlina Hamdan Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Malaysia.
Masrah Azrifah Azmi Murad Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Malaysia.

DOI:

https://doi.org/10.24191/jcrinn.v10i2.532

Keywords:

Offline Handwriting Signatures, Signature Forgery Detection, Generative Adversarial Networks, Siamese Networks, Autoencoders, Deep Learning

Abstract

Handwriting-based authentication continues to be a critical element in forensic analysis, particularly in the context of document fraud and signature forgery. Although deep learning (DL) techniques have shown promising results, there are still obstacles associated with the availability of limited datasets, the generalization of models, and their robustness. This review conducts a systematic examination of recent developments in DL methods for signature forgery detection. It employs the PRISMA protocol and retrieves literature from four well-established databases: Scopus, ACM Digital Library, Web of Science, and IEEE Xplore. Following a rigorous screening procedure, a total of 15 primary studies published between 2019 and 2025 were selected from an initial 115 records that were filtered by Computer Science subject area, English language, and original research articles. Five publicly accessible datasets: CEDAR, BHSig260, ICDAR 2011 SigComp, Kaggle signature verification dataset by RobinReni, and Kaggle handwritten signatures by Divyansh Rai were identified and analysed. The review indicates that Siamese networks dominate the DL architecture for signature forgery detection tasks, while alternative methods either employed fine-tuned pre-trained models (i.e., VGG16) or a hybrid of autoencoders and Convolutional Neural Networks (CNNs). An accuracy of 100% has been achieved through utilization of Siamese network leveraging the CEDAR dataset. This result is reasonable since CEDAR has the advantages of clean and balanced dataset. In response to the persisting limitations, this review emphasizes Generative Adversarial Networks (GANs) as the powerful data augmentation technique and a potential solution to enrich training datasets, simulate diverse forgery patterns, and enhance the robustness of models. Finally, a generative-aware conceptual framework is proposed at the end of the review to inform future research on the development of offline handwriting signature forgery detection system that is more resilient and forensic-ready.

Downloads

Download data is not yet available.

References

Anitha, A., Priya, M., Kamaraj, B., Yadav, N. K., & Srivastav, S. (2024). Handwritten signature forgery identification and prediction using Harris corner detection and Siamese network. In 2024 Second International Conference on Emerging Trends in Information Technology and Engineering (ICETITE) (pp. 1-5). IEEE. https://doi.org/10.1109/ic-etite58242.2024.10493595

Balaji, Y., Vikas Kedar, R., Virupakshi, H., & Anandan, P. (2024). Crafting trust with convolutional neural networks and hyperparameter tuning for precision signature verification in insurance claim. In 2024 International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS) (pp. 1-6). IEEE. https://doi.org/10.1109/adics58448.2024.10533503

Chaturvedi, P., & Jain, A. (2022). Feature ensemble based method for verification of offline signature images. In 2022 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) (pp. 710-714). IEEE. https://doi.org/10.1109/com-it-con54601.2022.9850628

Chokshi, A., Jain, V., Bhope, R., & Dhage, S. (2023). SigScatNet: A siamese + scattering based deep learning approach for signature forgery detection and similarity assessment. In 2023 International Conference on Modeling, Simulation &Amp; Intelligent Computing (MoSICom) (pp. 480-485). IEEE. https://doi.org/10.1109/mosicom59118.2023.10458765

Dash, R., Bag, M., Pattnayak, D., Mohanty, A., & Dash, I. (2023). Automated signature inspection and forgery detection utilizing VGG-16: A deep convolutional neural network. In 2023 2nd International Conference on Ambient Intelligence in Health Care (ICAIHC) (pp. 01-06). IEEE. https://doi.org/10.1109/icaihc59020.2023.10431430

Emberi, N. B., Mohan, A., Naphade, C. A., & Ransing, R. (2023). Harnessing deep neural networks for accurate offline signature forgery detection. In 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS) (pp. 619-626). https://doi.org/10.1109/iciccs56967.2023.10142593

Engin, D., Kantarci, A., Arslan, S., & Ekenel, H. K. (2020). Offline signature verification on real-world documents. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp 806-808). https://doi.org/10.1109/cvprw50498.2020.00412

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2017). GAN (Generative Adversarial Nets). Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, 29(5), 177. https://doi.org/10.3156/jsoft.29.5_177_2

Hadsell, R., Chopra, S., & LeCun, Y. (2006). Dimensionality reduction by learning an invariant mapping. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2, 1735–1742. https://doi.org/10.1109/cvpr.2006.100

Hafemann, L. G., Sabourin, R., & Oliveira, L. S. (2017). Offline handwritten signature verification - Literature review. In 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA) (pp. 1-8). https://doi.org/10.1109/ipta.2017.8310112

Jain, S., Khanna, M., & Singh, A. (2021). Comparison among different CNN architectures for signature forgery detection using Siamese neural network. In 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS) (pp. 481–486). https://doi.org/10.1109/icccis51004.2021.9397114

Joe Harris, S. K., & Anitha, J. (2023). An improved signature forgery detection using modified CNN in siamese network. In 2023 Second International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT) (pp. 1–5). https://doi.org/10.1109/iceeict56924.2023.10156951

Kathuria, I. (2022). Handwritten signature datasets [Data set]. Kaggle. https://www.kaggle.com/datasets/ishanikathuria/handwritten-signature-datasets.

Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020). A survey of the recent architectures of deep convolutional Neural Networks. Artificial Intelligence Review, 53(8), 5455–5516. https://doi.org/10.1007/s10462-020-09825-6

Krishna, C. A., & Bhuvaneswari, R. (2023). Offline signature forgery detection using Multi-Layer Perceptron. In 2023 3rd Asian Conference on Innovation in Technology (ASIANCON) (pp. 1-4). https://doi.org/10.1109/asiancon58793.2023.10269874

Liwicki, M., Blumenstein, M., van den Heuvel, E., Berger, C. E. H., Stoel, R. D., Found, B., Chen, X., & Malik, M. I. (2011). Hugging Face [Data set]. ICDAR 2011 Signature Verification Competition (SigComp2011). https://huggingface.co/datasets/1aurent/ICDAR-2011

Majumder, P., Joaa, A. M., Rahman Rhythm, E., Kabir Mehedi, M. H., & Alim Rasel, A. (2023). Siamese-transformer network for offline handwritten signature verification using few-shot. In 2023 26th International Conference on Computer and Information Technology (ICCIT) (pp. 1–6). IEEE. https://doi.org/10.1109/iccit60459.2023.10441035

Minh Tram, P. H., & Chau, D. N. (2024). Offline signature forgery detection using image processing. In 2024 13th International Conference on Control, Automation and Information Sciences (ICCAIS) (pp. 1-6). IEEE. https://doi.org/10.1109/iccais63750.2024.10814324

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., ... & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372.

Rai, D. (2020). Handwritten signatures dataset [Data set]. Kaggle. https://www.kaggle.com/datasets/divyanshrai/handwritten-signatures

Reddy, M. S., Lakshmi, A. A., Reddy, G. S., Madhavi, B. K., Panigrahi, B. S., & Mohan, V. (2024). Signature forgery detection using siamese-convolutional neural network. In 2024 1st International Conference on Cognitive, Green and Ubiquitous Computing (IC-CGU) (pp. 1–5). IEEE. https://doi.org/10.1109/ic-cgu58078.2024.10530761

Reni, R. (2019). Signature verification dataset [Data set]. Kaggle. https://www.kaggle.com/datasets/robinreni/signature-verification-dataset.

Schroff, F., Kalenichenko, D., & Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 815-823). IEEE. https://doi.org/10.1109/cvpr.2015.7298682

Shirisha, N., Pranitha, V. P., Balaram, A., Kalpana Chowdary, M., & Shekar, K. (2024). A learning-based intelligent method for signature forgery detection using pre-trained deep models. In 2024 Second International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI) (pp. 1337-1345). IEEE. https://doi.org/10.1109/icoici62503.2024.10696616

Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.

Soelistio, E. A., Hananto Kusumo, R. E., Martan, Z. V., & Irwansyah, E. (2021). A review of signature recognition using machine learning. In 2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI) (pp. 219-223). https://doi.org/10.1109/iccsai53272.2021.9609732

Srihari, S. N., & Leedham, G. (2001). CEDAR signature verification dataset [Data set]. Center of Excellence for Document Analysis and Recognition (CEDAR), University at Buffalo. http://www.cedar.buffalo.edu/NIJ/

Swamy, B. N., Kumar, D. L., Jyothi, K. L., Harika, M. V., Kancharla, G., & Karthik, B. R. (2024). Offline signature verification with AUTOENCODERCNN hybrid feature extraction for improved fake signature detection. In 2024 International Conference on Social and Sustainable Innovations in Technology and Engineering (SASI-ITE) (pp. 418–423). IEEE. https://doi.org/10.1109/sasi-ite58663.2024.00085

Tarek, O., & Atia, A. (2022). Forensic handwritten signature identification using Deep Learning. In 2022 IEEE 9th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT) (pp. 185–190). IEEE. https://doi.org/10.1109/setit54465.2022.9875697

Tehsin, S., Hassan, A., Riaz, F., Nasir, I. M., Fitriyani, N. L., & Syafrudin, M. (2024). Enhancing signature verification using triplet Siamese similarity networks in digital documents. Mathematics, 12(17), 2757. https://doi.org/10.3390/math12172757

Wang, S., & Jia, S. (2019). Signature handwriting identification based on generative adversarial networks. Journal of Physics: Conference Series, 1187(4), 042047. https://doi.org/10.1088/1742-6596/1187/4/042047