Automated Evaluation of Handwritten Answer Script Using Deep Learning Approach
DOI:
https://doi.org/10.14738/tmlai.104.12831Abstract
Automatic Essay Grading (AEG) is one of the exciting research topics in the field of adopting technology in education. In the education system assessment of student’s answer script is a critical job of teachers; yet doing so consumes a significant amount of their time and prevents them from working on other tasks. In addition, evaluating a large number of exam scripts is error-prone, inefficient, and tedious. Natural Language Processing (NLP), has created such an opportunity to make the computer learn about written text data and make important decisions based on the learned model. Similarly, it is possible to make a computer be able to assess an answering script based on the model used to train our computer to learn about answers to predefined short questions. In this paper, we propose a deep learning architecture with a combination of Con- volutional Neural Network (CNN) and Bidirectional Long Short Term Memory (BiLSTM) which has the ability to perform both handwritten answers recogni- tion and grading them as accurately as a human expert grader.
References
Dong, F., Zhang, Y. (2016). Automatic features for essay scoring–an empirical study. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (pp. 1072-1077).
D. Alikaniotis, H. Yannakoudakis, and M. Rei, Automatic Text Scoring Using Neural Networks, arXiv:1606.04289v2 [cs.CL], 2016.
B. Balci, D. Saadati, and D. Shiferaw, Handwritten Text Recognition using Deep Learning, Stanford University.
T. Wang, D. Wu, A. Coates, A. Ng. ”End-to-End Text Recognition with Convolutional Neural Networks” ICPR 2012
Thodore Bluche, Jrme Louradour, Ronaldo Messina. Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attention., arXiv:1604.03286, 2016.
A. Shehab, M. Elhoseny and A. E. Hassanien, ”A hybrid scheme for Automated Essay Grading based on LVQ and NLP techniques,” 2016 12th International Computer Engineering Conference (ICENCO), 2016, pp. 65-70, doi: 10.1109/ICENCO.2016.7856447.
MitchelI, T., Russel, T., Broomhead, P., and Aldridge N., Towards robust computerized marking of free-text responses, In M. Danson (Ed.), Proceedings of the Sixth International Computer Assisted Assessment Conference, Loughboroug University, Loughborouh, UK., 2002.
C. Cai, Automatic Essay Scoring with Recurrent Neural Network, Proceedings of the 3rd International Conference on High Performance Compilation, Computing and Communications, ACM, 2019.
H. Nguyen and L. Dery, Neural Networks for Automated Essay Grading, Department of Computer Science, Stanford University.
S. Srihari, J. Collins, R. Srihari, H. Srinivasan, S. Shetty, and J. B. Griffler, Automatic scoring of short handwritten essays in reading comprehension tests, Artificial Intelligence, Elsevier, 2008.
A.A.A. Alil and S. Mallaiah, Intelligent handwritten recognition using hybrid CNNarchitectures based-SVM classifier with dropout, Journal of King Saud University – Computer and Information Sciences, Elsevier, 2021.
A. Sharma and D. B. Jayagopi, Automated grading of handwritten essays, 16th International Conference on Frontiers in Handwriting Recognition, 2018.
S. Ge and X.Chen, The application of deep learning in automated essay evaluation, Emerging technologies for education, Springer Nature, Switzerland, 310-318, 2020.
P. Xu, T. M. Hospedales, Q. Yin, Y. Z. Song, T. Xiang, and L. Wang, Deep Learning for Free-Hand Sketch: A Survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
Zhang, Haochen, Liu, Dong, Xiong, and Zhiwei, CNN-based text image superresolution tailored for OCR, IEEE Visual Communications and Image Processing, 2017.
C. Jin, B. He, K. Hui, L.Sun,TDNN: A Two-stage Deep Neural Network for Prompt independent Automated Essay Scoring, Association for Computational Linguistics, 2018
P. Xu, C.K. Joshi, X. Bresson, Multigraph Transformer for Free-Hand Sketch Recognition, IEEE Transactions on Neural Networks and Learning Systems, 2021.
Frinken V., Bunke H., Continuous Handwritten Script Recognition, In: Doermann D., Tombre K. (eds) Handbook of Document Image Processing and Recognition. Springer, 2014.
Jorge Sueiras, Victoria Ruiz, Angel Sanchez, Jose F. Velez, Offline continuous handwriting recognition using sequence to sequence neural networks, Neurocomputing, Elsevier, Volume 289, 2018, Pages 119-128,
Myat Thiri Wai, Thi Thi Zin, Mitsuhiro Yokota, Khin Than Mya, Handwritten Character Segmentation in Tablet Based Application, Proceedings of the 8th IEEE Global Conference on Consumer Electronics, Osaka, Japan, 2019.
P. Shivakumara, D. Tang, M. Asadzadehkaljahi, T. Lu, U. Pal and M. Hossein Anisi, CNN-RNN based Method for License Plate Recognition, CAAI Transactions on Intelligence Technology, Vol. 3, No. 3, pp. 169-175, 2018.
B. B. Klebanov and M. Flor, Word association profiles and their use for automated scoring of essays, In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pages 1148–1158.
H. Bunke, M. Roth, E.G. Schukat-Talamazzini, Offline Cursive Handwriting Recognition using Hidden Markov Models, Elsevier Journal of Pattern Recognition,
Thodore Bluche, Jrme Louradour, Ronaldo Messina. Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attention.
Elfaik. H. and Nfaoui. E. H, Deep Bidirectional LSTM Network Learning-Based Sentiment Analysis for Arabic Text, Journal of Intelligent Systems, 2020.
S. M. S. Islam, M. M. Hasan, S. Abdullah Deep Learning based Early Detection and Grading of Diabetic Retinopathy Using Retinal Fundus Images, arXiv:1812.10595v1 [cs.CV], 2018.
Chen C-W, Tseng S-P, Kuan T-W, Wang J-F. Outpatient Text Classification Using Attention-Based Bidirectional LSTM for Robot-Assisted Servicing in Hospital. Information. 2020.
I. K. Ihianle, A. O. Nwajana, S. H. Ebenuwa, R. I. Otuka, K. Owa and M. O. Orisatoki, A Deep Learning Approach for Human Activities Recognition From Multimodal Sensing Devices, in IEEE Access, vol. 8, pp. 179028-179038, 2020.
Khan, M., Wang, H., Riaz, A. et al. Bidirectional LSTM-RNN-based hybrid deep learning frameworks for univariate time series classification. The Journal of Supercomputing 77, 7021–7045 (2021).
Attali and Burstein Automated essay scoring with e-Rater, Journal of Technology, Learning, and Assessment, 4(3):1–30, 2006.
Noura Farra, Swapna Somasundaran, and Jill Burstein, Scoring persuasive essays using opinions and their targets. In Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 64–74, 2015.
Taghipour, K., Ng, H. T. A neural approach to automated essay scoring. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (pp. 1882-1891), 2016.
Chung, J., Gulcehre, C., Cho, K., Bengio, Y. Empirical evaluation of gated recurrent neural networks on sequence modeling., arXiv preprint arXiv:1412.3555,(2014).
Zhang, H., Litman, D. (2018). Co-Attention Based Neural Network for Source-DependentEssayScoring.InProceedingsoftheThirteenthWorkshoponInnovative Use of NLP for Building Educational Applications (pp. 399-409).
A. De Sousa Neto, B. Bezerra, A. Toselli and E. Lima, “HTR-Flor: A Deep Learning System for Offline Handwritten Text Recognition”, Proceedings of International Conference on Graphics, Patterns and Images, pp. 1-8, 2020.
Q. Vo, S. Kim, H. Yang and G. Lee, “Text Line Segmentation using a Fully Convolutional Network in Handwritten Document Images”, IET Image Processing,
MitchelI, T., Russel, T., Broomhead, P., and Aldridge N. , ”Towards robust computerized marking of free-text responses”, In M. Danson (Ed.), Proceedings of the Sixth International Computer Assisted Assessment Conference, Loughboroug University, Loughborouh, UK., 2002.
B. Shi, X. Bai and C. Yao, An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition, arXiv:1507.05717v1 [cs.CV] 21 Jul 2015
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Md. Afzalur Rahaman, Hasan

This work is licensed under a Creative Commons Attribution 4.0 International License.