Multi-Layer Perceptron Algorithm, an Effective tool for the Prediction of the Judgments of the Supreme Court of Nigeria

Authors

  • F Ayankoya
  • O Ngige
  • E Onuiri
  • T Adigun
  • E. Omotunde

DOI:

https://doi.org/10.14738/tecs.116.15858

Keywords:

Supreme Court, Prediction, Feature selection, Multi-layer perceptron, ADAM optimization function, Algorithm, Classification Pearson correlation coefficient.

Abstract

Effective dispensation of justice is sacrosanct to the sustenance of peace and stability of any nation. Justice delayed is often perceived as justice denied, and so it becomes important that the rule of law as it concerns effective and efficient justice delivery is sustained. In achieving this effectiveness, adherence to transparency and adequate knowledge of judicial proceedings and practices play a key part in achieving justice. This is however not the case with the Nigerian justice system, as court congestions and case delays have plagued the Nigerian Supreme Court for decades, breeding distraught and lack of confidence in the institution and its process. This study attempted to quicken the pace of justice delivery by developing a predictive model for the classification of Supreme Court judgments in Nigeria, and improved the performance of the computational process that is required for the identification of the pattern between feature and judgment using the Pearson Correlation Coefficient to select relevant features. The study which was aimed at developing a predictive model for the classification of Supreme Court judgments in Nigeria using Multilayer Perceptron (MLP) algorithm was carried out using 5585 records of precedent judgments delivered at the SCN between 1962- July 2022. Data was collected from an independently owned data repository (Primsol Law Pavilion). Data annotation and feature extraction were carried out and variables that have strong impact on judgments were identified both from literature and from domain experts. Pearson Correlation feature selection method was used to select the most relevant features from the initially identified features, after which multi-layer perceptron with ADAM optimization function was used to develop the classification model. The result of the feature selection algorithms revealed that the Pearson Correlation-based methods proved to be effective in the identification of the most relevant features. The MLP-ADAM model for predicting the outcome of Supreme Court judgment was evaluated and benchmarked with a related study carried out to predict judicial decisions of criminal cases from Thai Supreme Court, using both conventional and modified models. The result of MLP-ADAM showed a better performance of predicting judicial decision, showing 100% precision, 99% recall and 100% F1 Score for the  as against 69.59% precision,79.87% recall and 74.38% F1score obtained by the Bi-GRU + attention model of the existing study.  The study showed that feature selection using the Pearson correlation based approach provides a better performance. The study also revealed that the ADAM optimization function was significant in achieving good accuracy and generalization ability of the model. The use of structured and well organized dataset enabled the model to train effectively. The study also demonstrated that a higher proportion of the dataset is important in the training phase.

References

H. Ahmad, M. U Asghar, A. Khan, A.H Mosavi, “A Hybrid Deep Learning Technique for Personality Trait Classification from Text”. IEEE Access, 9, 146214–146232, 2021.

M. Medvedeva, M. Wieling, and M. Vols, “Rethinking the Field of Automatic Prediction of Court Decisions”. Artificial Intelligence and Law, 1-19. Retrieved from https://doi.org/10.1007/s10506-021-09306-3.2022

M. Marković, and S. Gostojić “Open Judicial Data: A Comprehensive Analysis” Social Science Computer Review, vol 38, pp. 295-314. 2018

P. Bhilare, N. Parab, N. Soni, B. Thakur, B, “Predicting outcome of judicial cases and analysis using machine learning”. International Research Journal in Engineering Technology, 6, 326-330, 2019

K. Ashley, and S. Brüninghaus, “Automatically classifying case texts and predicting outcomes”. Artificial Intelligence in Law, 17(2), 125-165, 2009

B. Waltl, G. Bonczek, E. Scepankova, J. Landthaler, & F. Matthes, Predicting the outcome of appeal decisions in germany’s tax law. In Electronic Participation: 9th IFIP WG 8.5 International Conference, ePart 2017, St. Petersburg, Russia, September 4-7, 2017, Proceedings 9 (pp. 89-99). Springer International Publishing.2017

A. Haidar, T. Ahajjam, I. Zeroua & Y. Farhaoui. Application of machine learning algorithms for predicting outcomes of accident cases in Moroccan courts. Indonesian Journal of Electrical Engineering and Computer Science, 26(2), 1103-1108, 2022.

X. Shang. A computational intelligence model for legal prediction and decision support. Computational Intelligence and Neuroscience, 2022.

D. L Chen, Machine learning and the rule of law. Revista Forumul Judecatorilor, 19, 2019

J. J Rachlinski, & A.J Wistrich. Judging the judiciary by the numbers: Empirical research on judges. Annu. Rev. Law Soc. Sci, 13, 17-32, 2017

N. Aletras, D. Tsarapatsanis, D. Preotuic-Pietro, and V. Lampos, “Predicting Judicial decisions of the European Court of Human Rights.” Peer Journal of Computer Science, 2, 93-99, 2016

F. Kelbert, F. Shirazi, H. Simo, T. Wüchner, J. Buchmann, A. Pretschner, and M Waidner, “State of online privacy: A technical perspective.” In Internet Privacy (pp. 189-279). 2012 Berlin/Heidelberg: Springer

A. Završnik, “Algorithmic justice: Algorithms and big data in criminal justice settings” European Journal of Criminology Vol. 18(5) pp. 623–642, 2018

R. Simmons, “Big Data, Machine Judges, and the Legitimacy of the Criminal Justice System”. U.C. Davis Law Review, 52(2), pp. 1067-1118, 2018

K. Ashley, “A Brief History of the changing roles of case prediction in AI and Law: Law in context” Socio-Legal Journal, 36(1), 93-112, (2019).

M. Medvedeva, M. Vols, and M. Wieling, “Using Machine Learning to predict decisions of the European Court of Human Rights”. Artificial Intelliegence and Law, 28(2), pp. 237-266, 2020

A. Kaur, & B. Bozic. Convolutional Neural Network-based Automatic Prediction of Judgments of the European Court of Human Rights. In AICS (pp. 458-469), 2019, July.

C. O'Neil, “Weapons of Math Destruction: How Big Data increases inequality and threatens democrac”. Crown, 2016.

I. Chalkidis, I. Androutsopoulos, and N. Aletras, “Neural Legal Judgement Prediction in English”. 57th Annual Meeting of the Association for Computational Linguistics, pp. 4317-4323, 2019.

H. Alla, L. Moumoun, &Y. Balouki. A multilayer perceptron neural network with selective-data training for flight arrival delay prediction. Scientific Programming, 2021, 1-12.

M.B.L. Virtucio, J.A. Aborot, J.K.C Abonita, R.S. Avinante, R.J.B Copino, M. P. Neverida, & G.B.A Tan. Predicting decisions of the philippine supreme court using natural language processing and machine learning. In 2018 IEEE 42nd annual computer software and applications conference (COMPSAC) (Vol. 2, pp. 130-135). IEEE. July 2018.

R.A. Shaikh, T.P. Sahu, and V. Anand, V, “Predicting outcomes of legal cases based on legal factors using classifiers”. Procedia Computer Science, vol.167, pp.2393-2402, 2020

M.F. Sert, E. Yıldırım, & I. Haşlak. Using artificial intelligence to predict decisions of the turkish constitutional court. Social Science Computer Review, 40(6), 1416-1435, 2022

K. Kowsrihawat, P. Vateekul, & P. Boonkwan, predicting judicial decisions of criminal cases from Thai Supreme Court using bi-directional GRU with attention mechanism. In 2018 5th Asian Conference on Defense Technology (ACDT) (pp. 50-55). IEEE. October, 2018.

Z. Liu, & H. Chen. A predictive performance comparison of machine learning models for judicial cases. In 2017 IEEE Symposium series on computational intelligence (SSCI) (pp. 1-6). IEEE.

A. Sharma, A.S. Chudhey & M. Singh. Divorce case prediction using machine learning algorithms. In 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS) (pp. 214-219). IEEE. March, 2021.

H. Zhong, Z. Guo, C. Tu, C. Xiao, Z. Liu, & M. Sun, M. Legal judgment prediction via topological learning. In Proceedings of the 2018 conference on empirical methods in natural language processing (pp. 3540-3549). (2018.

S. Sengupta, & V. Dave, predicting applicable law sections from judicial case reports using legislative text analysis with machine learning. Journal of Computational Social Science, 1-14, 2021

J.S. Howe, L.H. Khang, & L.E. Chai. Legal Area Classification: A Comparative Study of Text Classifiers on Singapore Supreme Court Judgments. arXiv preprint arXiv:1904.06470, 2019.

S. Agrawal, E. Ash, D. Chen, S.S Gill, A. Singh, A; & K. Venkatesan. Affirm or Reverse? Using Machine Learning to Help Judges Write Opinions. In: (2017). [13] S. Bird, E. Klein, and E. Looper.

B. Strickson, & B. De La Iglesia. Legal judgement prediction for uk courts. In Proceedings of the 3rd International Conference on Information Science and Systems (pp. 204-209). March, 2020.

N. Sivaranjani, J. Jayabharathy, & P.C Teja, Predicting the supreme court decision on appeal cases using hierarchical convolutional neural network. International Journal of Speech Technology, 24(3), 643-650,

C. Chu, A. L Hsu, K.H. Chou, P. Bandettini, C. Lin, & Alzheimer's Disease Neuroimaging InitiativeDoes feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images. Neuroimage, 60(1), 59-70, 2012

M. Afshar, & H. Usefi. Optimizing feature selection methods by removing irrelevant features using sparse least squares. Expert Systems with Applications, 200, 116928, 2022

Ali, R. (2020). Predictive Modeling: Types, Benefits, and Algorithms. Retrieved from Oracle Netsuite: https://www. netsuite. com/portal/resource/articles/financial-management/predictive-modeling. shtml.

R.R. Quinlan, “Induction of Decision Trees”. Machine Learning 1: 81 – 106, 1996.

L. Yu, and H. Liu, “Efficient feature selection via analysis of relevance and redundancy”. JMLR 5: pp. 1205 –1224, 2004.

A. Lage-Freitas, H. Allende-Cid, O. Santana, and O. Lıvia, “Predicting Brazilian court decisions” Found at: https://arxiv.org/abs/1905.10348

L. Kostrzewa, & R, Nowak. Polish Court Ruling Classification Using Deep Neural Networks. Sensors, 22(6), 2137, 2022

Downloads

Published

2023-11-12

How to Cite

Ayankoya, F., Ngige, O., Onuiri, E., Adigun, T., & Omotunde, E. (2023). Multi-Layer Perceptron Algorithm, an Effective tool for the Prediction of the Judgments of the Supreme Court of Nigeria. Transactions on Engineering and Computing Sciences, 11(6), 1–18. https://doi.org/10.14738/tecs.116.15858