Judicial Artificial Intelligence Bias: A Survey and Recommendations
DOI:
https://doi.org/10.14738/tmlai.92.10118Keywords:
Judiciary, Artificial Intelligence, Artificial Intelligence Bias, algorithm and Survey.Abstract
Artificial intelligence (AI) has continued to disrupt the way tasks are being carried out, finding its way into almost all facets of human existence, and advancing the development of human society. The AI revolution has made huge and significant inroad into diverse industries like health, energy, transport, retail, advertising, et cetera. AI has been found to assist in carrying out tasks more quickly and efficiently too. Tasks which were hitherto difficult have been simplified significantly through the use of AI. Slow adoption in judiciary has however been reported, compared to other sectors. A lot of factors have been attributed to this, with AI bias being an issue of concern. Decisions emanating from courts have a significant impact on an individual’s private and professional life. It is thus imperative to identify and deal with bias in any judicial AI system in order to avoid delivering a prejudiced and inaccurate decision, thereby possibly intensifying the existing disparities in the society. This paper therefore surveys judicial artificial intelligence bias, paying close attention to types and sources of AI bias in judiciary. The paper also studies the trust-worthy AI, the qualities of a trust-worthy artificial intelligence system and the expectations of users as it is being deployed to the judiciary, and concludes with recommendations in order to mitigate the AI bias in Judiciary.
References
Adadi, A., & Berrada, M. (2018). Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access, 6 , 52138–52160.
Amini, A; Soleimany, A; Schwarting, W; Bhatia, S& Rus, D (2019). Uncovering and Mitigating Algorithmic Bias through Learned Latent Structure. In Proceedings of the 2019 AAAI/ ACM Conference on Artificial Intelligence, Ethics, and Society (AIES), 27-28 January, 2019, Honolulu, Hawaii, United States, AAAI/ACM, 2019. Angileri, J; Brown, M; DiPalma, J; Ma, Z & Dancy, C () Ethical considerations of facial classification: Reducing racial bias in AI. https://www.researchgate.net/profile/John-Angileri/publication/338225415_Ethical_Considerations_of_Facial_Classification_Reducing_Racial_Bias_in_AI/links/5e0916c6299bf10bc382bb88/Ethical-Considerations-of-Facial-Classification-Reducing-Racial-Bias-in-AI.pdf.
Aysolmaz, B; Dau, N & Iren, D (2020) Preventing Algorithmic bias in the development of algorithmic decisionrd making systems: A Delphi study. In proceedings of the 53 Hawaii International Conference on System Sciences 2020S
Bagaric, M; Hunter, D; & Stobbs, N (2020) Erasing the Bias Against Using Artificial Intelligence to Predict Future Criminality: Algorithms are Color Blind and Never Tire, 88 U. Cin. L. Rev. 1037 (2020) Available at: https://scholarship.law.uc.edu/uclr/vol88/iss4/3
Bellamy, R.K; Dey, K; Hind, M; Hoffman,S.C; Houde, S; Kannan, K; Lohia, P; Martino, J; Mehta, S; Mojsilovic, A; Nagar, S; Ramamurthy, K.N; Richards, J; Saha, D; Sattigeri, Singh, M; Varshney, K.R & Zhang, Y (2018). AI Fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias. arXiv:1810.01943v1 [cs.AI] 3 Oct 2018
Bolukbasi, T; Chang, K; Zou, J; SAligrama, V & Kalai, A (2016) Man is to Computer program as woman is to homemaker? Debiasing word embeddings. arXiv:1607.06520v1 [cs.CL] 21 Jul 2016
DeBrusk, C (2018) The risk of machine learning bias and how to prevent it. Risk Journal/ Rethinking Tactics 2018. https://www.oliverwyman.com/content/dam/oliver-wyman/v2/publications/2018/november/Risks-ofmachine-learning.pdf
Erdelyi, O.J and Goldsmith,J (2020) Regulating artificial intelligence proposal for a global solution. https://arxiv.org/pdf/2005.11072.pdf.
Ferrer , X; Nuenen, T; Such, J.M; Cot´e, M &Criado, N (2020) Bias and Discrimination in AI: a cross-disciplinary perspective. arXiv:2008.07309 [cs.CY]
Gavoor, A and Teperdjian, R. A Structural Solution to Mitigating Artificial Intelligence Bias in Administrative Agencies (January 18, 2021). 89 George Washington Law Review Arguendo (2021 Forthcoming), Available at SSRN: https://ssrn.com/abstract=3768214 or http://dx.doi.org/10.2139/ssrn.3768214.
Genway, S (2021) Three causes of AI bias and how to deal with them. Tessella Altrain Group. https://www.tessella.com/insights/three-causes-of-ai-bias-and-how-to-deal-with-them
Greene, T; Shmueli, G;Fell, J; Lin, C; Shope, M.L & Liu, H (2020). The Hidden Inconsistencies Introduced by Predictive Algorithms in Judicial Decision Making. https://arxiv.org/ftp/arxiv/papers/2012/2012.00289.pdf.
Guihot, M; Mathew, A.F & Suzor, N.P (2017) Nudging Robots: Innovative Solutions to Regulate Artificial Intelligence. Vanderbilt Journal of Entertainment and Technology Law, 20(2), pp. 385-456.
Hammond, K (2016) unexpected sources of bias in artificial intelligence. https://techcrunch.com/2016/12/10/5-unexpected-sources-of-bias-in-artificial-intelligence/
Lee, N.T; Resnick, P &Barton, G (2019) Algorithmic bias detection and mitigation: Best practices and policies to reduce consumer harms. https://www.brookings.edu/research/algorithmic-bias-detection-and-mitigation-bestpractices-and-policies-to-reduce-consumer-harms/
Lee, N.T; Resnick, P &Barton, G (2019). Algorithmic bias detection and mitigation: best practices and consumer policies to reduce consumer harms. https://www.brookings.edu/research/algorithmic-bias-detection-andmitigation-best-practices-and-policies-to-reduce-consumer-harms/
Liang, L & Acuna, D.E (2019) Artificial mental phenomena: Psychophysics as a framework to detect perception biases in AI models. . ArXiv: 1912.10818v1 [cs.CL] 15 Dec 2019
Lloyd, K & Hamilton,B.O () Bias Amplification in Artificial Intelligence. https://arxiv.org/ftp/arxiv/papers/1809/1809.07842.pdf.
Mehrabi, N; Morstatter, F; Saxena,N; Lerman, K & Galstyan, A (2019). A Survey on Bias and Fairness in Machine Learning. arXiv:1908.09635v2 [cs.LG] 17 Sep 2019
Pasquale, F (2019) Data –informed duties in AI development. Columbia Law Review. Vol 119-m1917. https://digitalcommons.law.umaryland.edu/cgi/viewcontent.cgi?article=2629&context=fac_pubs.
Pena, A; Serna, I; Morales, A and Fierrez, J (2020) Bias in Multimodal AI: Testbed for Fair Automatic Recruitment. https://openaccess.thecvf.com/content_CVPRW_2020/papers/w1/Pena_Bias_in_Multimodal_AI_Testbed_for_Fair_Automatic_Recruitment_CVPRW_2020_paper.pdf.
Pratt, M (2019). Machine Learning bias (AI bias) https://searchenterpriseai.techtarget.com/definition/machinelearning-bias-algorithm-bias-or-AI-bias
Salmanowitz, N (2016) Unconventional Methods for a Traditional Setting: The Use of Virtual Reality to Reduce Implicit Racial Bias in the Courtroom, the University of New Hampshire Law Review, Volume 15, Article 2, November, 2016.
Schlesinger, A., O'Hara, K. P., & Taylor, A. S. (2018, April). Let's Talk About Race: Identity, Chatbots, and AI. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (p. 315). ACM.
Sharma, A (2020) Bias in AI-Enabled Chatbots: Implications, causes and solutions. https://anukritisharma.com/blog/2020/3/24/bias-in-ai-enabled-chatbots-implications-causes-and-solutions
Silberg, J & Manyika, J (2019) Notes from the AI frontier: Tackling bias in AI (and in humans). Mckinsey Global Institute. https://www.mckinsey.com/~/media/McKinsey/Featured%20Insights/Artificial%20Intelligence/Tackling%20bias%20in%20artificial%20intelligence%20and%20in%20humans/MGI-Tackling-bias-in-AI-June-2019.pdf
Sperrle, F & Keim, M.D () Human trust modeling for bias mitigation in artificial intelligence. http://kops.unikonstanz.de/bitstream/handle/123456789/45547/Sperrle_2-1dk03mfjgsyvb7.pdf?sequence=1&isAllowed=y Thiebes, S; Lins, S &Sunyaev, A (2020) Trustworthy artificial intelligence. Electronic Markets, Springer https://doi.org/10.1007/s12525-020-00441-4
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Ogochukwu Constance Ngige, Oludele Awodele, Oluwatobi Balogun

This work is licensed under a Creative Commons Attribution 4.0 International License.