A Thematic Analysis on Large Language Models: Hallucination, Trust, and Governance Challenges in AI Systems
DOI:
https://doi.org/10.14738/assrj.1305.2402Keywords:
large language models, thematic analysis, AI governance, trustworthiness, hallucination detectionAbstract
Large language models (LLMs) are becoming increasingly popular and powerful in terms of applications. They can be used for text and image generation, multimodal models, and reasoning. Despite the numerous potential uses, there is a significant problem with hallucinations and the generation of false, misleading, or inaccurate information by the models. This paper conducts a thematic analysis of topics such as hallucination types, mitigations, and the effects on multilingual models. There is also an analysis of attempts to regulate the power of models. The solutions to the problem of hallucinations vary from purely technological solutions to an interdisciplinary approach, identifying both potential benefits and future risks. The sources analyzed are around 320 references, including preprint papers from the fastest-growing field of AI. This paper focuses on equipping the reader with a basic conceptual understanding of the field and directions for future research, to establish knowledge and build trustworthy AI systems.
References
Abdelrahman, M. (2024). Hallucination in low-resource languages: Amplified risks and mitigation strategies for multilingual LLMs. Journal of Applied Big Data Analytics, Decision-Making, and Predictive Modelling Systems, 8(12), 17–24.
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024). Trust in AI: Progress, challenges, and future directions. Humanities and Social Sciences Communications, 11(1568).
Al-kfairy, M. (2025). Strategic integration of generative AI in organizational settings: Applications, challenges and adoption requirements. IEEE Engineering Management Review, 1–14.
Al-Kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., & Alfandi, O. (2024). Ethical challenges and solutions of generative AI: An interdisciplinary perspective. Informatics, 11, 58. Multidisciplinary Digital Publishing Institute.
Alsadie, D. (2024). A comprehensive review of AI techniques for resource management in fog computing: Trends, challenges, and future directions. IEEE Access, 12, 118007–118059.
Amidi, A., & Amidi, S. (2017). Deep learning cheatsheet. Stanford University. Retrieved from https://stanford.edu/~shervine/teaching/cs-230/cheatsheet-deep-learning-tips-and-tricks
Anonymous. (2025). Agreeing to disagree: Human-AI collaboration in ethical decision-making. SSRN Electronic Journal. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5262517
Anonymous. (2025). Where is morality on wheels? Decoding large language model (LLM) ethical decision-making in autonomous vehicles. Transportation Research Interdisciplinary Perspectives. https://www.sciencedirect.com/science/article/abs/pii/S2214367X25000572
Anthropic Research Team. (2025, June). Agentic misalignment: How LLMs could be insider threats. Anthropic Research. https://www.anthropic.com/research/agentic-misalignment
Anthropic. (2025, May). Introducing Claude 4. Anthropic News. https://www.anthropic.com/news/claude-4
Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2021). AI explainability 360 toolkit. In Proceedings of the 3rd ACM India Joint International Conference on Data Science & Management of Data (8th ACM IKDD CODS & 26th COMAD) (pp. 376–379).
Bai, B., Liang, J., Zhang, G., Li, H., Bai, K., & Wang, F. (2021). Why attentions may not be interpretable? In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining.
Betker, J.; Goh, G.; Jing, L.; Brooks, T.; Wang, J.; Li, L.; Ouyang, L.; Zhuang, J.; Lee, J.; Guo, Y.; et al. Improving Image Generation with Better Captions. Available online: https://api.semanticscholar.org/CorpusID:264403242 (accessed on 19 April 2024). Page | 46
Scholar Publishing Brock, D. C., & Grad, B. (2022). Expert systems: Commercializing artificial intelligence. IEEE Annals of the History of Computing, 44, 5–7. https://doi.org/10.1109/mahc.2022.3149612
Brock, D. C., & Grad, B. (2022). Expert systems: Commercializing artificial intelligence. IEEE Annals of the History of Computing, 44, 5–7. https://doi.org/10.1109/mahc.2022.3149612
Cass, S. (2016). What would Marvin Minsky read? Key works from the AI Titan’s favorite authors. IEEE Spectrum, 53, 22. https://doi.org/10.1109/MSPEC.2016.7439586
Chaudhari, S., Aggarwal, P., Murahari, V., Rajpurohit, T., Kalyan, A., Narasimhan, K., Deshpande, A., & Castro da Silva, B. (2024). RLHF deciphered: A critical analysis of reinforcement learning from human feedback for LLMs. ACM Computing Surveys, 58(2), 1–37.
Chen, J., Wang, L., Zhang, Y., & Liu, X. (2024). Towards a better understanding of evaluating trustworthiness in AI systems. ACM Computing Surveys, 57(3), 1–42. https://dl.acm.org/doi/abs/10.1145/3721976
Chopra, S., Hadsell, R., & LeCun, Y. (2005). Learning a similarity metric discriminatively, with application to face verification. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) (Vol. 1, pp. 539–546). IEEE.
Christiano, P. F., Leike, J., Brown, T., Martic, M., Legg, S., & Amodei, D. (2017). Deep reinforcement learning from human preferences. Advances in Neural Information Processing Systems, 30.
Constitutional AI Project. (2025). Constitutional AI: Tracking Anthropic’s revolutionary framework. Constitutional AI Website. Retrieved from https://constitutional.ai/
Databricks Inc. (2025). Databricks AI Governance Framework (DAGF): A comprehensive approach to responsible AI. Technical Report. Databricks, San Francisco, CA. Retrieved from https://www.databricks.com/ai-governance-framework
Dias, M., & Silva Junior, D. S., Oliveira, A.R. (2026a). Innovation at the Core of Competitive Advantage: A Thematic Exploration of Emerging Organizational Pathways. Veredas do Direito,23(6), e235771. https://doi.org/10.18623/rvd.v23.5771
Dias, M., & Silva Junior, D. S., Oliveira, A.R. (2026b). Paradigms and Frontiers in Entrepreneurship: A Systematic Literature Review. The International Journal of Business Management and Technology, 10(4), 1-17; https://doi.org/10.5281/zenodo.19438545
Dokumacı, M. (2024). Legal frameworks for AI regulations. Human Computer Interaction. https://doi.org/10.62802/ytst2927
European Parliament and Council of the European Union. (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Retrieved from https://eurlex.europa.eu/eli/reg/2024/1689/oj
Page | 47 Scholar Publishing Fan, Y., Li, R., Zhang, G., Shi, C., & Wang, X. (2025). A weighted cross-entropy loss for mitigating LLM hallucinations in cross-lingual continual pretraining. In ICASSP 2025 – IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 1–5). IEEE.
Farquhar, S., Kossen, J., Kuhn, L., & Gal, Y. (2024). Detecting hallucinations in large language models using semantic entropy. Nature, 630(8017), 625–630.
Faust, O., et al. (2018). Deep learning for healthcare applications based on physiological signals: A review. Nature Scientific Reports, 8(1), 1–13.
Fish, W. (2009). Perception, hallucination, and illusion. Oxford University Press.
Galitsky, B. A., & Rybalov, A. (2025). An information-theoretic model of abduction for detecting hallucinations in explanations. Manuscrito não publicado.
Ganhor, C., Penz, D., Rekabsaz, N., Lesota, O., & Schedl, M. (2022). Unlearning protected user attributes in recommendations with adversarial training. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. https://doi.org/10.1145/3477495.3531820
Gantla, S. R. (2025). Exploring mechanistic interpretability in large language models: Challenges, approaches, and insights. In 2025 International Conference on Data Science and Engineering. Retrieved from https://ieeexplore.ieee.org/abstract/document/11011640/Guha, N., Lawrence, C. M., Gailmard, L. A., Rodolfa, K. T., Saremi, F., Beaumavant, R., Deborah,
I., Raj, M., Covellan, F., Hemingberg, C., et al. (2024). AI regulation has its own alignment problem: The technical and institutional feasibility of disclosure, registration, licensing, and auditing. George Washington Law Review, 92(5), 1473.
Guha, N., Lawrence, C. M., Gailmard, L. A., Rodolfa, K. T., Saremi, F., Beaumavant, R., Deborah, I., Raj, M., Covellan, F., Hemingberg, C., et al. (2024). AI regulation has its own alignment problem: The technical and institutional feasibility of disclosure, registration, licensing, and auditing. George Washington Law Review, 92(5), 1473.
Guu, K., Lee, K., Tung, Z., Pasupat, P., & Chang, M. (2020). Retrieval augmented language model pre-training. In International Conference on Machine Learning (pp. 3929–3938). PMLR.
Hahn, M. (2020). Theoretical limitations of self-attention in neural sequence models. Transactions of the Association for Computational Linguistics, 8, 156–171. https://direct.mit.edu/tacl/articleabstract/doi/10.1162/tacl_a_00306/43545
Henderson, P., Hashimoto, T., & Lemley, M. A. (2023). Where’s the liability in harmful AI speech? Journal of Free Speech Law, 3, 535–594.
HM Courts & Tribunals Service & Ministry of Justice. (2025). AI Action Plan for Justice: Transforming the justice system through artificial intelligence. Technical Report. Ministry of Justice, United Kingdom. Retrieved from https://www.gov.uk/government/publications/ai-action-plan-justice
Hochreiter, S.; Schmidhuber, J. Long Short-Term Memory. Neural Comput. 1997, 9, 1735–1780. Page | 48
Scholar Publishing Infocomm Media Development Authority & Personal Data Protection Commission. (2025). AI Verify: Singapore’s framework for AI governance and testing. Technical Report. Government of Singapore. Retrieved from https://www.aiverify.sg/International Organization for Standardization & International Electrotechnical Commission. (2023). ISO/IEC 42001:2023 Information technology—Artificial intelligence—Management system. Retrieved from https://www.iso.org/standard/81230.html
International Organization for Standardization & International Electrotechnical Commission. (2023). ISO/IEC 42001:2023 Information technology—Artificial intelligence—Management system. Retrieved from https://www.iso.org/standard/81230.html
Jacob, C., Brasier, N., Laurenzi, E., Heuss, S., Mougiakakou, S.-G., Cöltekin, A., & Peter, M. K. (2025). AI for IMPACTS framework for evaluating the long-term real-world impacts of AI-powered clinician tools: Systematic review and narrative synthesis. Journal of Medical Internet Research, 27, e67485.
Jain, S., & Wallace, B. C. (2019). Attention is not explanation. In Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
Javed, H., El-Sappagh, S., & Abuhmed, T. (2024). Robustness in deep learning models for medical diagnostics: Security and adversarial challenges towards robust AI applications. Artificial Intelligence Review, 57(11), 1–55.
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), 1–38. https://doi.org/10.1145/3571730
Kamoi, R., Zhang, Y., Zhang, N., Han, J., & Zhang, R. (2024). When can LLMs actually correct their own mistakes? A critical survey of self-correction of LLMs. Transactions of the Association for Computational Linguistics, 12, 1417–1440.
Kim, I.; Han, G.; Ham, J.; Baek, W. KoGPT: KakaoBrain Korean(hangul) Generative Pre-Trained Transformer. 2021. Available online: https://github.com/kakaobrain/kogpt (accessed on 19 April 2024).
Kim, M., Jung, H., & Koo, M.-W. (2024). Self-expertise: Knowledge-based instruction dataset augmentation for a legal expert language model. In Findings of the Association for Computational Linguistics: NAACL 2024 (pp. 1098–1112). ACL.
Li, J., Li, G., Li, Y., & Jin, Z. (2025). Structured chain-of-thought prompting for code generation. ACM Transactions on Software Engineering and Methodology, 34(2), 1–23.
Liu, Z. (2024). Cultural bias in large language models: A comprehensive analysis and mitigation strategies. Journal of Transcultural Communication, 3(2), 224–244.
Lopes, R. & Dias, M. (2026a) Boards of Directors and Corporate Governance Outcomes: A Literature Review. Advances in Social Sciences Research Journal, 13(04), 46–66. https://doi.org/10.14738/assrj.1304.20194
Lopes, R. & Dias, M. (2026b) Mapping the Themes of Gender Diversity in Boards: A Thematic Analysis. Veredas Do Direito, 23(5), e235738. https://doi.org/10.18623/rvd.v23.5738 Page | 49
Scholar Publishing Lund, B., Orhan, Z., Mannuru, N. R., Bevara, R. V. K., Porter, B., Vinaih, M. K., & Bhaskara, P. (2025). Standards, frameworks, and legislation for artificial intelligence (AI) transparency. AI and Ethics, 5, 3639–3655. https://link.springer.com/article/10.1007/s43681-025-00661-4
Maharaj, K., Saxena, A., Kumar, R., Mishra, A., & Bhattacharyya, P. (2023). Eyes show the way: Modelling gaze behaviour for hallucination detection. In Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 11424–11438). ACL. [Online]. Available: https://aclanthology.org/2023.findings-emnlp.764/
Malin, B., Kalganova, T., & Boulgouris, N. (2025). A review of faithfulness metrics for hallucination assessment in large language models. IEEE Journal of Selected Topics in Signal Processing. https://doi.org/10.1109/JSTSP.2025.XXXXXXX
Manheim, D., Martin, S., Bailey, M., Samin, M., & Greutzmacher, R. (2025). The necessity of AI audit standards boards. AI & Society. https://link.springer.com/article/10.1007/s00146-025-02320-y
McCarthy, J., Minsky, M., Rochester, N., & Shannon, C. (2006). A proposal for the Dartmouth summer research project on artificial intelligence, August 31, 1955. AI Magazine, 27, 12–14. https://doi.org/10.1609/aimag.v27i4.1904
McDonald, D., Papadopoulos, R., & Benningfield, L. (2025). Reducing LLM hallucination using knowledge distillation: A case study with Mistral Large and MMLU benchmark. Authorea Preprints.
Mohammed, M. Y., Ali, S. A., Ali, S. K., Majeed, A. A., & Mohamed, E. H. (2025). AFTINA: Enhancing stability and preventing hallucination in AI-based Islamic fatwa generation using LLMs and RAG. Neural Computing and Applications, 1–26.
Mortaji, S. T. H., & Sadeghi, M. E. (2024). Assessing the reliability of artificial intelligence systems: Challenges, metrics, and future directions. International Journal of Innovation in Management, Economics and Social Sciences, 4(4), 1–15.
Naik, N., Hameed, B., Shetty, D., Swain, D., Shah, M., Paul, R., Aggarwal, K., Ibrahim, S., Patil, V., Smriti, K., Shetty, S., Rai, B. P., Chlosta, P., & Somani, B. (2022). Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility? Frontiers in Surgery, 9. https://doi.org/10.3389/fsurg.2022.862322
Nannini, L., Balayn, A., & Smith, A. L. (2023). Explainability in AI policies: A critical review of communications, reports, regulations, and standards in the EU, US, and UK. ACM Conference on Fairness, Accountability, and Transparency, 1198–1212.
National Institute of Standards and Technology. (2024). AI Risk Management Framework (AI RMF 1.0): Generative AI Profile. Technical Report NIST AI 600-1. U.S. Department of Commerce. Retrieved from https://www.nist.gov/itl/ai-risk-management-framework
NVIDIA Corporation. (2017). Deep learning: An introductory guide. Retrieved from https://research.nvidia.com/publication/2017-06_Deep-Learning-Introductory-Guide
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744.
Pan, Y., Kong, L., Wu, J., Yang, Y., Zuo, H., Xiu, Z., & Wang, X. (2025). Towards reliable large language models: A survey on hallucination detection. In International Conference on Intelligent Computing (pp. 438–451). Springer.
Quintão, H., Dias, M., da Mata, R. & da Silva Jr., D. (2026). Artificial Intelligence In Alternative Dispute Resolution: A Literature Review on Guidelines, Best Practices, and The Role Of Engineering Experts In Complex Construction Contracts. International Journal of Advance Research, 14(3), 821-830, https://doi.org/10.5281/zenodo.19161386
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 9.
Page | 50 Scholar Publishing Radford, A.; Narasimhan, K. Improving Language Understanding by Generative Pre-Training. 2018. Available online: https://api.semanticscholar.org/CorpusID:49313245 (accessed on 29 March 2024).
Radford, A.; Wu, J.; Child, R.; Luan, D.; Amodei, D.; Sutskever, I. Language Models are Unsupervised Multitask Learners. OpenAI Blog 2019, 1, 9.
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140), 1–67.
Raiaan, M.A.K.; Mukta, M.S.H.; Fatema, K.; Fahad, N.M.; Sakib, S.; Mim, M.M.J.; Ahmad, J.; Ali, M.E.; Azam, S. A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access 2024, 12, 26839–26874.
Saunders, M., Lewis, P., & Thornhill, A. (2009). Research methods for business students (5th ed.). Harlow: Pearson Education.
Shah, A., Banner, N., Heginbotham, C., & Fulford, B. (2014). Substance use and older people. Substance Use and Older People, 21(5), 9.
Shinn, N., Cassano, F., Gopinath, A., Narasimhan, K., & Yao, S. (2024). Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems, 36.
Sinclair, S., & Rockwell, G. (2026). Voyant Tools (Version 2.6.19) [Text analysis software]. Voyant Consortium. https://voyant-tools.org
Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Thousand Oaks, CA: Sage.
Sultan, M. A., Ganhotra, J., & Astudillo, R. F. (2024). Structured chain-of-thought prompting for few-shot generation of content-grounded QA conversations. In Findings of the Association for Computational Linguistics: EMNLP 2024 (pp. 16172–16187). ACL.
Taori, R.; Gulrajani, I.; Zhang, T.; Dubois, Y.; Li, X.; Guestrin, C.; Liang, P.; Hashimoto, T.B. Stanford Alpaca: An Instruction-Following LLaMA Model. 2023. Available online: https://github.com/tatsu-lab/stanford_alpaca (accessed on 29 March 2024).
Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538
Xu, T., Wu, S., Diao, S., Liu, X., Wang, X., Chen, Y., & Gao, J. (2024). Retrieval and reasoning on KGs: Integrate knowledge graphs into large language models for complex question answering. In Findings of the Association for Computational Linguistics: EMNLP 2024 (pp. 7598–7610). ACL.
Yang, D., Yuan, R., Fan, Y., Yang, Y., Wang, Z., Wang, S., & Zhao, H. (2023). RefGPT: Dialogue generation of GPT, by GPT, and for GPT. In Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 2511–2535). ACL.
Yuan, S.; Zhao, H.; Du, Z.; Ding, M.; Liu, X.; Cen, Y.; Zou, X.; Yang, Z.; Tang, J. WuDaoCorpora: A super large-scale Chinese corpora for pre-training language models. AI Open 2021, 2, 65–68.
Zhang, H., Liu, X., & Zhang, J. (2023). Summit: Iterative text summarization via ChatGPT. In Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 10644–10657). ACL.
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., ... & Wu, F. (2026). Instruction tuning for large language models: A survey. ACM Computing Surveys, 58(7), 1-36.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Advances in Social Sciences Research Journal
This work is licensed under a Creative Commons Attribution 4.0 International License.
