Identification of Misclassified Medicaid Audits
DOI:
https://doi.org/10.14738/abr.1306.18994Keywords:
Imbalanced data, noise filters, anomaly detection, forensic analysis, label noiseAbstract
Medicaid auditors typically use statistically valid samples from the total claims filed by service providers to detect overpayments or underpayments. These samples often contain many "zeros" (compliant claims) and a few "ones" (flagged issues), but errors in the auditing process can occur due to human mistakes, biases, or even AI and machine learning errors. Such mistakes may lead to false-positive results where a claim is wrongly flagged as an overpayment. Is it possible to identify and isolate false positives in defending impugned claims filed by Medicaid providers without the need for expensive forensic audits of the entire sample? To address this, we test the effectiveness of noise-filtering algorithms to isolate false-positive claims from legitimate ones. By artificially injecting noise (representing false positives) into synthetically generated data we create a realistic litigation environment resembling what happens during subpoenas or document requests. We then apply three noise-filtering algorithms and find that these filters reduce the audit data to a smaller, more focused sample, making it easier to identify false positives during any subsequent manual review. Our study does not propose a novel noise-filtering method; rather, we demonstrate how existing techniques can help forensic analysts concentrate false-positive claims in a reduced sample. While the specific focus is on Medicaid audits, the findings are applicable to any situation where audits are conducted on claims filed by service providers and paid by third parties.
References
Aggarwal, C. C. (2014). Data Classification. In C. C. Aggarwal, Instance-based Learning: A Survey, Data Classification: Algorithms and Applications. Chapman and Hall/CRC Press.
Akash, S., Amalan, R., Kumar, C. B., & Ram, O. B. (2021, April). Detecting and Characterizing Reviewer Groups in Online Product Reviews. International Research Journal of Engineering and Technology, 8(4), 835-839.
Argentieri, N. M. (2024, July Monday). Combating Health Care Fraud: 2024 National Enforcement Action. Blog Post. U.S. Department of Justice. From https://www.justice.gov/archives/opa/blog/combating-health-carefraud-2024-national-enforcement-action
Bekkum, M. v. (2025, February 16). Using sensitive data to de-bias AI systems: Article 10(5) of the EU AI act. Computer Law & Security Review, 56. doi:https://doi.org/10.1016/j.clsr.2025.106115
Blachnik, M. (2017). Instance Selection for Classifier Performance Estimation in Meta Learning. Entropy, 19. doi:doi:10.3390/e19110583
Bouveyron, C., & Girard, S. (2009, February 12). Robust supervised classification with mixture models: Learning from data with uncertain labels. Pattern Recognition, 2649-2658. From https://hal.science/hal-00325263/file/RR_RMDA.pdf
Breunig, M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000). LOF: Identifying Density-Based Local Outliers. Proceedings of the 2000 ACM SIGMOD international conference on Management of data, 93-104. doi:https://doi.org/10.1145/342009.335388
Brody, R. G., DeZoort, F. T., Gupta, G., & Hood, M. B. (2022). The Effects of Cognitive Bias on Fraud Examiner Judgments and Decisions. Journal of Forensic Accounting Research, 7(1), 50-63. doi:https://doi.org/10.2308/JFAR-2020-030
Diakopolous, N. (2016, February). Accountability in Algorithmic Decision Making. Communications of the ACM, 59(2). doi:http://dx.doi.org/10.1145/2844110
Emanual, K. C. (2025, February 5). AI Poised to Take the Reins for Medicare Audits. From RACmonitor: https://racmonitor.medlearn.com/ai-poised-to-take-the-reins-for-medicare-audits/Frenay, B., & Verleysen, M. (2014, May). Classification in the Presence of Label Noise: A Survey. IEEE Transactions on Neural Networks and Learning Systems, 25(5), 845-869. doi:doi.org/10.1109/TNNLS.2013.2292894
Harvin, O., & Killey, M. (2021). Do "Superstar" CEOs Impair Auditors' Judgement and Reduce Fraud Detection Opportunities? Journal of Forensic and Investigative Accounting, 13(3). From http://s3.amazonaws.com/web.nacva.com/JFIA/Issues/JFIA-2021-No3-7.pdf
Ioannidis, J. P. (2021). Over- and under-estimation of COVID019 deaths. European Journal of Epidemiology, 36(6), 581-588. doi:https://doi.org/10.1007%2Fs10654-021-00787-9
Kvanli, A., & Schauer, R. (2018). Handbook for HealthCare Auditors. Alan Kvanli.
Morales, P., Luengo, J., Garcia , L. P., Lorena, A. C., de Carvalho, A. C., & Herrera, F. (2017, June). The NoiseFiltersR Package: Label Noise Preproscessing in R. The R Journal, 9(1), 219-228.
National Association of Attorneys General. (2025, May 5). About the Medicaid Fraud Control Units. From National Association of Attorneys General: https://www.naag.org/about-naag/namfcu/about-the-medicaid-fraudcontrol-units/
Nigrini, M. J. (2020). Forensic Analytics. New York: John Wiley & Sons Inc.
Northcutt, C. G., Athalye, A., & Mueller, J. (2019, November 7). Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks. arXiv: 2103.14749. From https://arxiv.org/pdf/2103.14749
Office of the Inspector General, Health and Human Services. (2018). Statistical Sampling: A Toolkit for MFCUs. From https://oig.hhs.gov/fraud/medicaid-fraud-control-units-mfcu/files/MFCU-Sampling-Guidance.pdf
Pau, S., Perniciano, A., Pes, B., & Rubattu, D. (2023). An Evaluation of Feature Selection Robustness on Class Noisy Data. Information, 14. doi:doi.org/10.3390/info14080438
Rodriguez, A. E., & Kucsma, K. (2023). Appraising Audit Error in Medicaid Audits. International Journal of Accounting and Financial Reporting, 13(3), 2162-3082. doi:https://doi.org/10.5296/ijafr.v13i3
Rodriguez, A. E., Duman, G. M., & Kuntze, R. (2025, May). Two General Data Protection Regulation (GDPR) Compliant Approaches to Scoring Firm Financial Frailty in Business Litigation. American Business Review, 28(1), 1-14. doi:10.37625/abr.27.2.372-400
Saez, J. A. (2022, 10). Noise Models in Classification: Unified Nomenclature, Extended Taxonomy and Pragmatic Categorization. Mathematics, 10. doi:https://doi.org/10.3390/math10203736
Saez, J. A., Luengo, J., & Herrera, F. (2012, July 23). Predicting Noise Filtering Efficacy with Data Complexity Measures for Nearest Neigbor Classification. Pattern Recognition. doi:http://dx.doi.org/10.1016/j.patcog.2012.07.009
Saez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2014). SMOTE–IPF: Addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filtering. Information Sciences, 184-203. doi:http://dx.doi.org/10.1016/j.ins.2014.08.051
Schennach, S. M. (2016). Recent Advances in the Measurement Error Litarature. Annual Review of Economics, 8, 341-377. doi:10.1146/annurev-economics-080315-015058
Szeghalmy, S., & Fazekas, A. (2024, October). A Comparative Study on Noise Filtering of Imbalanced Data Sets. Knowledged-Based Systems, 1-17. doi:doi.org/10.1016/j.knosys.2024.112236
Torgo, L. (2011). Data Mining with R. Boca Raton, FL: Chapman & Hall/CRC.
US Dept of Health & Human Services. (2025, May 5). Summary of the HIPAA Privacy Rule. From US Dept. of Health and Human Services: https://www.hhs.gov/hipaa/for-professionals/privacy/lawsregulations/index.html#:~:text=The%20Health%20Insurance%20Portability%20and%20Accountability%20Act%20of%201996%20(HIPAA,was%20published%20December%2028%2C%202000.
Van Hulse, J., Khoshgoftaar, T. M., & Napolitano, A. (2011). An Exploration of Learning When Data is Noisy. Intelligent Data Analysis, 215-236. doi:doi.org/10.3233/IDA-2010-0464
Villuendas-Rey, Y., Tusell-Rey, C. C., & Camacho-Rey, O. (2024, September 19). Simultaneous Instance and Attribute Selection for Noise Filtering. Applied Sciences. doi:https://doi.org/10.3390/app14188459
Walauskis, M. A., & Khoshgoftaar, T. M. (2025). Unsupervised Label Generation for Severely Imbalanced Fraud Data. Journal of Big Data, 12(63), 1-23.
Zimiles, E., & Fontecilla, R. (2023, June 9). AI and machine learning – an intelligent approach to healthcare fraud prevention. Retrieved May 5, 2025 from healthcare financial management association: https://www.hfma.org/cost-effectiveness-of-health/ai-and-machine-learning-an-intelligent-approach-tohealthcare-fraud-prevention/
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 A. E. Rodriguez, M. F. Ahmed

This work is licensed under a Creative Commons Attribution 4.0 International License.