AttentiveBugLocator: A Bug Localization Model using Attention-based Semantic Features and Information Retrieval
DOI:
https://doi.org/10.14738/tecs.122.16373Keywords:
Bug report, Bug Localization, Deep learning, Software Maintenance, Bug tracking systemsAbstract
In recent years, deep learning-based algorithms such as CNN, LSTM, and auto-encoders have been proposed to rank suspicious buggy files. Meanwhile, representational learning has served to be the best ap-proach to extract rich semantic features of bug reports and source code to reduce their lexical mismatch. In this paper, we propose AttentiveBu-gLocator, a Siamese-based representational learning model for improved bug localization performance. AttentiveBugLocator employs BERT and code2vec embedding models to produce richer semantic representations and a Siamese BiLSTM network with context attention to learn semantic matching between BRs and SFs. To further improve the effectiveness of AttentiveBugLocator, the semantic matching features are carefully fused with VSM, stack trace, and code complexity features. Evaluation results on four data sets show that AttentiveBugLocator can identify buggy files on the scale of 56% and 62% on MAP and MRR – thus, outperforms sev-eral state-of-the-art approaches.
References
Alon, U., Zilberstein, M., Levy, O., Yahav, E.: code2vec: Learning distributed representations of code. Proceedings of the ACM on Programming Languages 3(POPL), 1–29 (2019)’
Beel, J., Langer, S., Gipp, B.: Tf-iduf: a novel term-weighting scheme for user modeling based on users’ personal document collections (2017)
Bölücü, N., Can, B., Artuner, H.: A siamese neural network for learning semantically-informed sentence embeddings. Expert Systems with Applications 214, 119103 (2023)
Cao, J., Yang, S., Jiang, W., Zeng, H., Shen, B., Zhong, H.: Bugpecker: Locating faulty methods with deep learning on revision graphs. In: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering. pp. 1214–1218 (2020)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirec-tional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Fang, F., Wu, J., Li, Y., Ye, X., Aljedaani, W., Mkaouer, M.W.: On the classifica-tion of bug reports to improve bug localization. Soft Computing 25(11), 7307–7323 (2021)
Huang, X., Xiang, C., Li, H., He, P.: Sbuglocater: Bug localization based on deep matching and information retrieval. Mathematical Problems in Engineering 2022 (2022)
Huo, X., Li, M., Zhou, Z.H.: Control flow graph embedding based on multi-instance decomposition for bug localization. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 34, pp. 4223–4230 (2020)
Huo, X., Li, M., Zhou, Z.H., et al.: Learning unified features from natural and programming languages for locating buggy source code. In: IJCAI. vol. 16, pp. 1606–1612 (2016)
Jia, C., Yang, Y., Xia, Y., Chen, Y.T., Parekh, Z., Pham, H., Le, Q., Sung, Y.H., Li, Z., Duerig, T.: Scaling up visual and vision-language representation learning with noisy text supervision. In: International Conference on Machine Learning. pp. 4904–4916. PMLR (2021)
Kim, M., Kim, Y., Lee, E.: An empirical study of ir-based bug localization for deep learning-based software. In: 2022 IEEE Conference on Software Testing, Verifica-tion and Validation (ICST). pp. 128–139. IEEE (2022)
Lam, A.N., Nguyen, A.T., Nguyen, H.A., Nguyen, T.N.: Combining deep learning with information retrieval to localize buggy files for bug reports (n). In: 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE). pp. 476–481. IEEE (2015)
Lam, A.N., Nguyen, A.T., Nguyen, H.A., Nguyen, T.N.: Bug localization with combination of deep learning and information retrieval. In: 2017 IEEE/ACM 25th International Conference on Program Comprehension (ICPC). pp. 218–229. IEEE (2017)
Liang, H., Sun, L., Wang, M., Yang, Y.: Deep learning with customized abstract syntax tree for bug localization. IEEE Access 7, 116309–116320 (2019)
Lukins, S.K., Kraft, N.A., Etzkorn, L.H.: Bug localization using latent dirichlet allocation. Information and Software Technology 52(9), 972–990 (2010)
Luo, Z., Wang, W., Cen, C.: Improving bug localization with effective contrastive learning representation. IEEE Access (2022)
Moreno, L., Treadway, J.J., Marcus, A., Shen, W.: On the use of stack traces to im-prove text retrieval-based bug localization. In: 2014 IEEE International Conference on Software Maintenance and Evolution. pp. 151–160. IEEE (2014)
Mou, L., Li, G., Jin, Z., Zhang, L., Wang, T.: Tbcnn: A tree-based convo-lutional neural network for programming language processing. arXiv preprint arXiv:1409.5718 (2014)
Saha, R.K., Lease, M., Khurshid, S., Perry, D.E.: Improving bug localization using structured information retrieval. In: 2013 28th IEEE/ACM International Confer-ence on Automated Software Engineering (ASE). pp. 345–355. IEEE (2013)
Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE trans-actions on Signal Processing 45(11), 2673–2681 (1997)
Seyam, A.A., Hamdy, A., Farhan, M.S.: Code complexity and version history for enhancing hybrid bug localization. IEEE Access 9, 61101–61113 (2021)
Shi, Z., Keung, J., Bennin, K.E., Zhang, X.: Comparing learning to rank techniques in hybrid bug localization. Applied Soft Computing 62, 636–648 (2018)
Veličković, P.: Everything is connected: Graph neural networks. Current Opinion in Structural Biology 79, 102538 (2023)
Wang, B., Xu, L., Yan, M., Liu, C., Liu, L.: Multi-dimension convolutional neural network for bug localization. IEEE Transactions on Services Computing (2020)
Wang, H., Wang, J., Wang, J., Zhao, M., Zhang, W., Zhang, F., Xie, X., Guo, M.: Graphgan: Graph representation learning with generative adversarial nets. In: Proceedings of the AAAI conference on artificial intelligence. vol. 32 (2018)
Wang, Y., Yao, Y., Tong, H., Huo, X., Li, M., Xu, F., Lu, J.: Bug localization via supervised topic modeling. In: 2018 IEEE international conference on data mining (ICDM). pp. 607–616. IEEE (2018)
Wang, Z., Tong, W., Li, P., Ye, G., Chen, H., Gong, X., Tang, Z.: Bugpre: an intel-ligent software version-toversion bug prediction system using graph convolutional neural networks. Complex & Intelligent Systems pp. 1–21 (2022)
Wong, C.P., Xiong, Y., Zhang, H., Hao, D., Zhang, L., Mei, H.: Boosting bug-report-oriented fault localization with segmentation and stack-trace analysis. In: 2014 IEEE International Conference on Software Maintenance and Evolution. pp. 181–190. IEEE (2014)
Xiao, X., Pan, Y., Zhang, B., Hu, G., Li, Q., Lu, R.: Albfl: A novel neural ranking model for software fault localization via combining static and dynamic features. Information and Software Technology 139, 106653 (2021)
Xiao, Y., Keung, J., Bennin, K.E., Mi, Q.: Machine translation-based bug localiza-tion technique for bridging lexical gap. Information and Software Technology 99, 58–61 (2018)
Xiao, Y., Keung, J., Mi, Q., Bennin, K.E.: Improving bug localization with an enhanced convolutional neural network. In: 2017 24th Asia-Pacific Software Engi-neering Conference (APSEC). pp. 338–347. IEEE (2017)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies. pp. 1480–1489 (2016)
Ye, X., Bunescu, R., Liu, C.: Learning to rank relevant files for bug reports us-ing domain knowledge. In: Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. pp. 689–699 (2014)
Yu, D., Yang, Q., Chen, X., Chen, J., Xu, Y.: Graph-based code semantics learning for eficient semantic code clone detection. Information and Software Technology 156, 107130 (2023)
Zhang, C., Yang, Z., He, X., Deng, L.: Multimodal intelligence: Representation learning, information fusion, and applications. IEEE Journal of Selected Topics in Signal Processing 14(3), 478–493 (2020)
Zhang, J., Xie, R., Ye, W., Zhang, Y., Zhang, S.: Exploiting code knowledge graph for bug localization via bidirectional attention. In: Proceedings of the 28th Inter-national Conference on Program Comprehension. pp. 219–229 (2020)
Zhou, J., Zhang, H., Lo, D.: Where should the bugs be fixed? more accurate in-formation retrievalbased bug localization based on bug reports. In: 2012 34th International Conference on Software Engineering (ICSE). pp. 14–24. IEEE (2012)
Zhu, Z., Li, Y., Wang, Y., Wang, Y., Tong, H.: A deep multimodal model for bug localization. Data Mining and Knowledge Discovery 35(4), 1369–1392 (2021)
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Aminu Ahmad, Yu Lasheng, Hussaini Aliyu Idris, Buhari Aliyu, Adamu Muhammad, Muhammad Umar Diginsa

This work is licensed under a Creative Commons Attribution 4.0 International License.