Explainable hybrid AI CAD framework for advanced prediction of steel surface defects – Scientific Reports

1. Zhong, H. et al. LiFSO-Net: A lightweight feature screening optimization network for complex-scale flat metal defect detection. Knowl. Based Syst. 304, 112520. https://doi.org/10.1016/j.knosys.2024.112520 (2024).

   Google Scholar 

2. Tang, B., Chen, L., Sun, W. & Lin, Z. Review of surface defect detection of steel products based on machine vision. IET Image Proc. 17(2), 303–322. https://doi.org/10.1049/ipr2.12647 (2023).

   Google Scholar 

3. Song, X., Cao, S., Zhang, J. & Hou, Z. Steel surface defect detection algorithm based on YOLOv8. Electronics 13(5), 988. https://doi.org/10.3390/electronics13050988 (2024).

   Google Scholar 

4. Cheng, X. & Yu, J. RetinaNet with difference channel attention and adaptively spatial feature fusion for steel surface defect detection. IEEE Trans. Instrum. Meas. 70, 1–11. https://doi.org/10.1109/TIM.2020.3040485 (2020).

   Google Scholar 

5. Saberironaghi, A., Ren, J. & El-Gindy, M. Defect detection methods for industrial products using deep learning techniques: A review. Algorithms. 16(2), 95. https://doi.org/10.3390/a16020095 (2023).

   Google Scholar 

6. Wang, C.Y., Yeh, I.H., Mark Liao, H.Y. Yolov9: Learning what you want to learn using programmable gradient information. In: European Conference on Computer Vision. 2025. Springer. https://doi.org/10.1007/978-3-031-72751-1_1.

7. Redmon, J., Divvala, S., Girshich, Ross., Ali, F. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016. https://doi.org/10.1109/CVPR.2016.91.

8. Wen, X., Shan, J., He, Y. & Song, K. Steel surface defect recognition: A survey. Coatings 13(1), 17. https://doi.org/10.3390/coatings13010017 (2022).

   Google Scholar 

9. Zhao, C., Shu, X., Yan, X., Zuo, X. & Zhu, F. RDD-YOLO: A modified YOLO for detection of steel surface defects. Measurement 214, 112776. https://doi.org/10.1016/j.measurement.2023.112776 (2023).

   Google Scholar 

10. Lu, M., Sheng, W., Zou, Y., Chen, Y. & Chen, Z. WSS-YOLO: An improved industrial defect detection network for steel surface defects. Measurement https://doi.org/10.1016/j.measurement.2024.115060 (2024).

    Google Scholar 

11. Huang, X., Zhu, J. & Huo, Y. SSA-YOLO: An improved YOLO for hot-rolled strip steel surface defect detection. IEEE Trans. Instrum. Meas. https://doi.org/10.1109/TIM.2024.3488136 (2024).

    Google Scholar 

12. Xie, W., Ma, W. & Sun, X. An efficient re-parameterization feature pyramid network on YOLOv8 to the detection of steel surface defect. Neurocomputing 614, 128775. https://doi.org/10.1016/j.neucom.2024.128775 (2025).

    Google Scholar 

13. Liu, L. et al. Surface defect detection of industrial components based on improved YOLOv5s. IEEE Sens. J. https://doi.org/10.1109/JSEN.2024.3407874 (2024).

    Google Scholar 

14. Li, C., Xu, A., Zheng, Q. & Cai, Y. Steel surface defect detection method based on improved YOLOX. IEEE Access. https://doi.org/10.1109/ACCESS.2024.3374869 (2024).

    Google Scholar 

15. Guo, Z., Wang, C., Yang, G., Huang, Z. & Li, G. Msft-yolo: Improved yolov5 based on transformer for detecting defects of steel surface. Sensors. 22(9), 3467. https://doi.org/10.3390/s22093467 (2022).

    Google Scholar 

16. Zhang, Y., Zhang, H., Huang, Q., Han, Y. & Zhao, M. DsP-YOLO: An anchor-free network with DsPAN for small object detection of multiscale defects. Expert Syst. Appl. 241, 122669. https://doi.org/10.1016/j.eswa.2023.122669 (2024).

    Google Scholar 

17. Li, G. et al. YOLO-RFF: An industrial defect detection method based on expanded field of feeling and feature fusion. Electronics 11(24), 4211. https://doi.org/10.3390/electronics11244211 (2022).

    Google Scholar 

18. Su, P., Han, H., Liu, M., Yang, T. & Liu, S. MOD-YOLO: Rethinking the YOLO architecture at the level of feature information and applying it to crack detection. Expert Syst. Appl. 237, 121346. https://doi.org/10.1016/j.eswa.2023.121346 (2024).

    Google Scholar 

19. Qureshi, A. S. & Roos, T. Transfer learning with ensembles of deep neural networks for skin cancer detection in imbalanced data sets. Neural Process. Lett. 55(4), 4461–4479. https://doi.org/10.1007/s11063-022-11049-4 (2023).

    Google Scholar 

20. Nakata, N. & Siina, T. Ensemble learning of multiple models using deep learning for multiclass classification of ultrasound images of hepatic masses. Bioengineering 10(1), 69. https://doi.org/10.3390/bioengineering10010069 (2023).

    Google Scholar 

21. Patil, S. & Kirange, D. Ensemble of deep learning mdels for brain tumor detection. Proced Comput. Sci. 218, 2468–2479. https://doi.org/10.1016/j.procs.2023.01.222 (2023).

    Google Scholar 

22. Zheng, Y. et al. Application of transfer learning and ensemble learning in image-level classification for breast histopathology. Intell. Med. 3(02), 115–128. https://doi.org/10.1016/j.imed.2022.05.004 (2023).

    Google Scholar 

23. Ukwuoma, C. C. et al. A hybrid explainable ensemble transformer encoder for pneumonia identification from chest X-ray images. J. Adv. Res. 48, 191–211. https://doi.org/10.1016/j.jare.2022.08.021 (2023).

    Google Scholar 

24. Loddo, A., Buttau, S. & Ruberto, C. D. Deep learning based pipelines for Alzheimer’s disease diagnosis: a comparative study and a novel deep-ensemble method. Comput. Biol. Med. 141, 105032. https://doi.org/10.1016/j.compbiomed.2021.105032 (2022).

    Google Scholar 

25. Kang, J., Ullah, Z. & Gwak, J. MRI-based brain tumor classification using ensemble of deep features and machine learning classifiers. Sensors. 21(6), 2222. https://doi.org/10.3390/s21062222 (2021).

    Google Scholar 

26. Aurna, N. F., Yousuf, M. A., Taher, K. A., Azad, A. K. M. & Moni, M. A. A classification of MRI brain tumor based on two stage feature level ensemble of deep CNN models. Comput. Biol. Med. 146, 105539. https://doi.org/10.1016/j.compbiomed.2022.1055 (2022).

    Google Scholar 

27. Solovyev, R., Wang, W. & Gabruseva, T. Weighted boxes fusion: Ensembling boxes from different object detection models. Image Vis. Comput. 107, 104117. https://doi.org/10.1016/j.imavis.2021.104117 (2021).

    Google Scholar 

28. Song, K. & Yan, Y. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl. Surf. Sci. 285, 858–864. https://doi.org/10.1016/j.apsusc.2013.09.002 (2013).

    Google Scholar 

29. Lv, X., Duan, F., Jiang, J.-J., Fu, X. & Gan, L. Deep metallic surface defect detection: The new benchmark and detection network. Sensors https://doi.org/10.3390/s20061562 (2020).

    Google Scholar 

30. He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. https://doi.org/10.1109/CVPR.2016.90 (2016).

    Google Scholar 

31. Tan, M., Le, Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning. 2019. PMLR. https://doi.org/10.48550/arXiv.1905.11946.

32. Huang, G., Liu, Z., Maaten, L, V, D., Weinberger, K, Q. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017. https://doi.org/10.1109/CVPR.2017.243.

33. Xie, S., Girshick, R., Dollar, P. & He, K. Aggregated residual transformations for deep neural networks. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. https://doi.org/10.1109/CVPR.2017.634 (2017).

    Google Scholar 

34. Hu, J., Shen, L. & Sun, G. Squeeze-and-excitation networks. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. https://doi.org/10.1109/TPAMI.2019.2913372 (2018).

    Google Scholar 

35. Zagoruyko, S., Komodakis, N. Wide residual networks. arXiv preprint arXiv:1605.07146, 2016. https://doi.org/10.48550/arXiv.1605.07146.

36. Wang, W., et al. Internimage: Exploring large-scale vision foundation models with deformable convolutions. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023. https://doi.org/10.1109/CVPR52729.2023.01385

37. Yang, L., Zhang, R, Y., LI, L., Xie, X. Simam: A simple, parameter-free attention module for convolutional neural networks. In International Conference on Machine Learning. 2021. PMLR. https://doi.org/10.1016/j.patcog.2024.110509.

38. Song, C., Chen, J., Lu, Z., Li, F. & Liu, Y. Steel surface defect detection via deformable convolution and background suppression. IEEE Trans. Instrum. Meas. 72, 1–9. https://doi.org/10.1109/TIM.2023.3277989 (2023).

    Google Scholar 

39. Gunning, D. D. W. A. DARPA’s explainable artificial intelligence program. AI Mag 40(2), 44. https://doi.org/10.1609/aimag.v40i2.2850 (2019).

    Google Scholar 

Download references