Exploring how deep learning decodes anomalous diffusion via Grad-CAM – Nature Communications

1. Mehta, P. et al. A high-bias, low-variance introduction to machine learning for physicists. Phys. Rep. 810, 1–124 (2019).

   Google Scholar 

2. Carleo, G. et al. Machine learning and the physical sciences. Rev. Mod. Phys. 91, 045002 (2019).

   Google Scholar 

3. Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R. & Poria, S. A review of deep learning techniques for speech processing. Informat. Fusion 99, 101869 (2023).

   Google Scholar 

4. Voulodimos, A., Doulamis, N., Doulamis, A. & Protopapadakis, E. Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 7068349 (2018).

   Google Scholar 

5. Ghielmetti, N. et al. Real-time semantic segmentation on FPGAs for autonomous vehicles with HLS4ML. Mach. Learn.: Sci. Technol. 3, 045011 (2022).

   Google Scholar 

6. OpenAI et al. GPT-4 technical report. Preprint at https://arxiv.org/abs/2303.08774 (2023).

7. Aad, G. et al. Search for neutral long-lived particles in pp collisions at (sqrt{s}=13) TeV that decay into displaced hadronic jets in the ATLAS calorimeter. J. High Energ. Phys. 2022, 1–49 (2022).

   Google Scholar 

8. Qiu, R., Krastev, P. G., Gill, K. & Berger, E. Deep learning detection and classification of gravitational waves from neutron star-black hole mergers. Phys. Lett. B 840, 137850 (2023).

   Google Scholar 

9. Jumper, J. et al. Highly accurate protein structure prediction with alphafold. Nature 596, 583–589 (2021).

   Google Scholar 

10. Bo, S., Schmidt, F., Eichhorn, R. & Volpe, G. Measurement of anomalous diffusion using recurrent neural networks. Phys. Rev. E 100, 010102 (2019).

    Google Scholar 

11. Granik, N. et al. Single-particle diffusion characterization by deep learning. Biophys. J. 117, 185–192 (2019).

    Google Scholar 

12. Kowalek, P., Loch-Olszewska, H. & Szwabiński, J. Classification of diffusion modes in single-particle tracking data: feature-based versus deep-learning approach. Phys. Rev. E 100, 032410 (2019).

    Google Scholar 

13. Muñoz-Gil, G., Garcia-March, M. A., Manzo, C., Martín-Guerrero, J. D. & Lewenstein, M. Single trajectory characterization via machine learning. New J. Phys. 22, 013010 (2020).

    Google Scholar 

14. Barkai, E., Garini, Y. & Metzler, R. Strange kinetics of single molecules in living cells. Phys. Today 65, 29–35 (2012).

    Google Scholar 

15. Krapf, D. Mechanisms underlying anomalous diffusion in the plasma membrane. Curr. Top Membr. 75, 167–207 (2015).

16. Okubo, A. Dynamical aspects of animal grouping: swarms, schools, flocks, and herds. Adv. Biophys. 22, 1–94 (1986).

    Google Scholar 

17. Lüdtke, O., Roberts, B. W., Trautwein, U. & Nagy, G. A random walk down university avenue: life paths, life events, and personality trait change at the transition to university life. J. Pers. Soc. Psychol. 101, 620–637 (2011).

    Google Scholar 

18. Plerou, V., Gopikrishnan, P., Amaral, L. A. N., Gabaix, X. & Stanley, H. E. Economic fluctuations and anomalous diffusion. Phys. Rev. E 62, R3023–R3026 (2000).

    Google Scholar 

19. Scher, H. & Montroll, E. W. Anomalous transit-time dispersion in amorphous solids. Phys. Rev. B 12, 2455–2477 (1975).

    Google Scholar 

20. Mandelbrot, B. B. & Van Ness, J. W. Fractional Brownian motions, fractional noises and applications. SIAM Rev. 10, 422–437 (1968).

    Google Scholar 

21. Klafter, J. & Zumofen, G. Lévy statistics in a Hamiltonian system. Phys. Rev. E 49, 4873–4877 (1994).

    Google Scholar 

22. Massignan, P. et al. Nonergodic subdiffusion from Brownian motion in an inhomogeneous medium. Phys. Rev. Lett. 112, 150603 (2014).

    Google Scholar 

23. Lim, S. C. & Muniandy, S. V. Self-similar Gaussian processes for modeling anomalous diffusion. Phys. Rev. E 66, 021114 (2002).

    Google Scholar 

24. Metzler, R., Jeon, J.-H., Cherstvy, A. G. & Barkai, E. Anomalous diffusion models and their properties: non-stationarity, non-ergodicity, and ageing at the centenary of single particle tracking. Phys. Chem. Chem. Phys. 16, 24128–24164 (2014).

    Google Scholar 

25. Weron, A., Janczura, J., Boryczka, E., Sungkaworn, T. & Calebiro, D. Statistical testing approach for fractional anomalous diffusion classification. Phys. Rev. E 99, 042149 (2019).

    Google Scholar 

26. Kepten, E., Weron, A., Sikora, G., Burnecki, K. & Garini, Y. Guidelines for the fitting of anomalous diffusion mean square displacement graphs from single particle tracking experiments. PLoS ONE 10, e.0117722 (2015).

    Google Scholar 

27. Magdziarz, M., Weron, A., Burnecki, K. & Klafter, J. Fractional Brownian motion versus the continuous-time random walk: a simple test for subdiffusive dynamics. Phys. Rev. Lett. 103, 180602 (2009).

    Google Scholar 

28. Meroz, Y., Sokolov, I. M. & Klafter, J. Test for determining a subdiffusive model in ergodic systems from single trajectories. Phys. Rev. Lett. 110, 090601 (2013).

    Google Scholar 

29. Schwarzl, M., Godec, A. & Metzler, R. Quantifying non-ergodicity of anomalous diffusion with higher order moments. Sci. Rep. 7, 3878 (2017).

    Google Scholar 

30. Kowalek, P., Loch-Olszewska, H., Łaszczuk, Ł, Opała, J. & Szwabiński, J. Boosting the performance of anomalous diffusion classifiers with the proper choice of features. J. Phys. A: Math. Theor. 55, 244005 (2022).

    Google Scholar 

31. Wagner, T., Kroll, A., Haramagatti, C. R., Lipinski, H.-G. & Wiemann, M. Classification and segmentation of nanoparticle diffusion trajectories in cellular micro environments. PLoS ONE 12, e0170165 (2017).

    Google Scholar 

32. Loch-Olszewska, H. & Szwabiński, J. Impact of feature choice on machine learning classification of fractional anomalous diffusion. Entropy 22, 1436 (2020).

    Google Scholar 

33. Muñoz-Gil, G. et al. Objective comparison of methods to decode anomalous diffusion. Nat. Commun. 12, 6253 (2021).

    Google Scholar 

34. Argun, A., Volpe, G. & Bo, S. Classification, inference and segmentation of anomalous diffusion with recurrent neural networks. J. Phys. A: Math. Theor. 54, 294003 (2021).

    Google Scholar 

35. Gentili, A. & Volpe, G. Characterization of anomalous diffusion classical statistics powered by deep learning (condor). J. Phys. A: Math. Theor. 54, 314003 (2021).

    Google Scholar 

36. Bland, T. Convolutional neural networks for characterisation and segmentation of anomalous diffusion trajectories (accessed 28 August 2025); https://github.com/tsmbland/andi_challenge.

37. Garibo-i Orts, Ò, Baeza-Bosca, A., Garcia-March, M. A. & Conejero, J. A. Efficient recurrent neural network methods for anomalously diffusing single particle short and noisy trajectories. J. Phys. A: Math. Theor. 54, 504002 (2021).

    Google Scholar 

38. Arts, M., Smal, I., Paul, M. W., Wyman, C. & Meijering, E. Particle mobility analysis using deep learning and the moment scaling spectrum. Sci. Rep. 9, 17160 (2019).

    Google Scholar 

39. Seckler, H. & Metzler, R. Bayesian deep learning for error estimation in the analysis of anomalous diffusion. Nat. Commun. 13, 6717 (2022).

    Google Scholar 

40. Simonyan, K., Vedaldi, A. & Zisserman, A. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps http://arxiv.org/abs/1312.6034 (2014).

41. Smilkov, D., Thorat, N., Kim, B., Viégas, F. & Wattenberg, M. Smoothgrad: Removing Noise by Adding Noise http://arxiv.org/abs/1706.03825 (2017).

42. Zeiler, M. D. & Fergus, R. Visualizing and Understanding Convolutional Networks, 818 https://doi.org/10.1007/978-3-319-10590-1_53 (2014).

43. Springenberg, J. T., Dosovitskiy, A., Brox, T. & Riedmiller, M. Striving for Simplicity: The All Convolutional Net https://arxiv.org/abs/1412.6806 (2015).

44. Bach, S. et al. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 10, e.0130140 (2015).

    Google Scholar 

45. Shrikumar, A., Greenside, P. & Kundaje, A. Learning Important Features Through Propagating Activation Differences, 3145 https://proceedings.mlr.press/v70/shrikumar17a.html (2017).

46. Sundararajan, M., Taly, A. & Yan, Q. Axiomatic Attribution for Deep Networks, 3319 https://proceedings.mlr.press/v70/sundararajan17a.html (2017).

47. Pineda, J. et al. Geometric deep learning reveals the spatiotemporal features of microscopic motion. Nat. Mach. Intell. 5, 71–82 (2023).

    Google Scholar 

48. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Learning Deep Features for Discriminative Localization, 2921 https://doi.org/10.1109/CVPR.2016.319 (2016).

49. Selvaraju, R. R. et al. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. In 2017 IEEE International Conference on Computer Vision (ICCV), 618–626 (IEEE, 2017).

50. Chattopadhay, A., Sarkar, A., Howlader, P. & Balasubramanian, V. N. Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 839–847 (IEEE, 2018).

51. Ennadifi, E., Laraba, S., Vincke, D., Mercatoris, B. & Gosselin, B. Wheat diseases Classification and Localization Using Convolutional Neural Networks and GradCAM Visualization https://doi.org/10.1109/ISCV49265.2020.9204258 (2020).

52. Lee, S., Lee, J., Lee, J., Park, C.-K. & Yoon, S. Robust tumor localization with pyramid Grad-CAM. Preprint at https://arxiv.org/abs/1805.11393 (2018).

53. Li, Y., Yang, H., Li, J., Chen, D. & Du, M. Eeg-based intention recognition with deep recurrent-convolution neural network: Performance and channel selection by grad-cam. Neurocomputing 415, 225–233 (2020).

    Google Scholar 

54. AL-hada, E. A., Tang, X. & Deng, W. Classification of stochastic processes by convolutional neural networks. J. Phys. A: Hath. Theor. 55, 274006 (2022).

    Google Scholar 

55. Bai, S., Kolter, J. Z. & Koltun, V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. Preprint at https://arxiv.org/abs/1803.01271 (2018).

56. He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition 770 https://doi.org/10.1109/CVPR.2016.90 (2016).

57. Bengio, Y., Courville, A. & Vincent, P. Representation learning: a review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 1798–1828 (2013).

    Google Scholar 

58. Mahendran, A. & Vedaldi, A. Visualizing deep convolutional neural networks using natural pre-images. Int. J. Comput. Vis. 120, 233–255 (2016).

    Google Scholar 

59. Kokhlikyan, N. et al. Captum: a unified and generic model interpretability library for PyTorch. Preprint at https://arxiv.org/abs/2009.07896 (2020).

60. Shorten, C. & Khoshgoftaar, T. M. A survey on image data augmentation for deep learning. J. Big Data 6, 60 (2019).

    Google Scholar 

61. Bae, J. & Jeong, H. Segment-based task-specific deep learning framework for detecting state transitions in anomalous diffusion trajectories. J. Phys.: Photonics 7, 025027 (2025).

    Google Scholar 

62. Muñoz-Gil, G., Requena, B., Volpe, G., Garcia-March, M. A. & Manzo, C. AnDiChallenge/ANDI_datasets: Challenge 2020 release. Zenodo https://doi.org/10.5281/zenodo.4775311 (2020).

63. Paszke, A. et al. Pytorch: An Imperative Style, High-Performance Deep Learning Library https://proceedings.neurips.cc/paper_files/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf (2019).

64. Kingma, D. P. & Ba, J. Adam: A Method for Stochastic Optimization. In 3rd International Conference for Learning Representations, San Diego, https://doi.org/10.48550/arXiv.1412.6980 (2015).

Download references