PDFP-enhanced physics-informed neural networks for solving higher-order PDEs: Application to engineering beam problems

  • Shahbaz Ahmad orcid

    Abdus Salam School of Mathematical Sciences, Government College University, Lahore 54600, Pakistan

  • Neha Zaman orcid

    Department of Mathematics, Government Post Graduate College Mansehra, Mansehra 21300, Pakistan

  • Muhammad Asif orcid

    Department of Mathematics, Government Post Graduate College Mansehra, Mansehra 21300, Pakistan

  • Muhammad Qasim orcid

    Government Degree College Havelian, Abbottabad 22010, Pakistan

  • Aaqib Hussain Shah orcid

    Department of Chemistry, Government Post Graduate College Mansehra, Mansehra 21300, Pakistan

  • Anam Shahzadi orcid

    Islamabad Model College for Girls, Islamabad 44000, Pakistan

  • Faizan Arshid orcid

    Department of Mathematics, Government Post Graduate College Mansehra, Mansehra 21300, Pakistan

  • Muhammad Israr orcid

    Abdus Salam School of Mathematical Sciences, Government College University, Lahore 54600, Pakistan

    Department of Mathematics, Government Post Graduate College Mansehra, Mansehra 21300, Pakistan

Article ID: 4125
Keywords: quasi newton optimization, PDFP optimizer, neural network, PINNs, euler–bernoulli beam problem, timoshenko beam problem

Abstract

This study introduces a modern technique for solving beam equations on elastic foundations, applied to Euler–Bernoulli and Timoshenko beams based on the Winkler foundation. Conventional Physics-Informed Neural Networks (PINNs) have faced major challenges in handling large space-time domains, even when closed-form solutions exist. To address these challenges, we introduced a preconditioned PINNs loss function that incorporates prior knowledge from similar problems, thereby enhancing both productivity and accuracy. This novel method improves the generalization capability of PINNs in structural engineering, specifically for beam dynamics on elastic foundations. The effectiveness of the method is shown through numerical simulations on Euler–Bernoulli beams and extended domains for Timoshenko beams. Comparing with state-of-the-art PINNs shows that our method speeds up the convergence and precisely describes the behavior of the system, surpassing current strategies under the L2-norm metric. Besides, we examine the weight and weight loss plots, and present 3D visualizations of the best weight configurations. Further, we describe the superior performance of the proposed method. The present study explores the application of Preconditioned Devidon–Fletcher–Powell (PDFP)-enhanced Physics-Informed Neural Networks (PINNs) for solving higher-order partial differential equations, with particular emphasis on their implementation in engineering beam problems. It provides an overview of the new approach for addressing complex beam dynamics, including visualizations of the neural network architectures, PINNs convergence behavior, and representative solutions for the beam problems.

Published
2026-01-27
How to Cite
Ahmad, S., Zaman, N., Asif, M., Qasim, M., Shah, A. H., Shahzadi, A., Arshid, F., & Israr, M. (2026). PDFP-enhanced physics-informed neural networks for solving higher-order PDEs: Application to engineering beam problems. Mechanical Engineering Advances, 4(1). https://doi.org/10.59400/mea4125
Section
Article

References

[1]Deng J, Shahroudi M, Liu K. Dynamic stability and responses of beams on elastic foundations under a parametric load. International Journal of Structural Stability and Dynamics. 2023; 23(2): 2350018.

[2]Younesian D, Hosseinkhani A, Askari H, et al. Elastic and viscoelastic foundations: a review on linear and nonlinear vibration modeling and applications. Nonlinear Dynamics. 2019; 97(1): 853–895.

[3]Saini R, Pradyumna S. Asymmetric vibrations of functionally graded annular nanoplates under thermal environment using nonlocal elasticity theory with modified nonlocal boundary conditions. Journal of Engineering Mechanics. 2023; 149(5): 04023022.

[4]Israr M, Khan I. Causal Physics-Informed Neural Networks for Singular and Singularly Perturbed Boundary Value Problems in Chemical Systems. Global Integrated Mathematics. 2025; 1(1): 13–27.

[5]Kabir H, Aghdam M. A robust Bézier based solution for nonlinear vibration and post-buckling of random checkerboard graphene nano-platelets reinforced composite beams. Composite Structures. 2019; 212: 184–198.

[6]Yu J, Lu L, Meng X, et al. Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems. Computer Methods in Applied Mechanics and Engineering. 2022; 393: 114823.

[7]Saini R, Gopalakrishnan S. Nonlocal boundaries and paradoxes in thermoelastic vibrations of functionally graded Non-Uniform cantilever nanobeams and annular nanoplates. Structures. 2023; 55: 1292–1305.

[8]Madenci E, Guven I. The Finite Element Method and Applications in Engineering Using ANSYS. Springer; 2015.

[9]Saini R. Thermoelastic vibrations of functionally graded nonuniform nanobeams. In: Nanomaterials for Advanced Technologies. Springer; 2022. pp. 141–171.

[10]Saini R, Saini R, Kumar A, et al. Free axisymmetric vibrations of heated non-uniform Bi-directional FGM Mindlin rings employing quadrature approaches. Thin-Walled Structures. 2023; 184: 110482.

[11]Saini R, Pradyumna S. Effect of thermal environment on the asymmetric vibration of temperature-dependent two-dimensional functionally graded annular plate by Chebyshev polynomials. Journal of Thermal Stresses. 2022; 45(9): 740–761.

[12]Meng D, Yang H, Yang S, et al. Kriging-assisted hybrid reliability design and optimization of offshore wind turbine support structure based on a portfolio allocation strategy. Ocean Engineering. 2024; 295: 116842.

[13]Meng D, Yang S, De Jesus AM, et al. A novel Kriging-model-assisted reliability-based multidisciplinary design optimization strategy and its application in the offshore wind turbine tower. Renewable Energy. 2023; 203: 407–420.

[14]Karniadakis GE, Kevrekidis IG, Lu L, et al. Physics-informed machine learning. Nature Reviews Physics. 2021; 3(6): 422–440.

[15]Israr M, Ayub A, Alkhalaf A, et al. AI-assisted PDFP-based PINNs for heat regulation of nanofluid in industrial cooling enclosures around circular barriers. International Communications in Heat and Mass Transfer. 2026; 173: 110717.

[16]E W, Yu B. The deep Ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics. 2018; 6(1): 1–12.

[17]Sirignano J, Spiliopoulos K. DGM: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics. 2018; 375: 1339–1364.

[18]Raissi M, Perdikaris P, Karniadakis GE. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics. 2019; 378: 686–707.

[19]Saini R. A review on artificial neural networks for structural analysis. Journal of Vibration Engineering & Technologies. 2025; 13(2): 142.

[20]Wang S, Teng Y, Perdikaris P. Understanding and mitigating gradient flow pathologies in physics-informed neural networks. SIAM Journal on Scientific Computing. 2021; 43(5): A3055–A3081.

[21]Saini R, Saini R. Thermal buckling analysis of nonuniform FG nanobeams: analytical and numerical solutions. Journal of Mechanics of Materials and Structures. 2024; 19(5): 837–855.

[22]Gou J, Sun L, Liu J, et al. An adaptive differential evolution with deeply informed mutation strategy and historical information for numerical optimization. Information Sciences. 2026; 739: 123146.

[23]Yang Q, Liu Z, Wang Xiaokai, et al. Physical model test and numerical modeling of cross-sectional shape effect on evolution mechanism of time-delayed deformation and rockburst in deep tunnels. Rock Mechanics and Rock Engineering. 2025; 59(2): 2015–2043.

[24]Su H, Liao Q, Zhang H, et al. Advanced Intelligent Pipeline Management Technology. Springer; 2023.

[25]Kingma DP. Adam: A method for stochastic optimization. arXiv preprint. 2014; arXiv:1412.6980.

[26]Bottou L. Stochastic gradient descent tricks. In: Neural Networks: Tricks of the Trade, 2nd ed. Springer; 2012. pp. 421–436.

[27]Jagtap AD, Kawaguchi K, Karniadakis GE. Adaptive activation functions accelerate convergence in deep and physics-informed neural networks. Journal of Computational Physics. 2020; 404: 109136.

[28]Wang S, Yu X, Perdikaris P. When and why PINNs fail to train: A neural tangent kernel perspective. Journal of Computational Physics. 2022; 449: 110768.

[29]Dolean V, Heinlein A, Mishra S, et al. Multilevel domain decomposition-based architectures for physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering. 2024; 429: 117116.

[30]Botev A, Ritter H, Barber D. Practical Gauss-Newton optimisation for deep learning. In: Proceedings of the 34th International Conference on Machine Learning; 6–11 August 2017; Sydney, Australia. pp. 557–565.

[31]Li W, Xiang X, Xu Y. Deep domain decomposition method: Elliptic problems. In: Proceedings of the First Mathematical and Scientific Machine Learning Conference; 20–24 July 2020; Princeton, NJ, USA. pp. 269–286.

[32]Bazmara M, Silani M, Mianroodi M, et al. Physics-informed neural networks for nonlinear bending of 3D functionally graded beam. Structures. 2023; 49: 152–162.

[33]Kapoor T, Wang H, Núñez A, et al. Physics-informed neural networks for solving forward and inverse problems in complex beam systems. IEEE Transactions on Neural Networks and Learning Systems. 2023; 35(5): 5981–5995.

[34]Saini R, Pradyumna S. A layer-wise theory for the dynamic analysis of functionally graded composite nanobeams under thermal environment using nonlocal boundary conditions and Chebyshev collocation technique. Journal of Vibration and Control. 2024; 30(19–20): 4591–4611.

[35]Xu C, Cao BT, Yuan Y, et al. Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios. Computer Methods in Applied Mechanics and Engineering. 2023; 405: 115852.

[36]Saini R. An Investigation for Asymmetric Vibrations of Multi-dimensional Functionally Graded Heated Non-Uniform Annular Nanoplates using Chebyshev Polynomials and Parallel Computing. Journal of Vibration Engineering & Technologies. 2025; 13(5): 289.

[37]Sukumar N, Srivastava A. Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks. Computer Methods in Applied Mechanics and Engineering. 2022; 389: 114333.

[38]Mishra S, Molinaro R. Estimates on the generalization error of physics-informed neural networks for approximating PDEs. IMA Journal of Numerical Analysis. 2023; 43(1): 1–43.

[39]Ahmad S, Israr M. A preconditioned quasi-newton optimizer for efficient training of PINNs. Machine Learning for Computational Science and Engineering. 2025; 1(2): 34.

[40]McClenny LD, Braga-Neto UM. Self-adaptive physics-informed neural networks. Journal of Computational Physics. 2023; 474: 111722.

[41]Uddin Z, Ganga S, Asthana R, et al. Wavelets based physics informed neural networks to solve non-linear differential equations. Scientific Reports. 2023; 13(1): 2882.

[42]Kapoor T, Wang H, Nunez A, et al. Transfer learning for improved generalizability in causal physics-informed neural networks for beam simulations. Engineering Applications of Artificial Intelligence. 2024; 133: 108085.