Degradation-aware AI energy management for hybrid supercapacitor–battery energy storage systems in microgrids
Abstract
The presence of intermittent sources of renewable energy in power systems requires ESSs to manage temporal imbalance in energy supply and demand. In this study, we introduce a hybrid energy storage system (HESS) coupled with an AI energy management system (EMS) that uses deep reinforcement learning (DRL) for optimal scheduling of renewable energy utilization within grid-connected and islanded microgrids. AI-enabled EMS utilizes a DRL agent with proximal policy optimization (PPO) to make optimal decisions regarding energy generation based on state space and economic considerations, while accounting for SoC constraints of batteries. An important aspect of the proposed system is the design of HESS architecture and reward function based on DRL. Further improvements are made via analysing the PPO clipping sensitivity, Pearson correlation analysis on the relationship between the intermittency of renewables and response latency, and Monte Carlo uncertainty analysis with a 95% confidence interval. For a 24-hour simulation period, the developed system is able to cut down on grid power imports by 43.2%, have an 87.3% renewable energy utilization rate, extend the lifespan of the battery from 8.1 to 12.5 years, and have 91.4% peak shaving efficiency through 100 Monte Carlo runs and without any SoC violations (25%–90%). Net benefit analysis is estimated to be $56,000–$66,000 for 15 years at a 6% discount rate, while a 120 ms response time and one-way ANOVA with Tukey's HSD confirm statistical significance.
Copyright (c) 2026 Lalit Sachdeva, Utkarsh Anand

This work is licensed under a Creative Commons Attribution 4.0 International License.
References
[1]Bilal M, Imdadullah, Hameed S. Advanced Energy Management, Storage, and Control in Microgrids: AI and Blockchain Perspectives. Energy Storage. 2025; 7(8): e70297. doi: 10.1002/est2.70297
[2]Kumar PSS, Suresh P, Lenine D. A comparative study of advanced control strategies for interlink converters in hybrid renewable energy microgrids. Archives for Technical Sciences. 2025; 33(2): 100–113. doi: 10.70102/afts.2025.1833.100
[3]Bhattacharjee J, Roy S. Solar Hybrid and Energy Storage Systems. In: Hybridization of Renewable Energy. CRC Press; 2026. pp. 62–85. doi: 10.1201/9781003602736-5
[4]Kumar MGV, Rajakumar PS. Thermodynamic-Aware Multi-Agent Reinforcement Learning with Predictive Load Shifting for Real-Time Power Optimization and Climate Control in Phase-Change Cold Storage Systems. International Academic Journal of Science and Engineering. 2025; 12(4): 469–486. doi: 10.71086/IAJSE/V12I4/IAJSE12112
[5]Tamrakar G, Shrirao NM. Next-generation renewable energy systems: Smart integration of solar, wind, and energy storage with AI-driven grid management. National Journal of Renewable Energy Systems and Innovation. 2025; 1(2): 17–23.
[6]Bhattacharya R, Kapoor T. Advancements in power electronics for sustainable energy systems: A study in the periodic series of multidisciplinary engineering. In: Smart Grid Integration. National Institute of STEM Research; 2024. pp. 19–25.
[7]Taghavi M, Lee CJ. Development of a novel hydrogen liquefaction structure based on liquefied natural gas regasification operations and solid oxide fuel cell: Exergy and economic analyses. Fuel. 2025; 384: 133826. doi: 10.1016/j.fuel.2024.133826
[8]Taghavi M, Colpan CO, Dincer I. Development of an integrated production and liquefaction system of hydrogen and green natural gas: energy, exergy, economic and sensitivity assessments. Energy. 2026; 360: 141476. doi: 10.1016/j.energy.2026.141476
[9]Manthila P, Anuradha KM. Hybrid energy storage systems for grid-interactive renewable power: Design, control, and reliability perspectives. National Journal of Renewable Energy Systems and Innovation. 2025; 1(4): 34–42.
[10]Sharma C, Bhandari S, Kaur S. A Systematic Review on Integrated Optimization of Solar PV Tilt, Supercapacitor Buffering, and AI-Driven Energy Management in Fchevs. International Journal of Advances in Signal and Image Sciences. 2026; 12(3s): 583–595. doi: 10.29284/45nx3p91
[11]Srivastava A, Jha SK, Gupta D, et al. A Critical Review of Microgrid Technologies: Storage and Control Systems with Effective Optimization Techniques for Modeling Wind, Solar, Biomass, and Battery Energy Storage Systems. Cureus Journal of Engineering. 2026; 3: 1–23. doi: 10.7759/s44388-025-00041-y
[12]Dharma Raj T, Kumar C, Somasundaram PL, et al. A review on energy management systems in battery electric vehicles. Evolutionary Intelligence. 2026; 19(1): 29. doi: 10.1007/s12065-025-01139-2
[13]Rana Y, Aru VK, Kanakatharani S, et al. A systematic review of the various strategies for optimal energy management in hybrid AC/DC microgrids. Engineering Research Express. 2026; 8(2): 022301. doi: 10.1088/2631-8695/ae351e
[14]Sayed K, Aref M, Abokhalil AG, et al. Hybrid and Advanced Energy Storage Systems: Integration, Applications, and Future Trends. In: Abdelaziz AY, Mossa MA, Bajaj M (editors). Energy Storage Devices - A Comprehensive Overview. IntechOpen; 2025. doi: 10.5772/intechopen.1010067
[15]Mitra U, Arya A, Gupta S, et al. An energy management strategy for a fuel cell based hybrid system in DC microgrid. Journal of the Indian Chemical Society. 2026; 103(7): 102636. doi: 10.1016/j.jics.2026.102636
[16]Amer M, Elmojarrush A, Alsosi A. Materials of Supercapacitor: Applications and Developments. International Journal of Electrical Engineering and Sustainability. 2025; 3(2): 1–18. doi: 10.65998/ijees.v3i2.118
[17]Kandaswamy KV, Jagadeeshwaran A, Anand R. Efficient Energy Management Strategy for an Electric Vehicle Powered by a Hybrid Energy Storage System Based on Hybrid GBDT-RSA Approach. Cybernetics and Systems. 2025; 56(6): 741–767. doi: 10.1080/01969722.2023.2176588
[18]Roy K, Mandal KK, Mandal AC. Smart energy management for optimal economic operation in grid-connected hybrid power system. Energy Sources, Part A: Recovery, Utilization, and Environmental Effects. 2025; 47(1): 10096–10116. doi: 10.1080/15567036.2021.1961945
[19]Upadhyay TU, Jamnani JG. Hybrid energy storage system: improvement technique of power quality of large-scale wind energy system integrated distribution system. Australian Journal of Electrical and Electronics Engineering. 2025; 1–16. doi: 10.1080/1448837X.2025.2548112
[20]Patel NH, Shah P, Desai JP, et al. Application of AI for Solar Generation Prediction in Hybrid Microgrid. In: Proceedings of the 2025 IEEE International Conference on Smart Power, Energy, Renewables, and Transportation (SPERT); 22–24 December 2025; Surat, India. pp. 1–6. doi: 10.1109/SPERT67079.2025.11469651
[21]Guo J, He H, Jia C, et al. The Energy Management Strategies for Fuel Cell Electric Vehicles: An Overview and Future Directions. World Electric Vehicle Journal. 2025; 16(9): 542. doi: 10.3390/wevj16090542
[22]Ni J, Chen Y, Goudarzi A, et al. Dynamic Characteristics-Based Capacity Optimization Strategy for Hybrid AA-CAES and Battery Storage Systems in Source-Grid-Load-Storage Integrated Base. IEEE Access. 2025; 13: 42336–42349. doi: 10.1109/ACCESS.2025.3548044
[23]Dubal DP, Ayyad O, Ruiz V, et al. Hybrid energy storage: the merging of battery and supercapacitor chemistries. Chemical Society Reviews. 2015; 44(7): 1777–1790. doi: 10.1039/C4CS00266K
[24]Challouf I, Khemissi L, Gannouni F, et al. Hybrid Supercapacitor–Battery System for PV Modules Under Partial Shading: Modeling, Simulation, and Implementation. Energies. 2025; 18(23): 6110. doi: 10.3390/en18236110
[25]Saltuk MF. Prefeasibility analysis of the Pumped Hydro Storage (PHS) system in Türkiye: A case study on a hybrid system. Energy Storage and Conversion. 2023; 1(1): 215. doi: 10.59400/esc.v1i1.215
[26]Longo M, Yaici W, Foiadelli F. Hybrid Renewable Energy System with Storage for Electrification – Case Study of Remote Northern Community in Canada. International Journal of Smart grid. 2019; 3(2). doi: 10.20508/ijsmartgrid.v3i2.58.g47
[27]Pande AS, Soni BP, Sharma AK. Modeling of one and two RC model and state estimation of Lithium-Ion Battery using Thevenin’s equivalent Circuit Model. Procedia Computer Science. 2025; 259: 494–503. doi: 10.1016/j.procs.2025.03.351
[28]Deshpande R, Verbrugge M, Cheng YT, et al. Battery Cycle Life Prediction with Coupled Chemical Degradation and Fatigue Mechanics. Journal of The Electrochemical Society. 2012; 159(10): A1730–A1738. doi: 10.1149/2.049210jes
[29]Loew S, Anand A, Szabo A. Economic model predictive control of Li‐ion battery cyclic aging via online rainflow‐analysis. Energy Storage. 2021; 3(3): e228. doi: 10.1002/est2.228
[30]Rizki A, Touil A, Echchatbi A, et al. A Reinforcement Learning-Based Proximal Policy Optimization Approach to Solve the Economic Dispatch Problem. In: Proceedings of the 1st International Conference on Smart Management in Industrial and Logistics Engineering (SMILE 2025); 16–19 April 2025; Casablanca, Morocco. doi: 10.3390/engproc2025097024



