Optimal Energy Management for Hybrid PV-Wind-Battery Microgrids through Markov Decision Processes Technique

Nitin Chakole, Krishna Priya Remamany, G Mohan, P Sasirekha, NMG Kumar, C Ramesh Kumar, M. Shunmugasundaram, Manjunathan Alagarsamy, Bibhu Prasad Ganthia

Abstract


Hybrid PV-Wind-Battery microgrids have emerged as sustainable solutions to meet growing energy demands while reducing reliance on fossil fuels. However, managing energy flow efficiently among multiple renewable sources and storage systems poses significant challenges due to the inherent variability of solar and wind power. This paper presents an advanced energy management framework for hybrid microgrids using Markov Decision Processes (MDP). The proposed approach optimizes energy distribution through stochastic decision-making based on real-time system states, such as power generation, load demand, and battery state of charge (SOC). The MDP-based model aims to minimize operational costs, enhance energy reliability, and maintain system stability by determining optimal actions for battery charging/discharging and energy source prioritization. A comparative analysis with conventional methods demonstrates the MDP framework’s superiority in adapting to dynamic conditions, reducing energy wastage, and maximizing renewable utilization. The proposed control strategy introduces a Markov Decision Process (MDP)-based energy management framework that dynamically adapts to the stochastic nature of renewable generation and load demand a distinct departure from traditional rule-based or deterministic approaches. Unlike previous methods that rely on fixed thresholds or predefined heuristics, our MDP model leverages real-time system states to make probabilistically optimal decisions regarding battery usage and source prioritization. This integration of stochastic optimization with hardware validation establishes a novel, scalable, and practical control solution for hybrid PV-Wind-Battery microgrids, marking a significant advancement in intelligent energy management systems.

Keywords


PV-Wind-Battery Systems; Markov Decision Processes (MDP); Energy Management Optimization; Renewable Energy Utilization; System Stability and Reliability

Full Text:

PDF

References


K. El Mezdi, A. El Magri, I. El Myasse, “Enhancing energy flow management for a hybrid grid-connected photovoltaic battery energy storage system”, International Journal of Renewable Energy Research (IJRER), Vol. 15, No. 2, pp. 226-233, 2025. (Article)

B. J. Wesley, G. S. Babu, P. S. Kumar, “LSTM-ANN controllers based grid connected hybrid pv-wind-battery power supply system”, International Journal of Renewable Energy Research (IJRER), Vol. 15, No. 2, pp. 234-242, 2025. (Article)

H. Xie, Y. Wang, Z. Gao, B. P. Ganthia, C. V. Truong, “Research on frequency parameter detection of frequency shifted track circuit based on nonlinear algorithm”, Nonlinear Engineering, Vol. 10, No. 1, pp. 592-599, 2021. (Article)

S. A. Zulkifli, “Implementation of virtual synchronous motor control using ev battery’s SOC for single-stage converter during battery charging”, International Journal of Renewable Energy Research (IJRER), Vol. 15, No. 1, pp. 30-41, 2025. (Article)

J. Almada, R. Leão, R. Sampaio, G. Barroso, “A centralized and heuristic approach for energy management of an AC microgrid”, Renewable and Sustainable Energy Reviews, Vol. 60, pp. 1396–1404, 2016. (Article)

M. Abdelsattar, A. Mesalam, A. Fawzi, I. Hamdan, “Assessing the feasibility of a grid-tied smart hybrid power system through optimal sizing under various weather conditions”, International Journal of Renewable Energy Research (IJRER), Vol. 15, No. 1, pp. 1-14, 2025. (Article)

S. R. Kabat, C. K. Panigrahi, B. P. Ganthia, S. K. Barik, B. Nayak, “Implementation and analysis of mathematical modeled drive train system in type III wind turbines using computational fluid dynamics”, Advances in Science and Technology. Research Journal, Vol. 16, No. 1, pp. 180-189, 2022. (Article)

J. Gu, W. Wang, R. Yin, C. V. Truong, B. P. Ganthia, “Complex circuit simulation and nonlinear characteristics analysis of GaN power switching device”, Nonlinear Engineering, Vol. 10, No. 1, pp. 555-562, 2021. (Article)

B. Alahmad, M. Braun, “Control strategies for renewable microgrid systems: A review of recent developments”, IET Renewable Power Generation, Vol. 16, No. 10, pp. 1-12, 2022. DOI: 10.1049/rpg2.12410. (Article)

D. Radhakrishnan, M. Braun, “Advanced energy management systems in hybrid microgrids: A comprehensive review”, IET Renewable Power Generation, Vol. 17, No. 5, pp. 1-10, 2023. DOI: 10.1049/rpg2.12638. (Article)

M. Mohamed, A. El-Mashad, “Optimization techniques for integrating PV and wind energy in microgrids”, IET Renewable Power Generation, Vol. 17, No. 4, pp. 1-9, 2023. DOI: 10.1049/rpg2.12505. (Article)

Y. Liu, Y. Li, Z. Cai, “Coordinated control of hybrid energy storage system in grid-connected microgrids”, IEEE Transactions on Energy Conversion, pp. 1-8, 2018. DOI: 10.1109/TEC.2018.2832447. (Article)

R. Gupta, B. Singh, “Design and performance analysis of a TCSC-based voltage regulation system for grid-connected solar farms”, IEEE Transactions on Power Delivery, pp. 1-10, 2019. DOI: 10.1109/TPWRD.2019.2954436. (Article)

M. R. A. Refaai, L. Dhanesh, B. P. Ganthia, M. Mohanty, R. Subbiah, E. M. Anbese, “Design and implementation of a floating PV model to analyse the power generation”, International Journal of Photoenergy, Vol. 2022, No. 1, Article ID 3891881, 2022. (Article)

M. Khushal, P. Li, “Impact of machine learning techniques on voltage regulation in grid-connected systems”, IEEE Access, pp. 1-12, 2023. DOI: 10.1109/ACCESS.2023.3265091. (Article)

D. Kumar, A. Roy, “Dynamic voltage restorer (DVR) using fuzzy logic for mitigating voltage sags”, IET Renewable Power Generation, Vol. 17, No. 6, pp. 1-10, 2023. DOI: 10.1049/rpg2.12513. (Article)

B. P. Ganthia, R. Dharmaprakash, T. Choudhary, T. V. Muni, E. A. Al-Ammar, A. H. Seikh, A. Diriba, “Simulation model of pv system function in stand?alone mode for grid blackout area”, International Journal of Photoenergy, Vol. 2022, No. 1, Article ID 6202802, 2022. (Article)

S. Mishra, B. P. Ganthia, A. Sridharan, P. Rajakumar, D. Padmapriya, S. Kaliappan, “Optimization of load forecasting in smartgrid using artificial neural network based NFTOOL and NNTOOL”, Journal of Physics: Conference Series, Vol. 2161, No. 1, p. 012068, IOP Publishing, 2022. (Conference Paper)

B. P. Ganthia, S. Hanumanthakari, H. Gudimindla, H. Anandaram, M. S. Ramkumar, M. Mohanty, K. M. Hadish, “Machine learning strategy to achieve maximum energy harvesting and monitoring method for solar photovoltaic panel applications”, 2022. (Article)

K. Raman, P. Varghese, “Voltage stability improvement using a DVR with machine learning algorithms”, IET Renewable Power Generation, Vol. 17, No. 8, pp. 1-11, 2023. DOI: 10.1049/rpg2.12654. (Article)

B. P. Ganthia, S. K. Barik, “Fault analysis of PI and fuzzy-logic-controlled DFIG-based grid-connected wind energy conversion system”, Journal of The Institution of Engineers (India): Series B, pp. 1-23, 2022. (Article)

Y. Fu, J. Kumar, B. P. Ganthia, R. Neware, “Nonlinear dynamic measurement method of software reliability based on data mining”, International Journal of System Assurance Engineering and Management, Vol. 13, Suppl. 1, pp. 273-280, 2022. (Article)

M. Jacob, T. Harrison, “Recent advancements in power electronics for microgrid applications”, IET Renewable Power Generation, Vol. 17, No. 11, pp. 1-12, 2023. DOI: 10.1049/rpg2.12738. (Article)

S. Nanda, A. Singh, “Design and analysis of power electronic converters for hybrid microgrids”, IET Electric Power Applications, Vol. 11, No. 12, pp. 1-9, 2017. DOI: 10.1049/iet-epa.2017.0804. (Article)

B. P. Ganthia, S. K. Barik, B. Nayak, “Radial basis function artificial neural network optimized stability analysis in modified mathematical modeled type-III wind turbine system using bode plot and nyquist plot”, ECS Transactions, Vol. 107, No. 1, p. 5663, 2022. (Article)

B. P. Ganthia, S. Panda, K. P. Remamany, A. Chaturvedi, A. Y. Begum, G. Mohan, S. Ishwarya, “Experimental techniques for enhancing PV panel efficiency through temperature reduction using water cooling and colour filters”, Electrical Engineering, pp. 1-27, 2025. (Article)

K. Mehta, A. Patel, “Optimization of inverter performance in grid-connected microgrids”, IET Power Electronics, Vol. 12, No. 15, pp. 1-8, 2019. DOI: 10.1049/iet-pel.2019.1154. (Article)

H. Zhang, F. Li, “Performance evaluation of hybrid energy storage systems in renewable-based microgrids”, Energies, Vol. 11, No. 5, Article 1067, 2018. DOI: 10.3390/en11051067. (Article)

S. Mohapatra, R. Gupta, “Dynamic energy management techniques for hybrid microgrids”, International Journal of Renewable Energy Research, Vol. 6, No. 4, pp. 324-333, 2016. (Article)

R. Shinde, S. Gaikwad, “Control strategies for hybrid energy storage systems in microgrids”, IET Power Electronics, Vol. 12, No. 13, pp. 1-9, 2019. DOI: 10.1049/iet-pel.2019.1154. (Article)

F. Perez, Y. Zhao, “Advanced monitoring systems for microgrid protection using machine learning techniques”, Electronics, Vol. 7, No. 11, Article 288, 2018. DOI: 10.3390/electronics7110288. (Article)

A. Sahu, S. Patel, “Hybrid PV-wind energy systems: Modelling and control using AI”, in Advances in Green Energy Systems, Springer, pp. 45-60, 2020. DOI: 10.1007/978-981-15-9251-5_5. (Article)

R. Kumar, S. Roy, “Energy management systems in hybrid renewable systems using artificial intelligence”, in Smart Grid and Renewable Energy, Springer, pp. 329-340, 2021. DOI: 10.1007/978-981-16-4388-0_20. (Article)

B. P. Ganthia, S. Mohanty, P. K. Rana, P. K. Sahu, “Compensation of voltage sag using DVR with PI controller”, in 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), pp. 2138-2142, IEEE, March 2016. DOI: 10.1109/ICEEOT.2016.7755094. (Conference Paper)

R. Thakur, P. Banerjee, “Machine learning-based approach for voltage stability in renewable energy-based microgrids”, IEEE Transactions on Power Delivery, pp. 1-10, 2022. DOI: 10.1109/TPWRD.2022.3146697. (Article)

A. Sharma, V. Roy, “Advanced energy storage systems for voltage stability in microgrids”, in Energy Storage and Smart Grid Integration, Springer, pp. 789-801, 2022. DOI: 10.1007/978-981-16-8512-5_43. (Article)

J. Bilbao, E. Bravo, O. García, C. Rebollar, C. Varela, “Optimising energy management in hybrid microgrids”, Mathematics, Vol. 10, No. 2, Article 214, 2022. DOI: 10.3390/math10020214. (Article)

B. P. Ganthia, B. M. Praveen, S. R. Barkunan, A. V. G. A. Marthanda, N. M. G. Kumar, S. Kaliappan, “Energy management in hybrid PV-wind-battery storage-based microgrid using Monte Carlo optimization technique”, 2022. (Article)

S. E. Eyimaya, N. Altin, “Review of energy management systems in microgrids”, Applied Sciences, Vol. 14, No. 3, Article 1249, 2024. DOI: 10.3390/app14031249. (Article)

F. Agha Kassab, R. Rodriguez, B. Celik, F. Locment, M. Sechilariu, “A comprehensive review of sizing and energy management strategies for optimal planning of microgrids with pv and other renewable ?ntegration”, Applied Sciences, Vol. 14, No. 22, Article 10479, 2024. DOI: 10.3390/app142210479. (Article)

A. Esparza, M. Blondin, J. P. F. Trovão, “A review of optimization strategies for energy management in microgrids”, Energies, Vol. 18, No. 13, Article 3245, 2025. DOI: 10.3390/en18133245. (Article)

B. P. Ganthia, B. M. Praveen, S. R. Kabat, B. K. Mohapatra, R. Sethi, A. Buradi, “Energy management in hybrid PV-wind-battery storage-based microgrid using droop control technique”, 2022. (Article)

K. Zhou, Z. Fei, R. Hu, “Hybrid robust decentralized optimization of emission-aware multi-energy microgrids considering multiple uncertainties”, Energy, Vol. 265, Article 126405, 2023. DOI: 10.1016/j.energy.2022.126405. (Article)

T. Jeyaraj, A. Ponnusamy, D. Selvaraj, “Hybrid renewable energy systems stability analysis through future advancement technique: A review”, Applied Energy, Vol. 383, Article 125355, 2025. DOI: 10.1016/j.apenergy.2025.125355. (Article)

S. Sahu, B. K. Mohapatra, S. R. Kabat, S. Panda, S. Pahadasingh, B. P. Ganthia, “Multiple order harmonic elimination in photovoltaic system using SPWM based eleven level cascaded H-bridge multilevel inverter”, 2022. (Article)

M. Mohanty, N. Nayak, B. P. Ganthia, M. K. Behera, “Power smoothening of photovoltaic system using dynamic pso with esc under partial shading condition”, in 2023 International Conference in Advances in Power, Signal, and Information Technology (APSIT), pp. 675-680, IEEE, June 2023. DOI: 10.1109/APSIT58231.2023.10154467. (Conference Paper)

S. R. Kabat, C. K. Panigrahi, B. P. Ganthia, “Fuzzy logic based fault current prediction in double fed induction generator based wind turbine system”, Materials Today: Proceedings, Vol. 80, pp. 2530-2538, 2023. DOI: 10.1016/j.matpr.2022.11.395. (Conference Paper)

R. Chunduri, B. Gracelin, D. S. Vanaja, S. Priyadarshini, A. Khillo, B. P. Ganthia, “Design and control of a solar photovoltaic fed asymmetric multilevel inverter using computational intelligence”, Annals of the Romanian Society for Cell Biology, Vol. 25, No. 6, pp. 10471-10484, 2021. (Article)

K. Thenmalar, K. Kiruba, P. Raj, B. P. Ganthia, “A real time implementation of ANN controller to track maximum power point in solar photovoltaic system”, Annals of the Romanian Society for Cell Biology, Vol. 25, No. 6, pp. 10592-10607, 2021. (Article)

B. P. Ganthia, J. P. Ganthia, A. Sahu, R. K. Vadrevu, T. Patra, “Carbon reduction potential study in combined hybrid system for rural electrification”, Materials Today: Proceedings, Vol. 5, No. 1, pp. 234-240, 2018. DOI: 10.1016/j.matpr.2017.11.040. (Conference Paper)




DOI (PDF): https://doi.org/10.20508/ijsmartgrid.v9i3.379.g401

Refbacks

  • There are currently no refbacks.


www.ijsmartgrid.com; www.ijsmartgrid.org

ilhcol@gmail.com; icolak@gazi.edu.tr

Online ISSN: 2602-439X

Publisher: ilhami COLAK

https://www.ilhamicolak.org/english.htm

Cited in SCOPUS Q1, SCIMAGO, Google Scholar and CrossRef

 

 

LinkedIn Logo Follow us on LinkedIn

Google Scholar Statistics of ijSmartGrid

https://scholar.google.com/citations?user=qP9ZUKAAAAAJ&hl=tr&authuser=1 

 

SCIMAGO information:

https://www.scimagojr.com/journalsearch.php?q=21101271431&tip=sid&clean=0#google_vignette

Q2, h-index:13