A novel nested stochastic dynamic programming (nSDP) and nested reinforcement learning (nRL) algorithm for multipurpose reservoir optimization

Delipetrev, Blagoj and Jonoski, Andreja and Solomatine, Dimitri P (2017) A novel nested stochastic dynamic programming (nSDP) and nested reinforcement learning (nRL) algorithm for multipurpose reservoir optimization. Journal of Hydroinformatics, 19 (1). pp. 47-61.

Text 9. A novel nested stochastic dynamic programming (nSDP) and nested reinforcement learning (nRL) algorithm for.pdf Download (564kB)

Abstract

In this article we present two novel multipurpose reservoir optimization algorithms named nested stochastic dynamic programming (nSDP) and nested reinforcement learning (nRL). Both algorithms are built as a combination of two algorithms; in the nSDP case it is (1) stochastic dynamic programming (SDP) and (2) nested optimal allocation algorithm (nOAA) and in the nRL case it is (1) reinforcement learning (RL) and (2) nOAA. The nOAA is implemented with linear and non-linear optimization. The main novel idea is to include a nOAA at each SDP and RL state transition, that decreases starting problem dimension and alleviates curse of dimensionality. Both nSDP and nRL can solve multi-objective optimization problems without significant computational expenses and algorithm complexity and can handle dense and irregular variable discretization. The two algorithms were coded in Java as a prototype application and on the Knezevo reservoir, located in the Republic of Macedonia. The nSDP and nRL optimal reservoir policies were compared with nested dynamic programming policies, and overall conclusion is that nRL is more powerful, but significantly more complex than nSDP.

Item Type:	Article
Impact Factor Value:	2
Subjects:	Natural sciences > Computer and information sciences
Divisions:	Faculty of Computer Science
Depositing User:	Blagoj Delipetrev
Date Deposited:	06 May 2021 13:08
Last Modified:	06 May 2021 13:08
URI:	https://eprints.ugd.edu.mk/id/eprint/28053

Actions (login required)

View Item