Discrete Event Modeling and Simulation of Markov Decision Process.

Emanuele Barbieri

ISBN 10: 6206846695 / ISBN 13: 9786206846697

Edité par LAP LAMBERT Academic Publishing Nov 2023, 2023

A propos de cet article

Neuware -Markov Decision Process (MDP) models are widely used to model decision-making problems in many research fields. MDPs can be readily designed through modeling and simulation(M&S) using the Discrete Event System Specification formalism (DEVS) due to its modular and hierarchical aspects, which improve the explainability of the models. In particular, the separation between the agent and the environment components involved in the traditional reinforcement learning (RL) algorithm, such as Q-Learning, is clearly formalized to enhance observability and envision the integration of AI components in the decision-making process. Our proposed DEVS model also improves the trust of decision makers by mitigating the risk of delegation to machines in decision-making processes. The main focus of this work is to provide the possibility of designing a Markovian system with a modeling and simulation formalism to optimize a decision-making process with greater explainability through simulation. Furthermore, the work involves an investigation based on financial process management, its specification as an MDP-based RL system, and its M&S with DEVS formalism.Books on Demand GmbH, Überseering 33, 22297 Hamburg 168 pp. Englisch.

N° de réf. du vendeur 9786206846697

Détails bibliographiques

• Titre: Discrete Event Modeling and Simulation of Markov Decision Process.
• Éditeur: LAP LAMBERT Academic Publishing Nov 2023
• Date de parution: 2023
• Langue: anglais
• ISBN à 10 chiffres: 6206846695
• ISBN à 13 chiffres: 9786206846697
• Reliure: Taschenbuch
• État de l'article: Neu

A propos de ce titre

Synopsis

Markov Decision Process (MDP) models are widely used to model decision-making problems in many research fields. MDPs can be readily designed through modeling and simulation(M&S) using the Discrete Event System Specification formalism (DEVS) due to its modular and hierarchical aspects, which improve the explainability of the models. In particular, the separation between the agent and the environment components involved in the traditional reinforcement learning (RL) algorithm, such as Q-Learning, is clearly formalized to enhance observability and envision the integration of AI components in the decision-making process. Our proposed DEVS model also improves the trust of decision makers by mitigating the risk of delegation to machines in decision-making processes. The main focus of this work is to provide the possibility of designing a Markovian system with a modeling and simulation formalism to optimize a decision-making process with greater explainability through simulation. Furthermore, the work involves an investigation based on financial process management, its specification as an MDP-based RL system, and its M&S with DEVS formalism.