Image de l'éditeur

Constrained Markov Decision Processes (Hardback)

Etan Altman

0 avis par Goodreads
ISBN 10: 0849303826 / ISBN 13: 9780849303821
Edité par Taylor Francis Ltd, United States, 1999
Neuf(s) Etat : New Couverture rigide
Vendeur The Book Depository US (London, Royaume-Uni)

Vendeur AbeBooks depuis 10 septembre 2013

Quantité : 1
Acheter neuf
Prix conseillé : 169.95
Prix: EUR 122,48 Autre devise
Livraison : EUR 0 De Royaume-Uni vers Etats-Unis Destinations, frais et délais
Ajouter au panier

A propos de cet article

Language: English . Brand New Book. This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given. N° de réf. du libraire AA69780849303821

Poser une question au libraire

Détails bibliographiques

Titre : Constrained Markov Decision Processes (...

Éditeur : Taylor Francis Ltd, United States

Date d'édition : 1999

Reliure : Hardback

Etat du livre :New

A propos de ce titre

Synopsis :

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction.
The book is then divided into three sections that build upon each other.
The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques.
In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework.
The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Review:

"an outstanding addition to the MDPs literature and it complements." tstanding addition to the MDPs literature and it complements."

Les informations fournies dans la section « A propos du livre » peuvent faire référence à une autre édition de ce titre.

Description de la librairie

Book Depository is an international bookseller. We ship our books to over 100 countries around the globe and we are always looking to add more countries to the list. We really, really love books and offer millions of titles, currently over 10 million of them, with this figure increasing daily. Living by our motto, 'Bookseller to the World', we focus on offering as many titles as possible to as many customers as possible. Most of our titles are dispatched within 2 business days of your order. Apart from publishers, distributors and wholesalers, we even list and supply books from other retailers! We hope you enjoy our selection and discover your new favorite book.

Visitez la page d?accueil du vendeur

Conditions de vente :

All books are shipped in New condition promptly, we are happy to accept returns up to 30 days from purchase. Orders usually ship within 1-2 business days. Domestic Shipments are sent by Royal Mail, and International by Priority Airmail. We are happy to accept returns up to 30 days from purchase. Please contact the seller directly if you wish to return an order. Name of business : The Book Depository Ltd Form of legal entity : A Limited Company Business address: The Book Depository, 60 Holborn Vi...

Pour plus d'information
Conditions de livraison :

Orders usually ship within 1-2 business days. Domestic Shipments are sent by Royal Mail, and International by Priority Airmail. We are happy to accept returns up to 30 days from purchase. Please contact the seller directly if you wish to return an order.

Afficher le catalogue du vendeur

Modes de paiement
acceptés par le vendeur

Visa Mastercard American Express Carte Bleue