Markov Decision Processes in Practice

Business & Finance, Management & Leadership, Operations Research, Nonfiction, Science & Nature, Mathematics, Statistics
Cover of the book Markov Decision Processes in Practice by , Springer International Publishing
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: ISBN: 9783319477664
Publisher: Springer International Publishing Publication: March 10, 2017
Imprint: Springer Language: English
Author:
ISBN: 9783319477664
Publisher: Springer International Publishing
Publication: March 10, 2017
Imprint: Springer
Language: English

This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach.  The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation.  This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car . Part 4 contains three chapters that illustrates the structure of approximate policies for  production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach.  The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation.  This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car . Part 4 contains three chapters that illustrates the structure of approximate policies for  production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.

More books from Springer International Publishing

Cover of the book Ethical and Secure Computing by
Cover of the book Patch-Based Techniques in Medical Imaging by
Cover of the book Disparity and Discrimination in Labour Market Outcomes in India by
Cover of the book Intravascular Imaging and Computer Assisted Stenting and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis by
Cover of the book Intermediation and Representation in Latin America by
Cover of the book Handbook of Deep Learning Applications by
Cover of the book Advances in Algebraic Quantum Field Theory by
Cover of the book Cartography of the Sun and the Stars by
Cover of the book Processes of Believing: The Acquisition, Maintenance, and Change in Creditions by
Cover of the book Soil Dynamics and Soil-Structure Interaction for Resilient Infrastructure by
Cover of the book Neoclassical Physics by
Cover of the book Relativity for Everyone by
Cover of the book Organic Cation Transporters by
Cover of the book MRI of Degenerative Disease of the Spine by
Cover of the book Advanced Procedures for Pain Management by
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy