Multi-Objective Decision Making

Nonfiction, Computers, Advanced Computing, Artificial Intelligence, General Computing, Programming
Cover of the book Multi-Objective Decision Making by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone, Morgan & Claypool Publishers
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone ISBN: 9781681731827
Publisher: Morgan & Claypool Publishers Publication: April 20, 2017
Imprint: Morgan & Claypool Publishers Language: English
Author: Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
ISBN: 9781681731827
Publisher: Morgan & Claypool Publishers
Publication: April 20, 2017
Imprint: Morgan & Claypool Publishers
Language: English

Many real-world decision problems have multiple objectives. For example, when choosing a medical treatment plan, we want to maximize the efficacy of the treatment, but also minimize the side effects. These objectives typically conflict, e.g., we can often increase the efficacy of the treatment, but at the cost of more severe side effects. In this book, we outline how to deal with multiple objectives in decision-theoretic planning and reinforcement learning algorithms. To illustrate this, we employ the popular problem classes of multi-objective Markov decision processes (MOMDPs) and multi-objective coordination graphs (MO-CoGs).

First, we discuss different use cases for multi-objective decision making, and why they often necessitate explicitly multi-objective algorithms. We advocate a utility-based approach to multi-objective decision making, i.e., that what constitutes an optimal solution to a multi-objective decision problem should be derived from the available information about user utility. We show how different assumptions about user utility and what types of policies are allowed lead to different solution concepts, which we outline in a taxonomy of multi-objective decision problems.

Second, we show how to create new methods for multi-objective decision making using existing single-objective methods as a basis. Focusing on planning, we describe two ways to creating multi-objective algorithms: in the inner loop approach, the inner workings of a single-objective method are adapted to work with multi-objective solution concepts; in the outer loop approach, a wrapper is created around a single-objective method that solves the multi-objective problem as a series of single-objective problems. After discussing the creation of such methods for the planning setting, we discuss how these approaches apply to the learning setting.

Next, we discuss three promising application domains for multi-objective decision making algorithms: energy, health, and infrastructure and transportation. Finally, we conclude by outlining important open problems and promising future directions.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

Many real-world decision problems have multiple objectives. For example, when choosing a medical treatment plan, we want to maximize the efficacy of the treatment, but also minimize the side effects. These objectives typically conflict, e.g., we can often increase the efficacy of the treatment, but at the cost of more severe side effects. In this book, we outline how to deal with multiple objectives in decision-theoretic planning and reinforcement learning algorithms. To illustrate this, we employ the popular problem classes of multi-objective Markov decision processes (MOMDPs) and multi-objective coordination graphs (MO-CoGs).

First, we discuss different use cases for multi-objective decision making, and why they often necessitate explicitly multi-objective algorithms. We advocate a utility-based approach to multi-objective decision making, i.e., that what constitutes an optimal solution to a multi-objective decision problem should be derived from the available information about user utility. We show how different assumptions about user utility and what types of policies are allowed lead to different solution concepts, which we outline in a taxonomy of multi-objective decision problems.

Second, we show how to create new methods for multi-objective decision making using existing single-objective methods as a basis. Focusing on planning, we describe two ways to creating multi-objective algorithms: in the inner loop approach, the inner workings of a single-objective method are adapted to work with multi-objective solution concepts; in the outer loop approach, a wrapper is created around a single-objective method that solves the multi-objective problem as a series of single-objective problems. After discussing the creation of such methods for the planning setting, we discuss how these approaches apply to the learning setting.

Next, we discuss three promising application domains for multi-objective decision making algorithms: energy, health, and infrastructure and transportation. Finally, we conclude by outlining important open problems and promising future directions.

More books from Morgan & Claypool Publishers

Cover of the book Atomic Bomb: The Story of the Manhattan Project by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Search-Based Applications by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Theories of Matter, Space, and Time by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Relativity, Symmetry and the Structure of the Quantum Theory by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Special and General Relativity by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Lectures on Selected Topics in Mathematical Physics by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Communication Networks by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Maple by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book On the Efficient Determination of Most Near Neighbors by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Hard Problems in Software Testing by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Quantum Chemistry by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Smart Internal Stimulus-Responsive Nanocarriers for Drug and Gene Delivery by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Customizable Computing by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Relativity, Symmetry, and the Structure of Quantum Theory, Volume 2 by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
Cover of the book Lattice Boltzmann Modeling of Complex Flows for Engineering Applications by Diederik M. Roijers, Shimon Whiteson, Ronald Brachman, Peter Stone
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy