Markov Chains

Theory and Applications

Nonfiction, Science & Nature, Mathematics, Applied
Cover of the book Markov Chains by Bruno Sericola, Wiley
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Bruno Sericola ISBN: 9781118731536
Publisher: Wiley Publication: August 5, 2013
Imprint: Wiley-ISTE Language: English
Author: Bruno Sericola
ISBN: 9781118731536
Publisher: Wiley
Publication: August 5, 2013
Imprint: Wiley-ISTE
Language: English

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

More books from Wiley

Cover of the book Optimal Control by Bruno Sericola
Cover of the book Building Chicken Coops For Dummies by Bruno Sericola
Cover of the book Breed Predispositions to Disease in Dogs and Cats by Bruno Sericola
Cover of the book The Social Media MBA by Bruno Sericola
Cover of the book Edward Said by Bruno Sericola
Cover of the book Guide to Good Practice in the Management of Time in Major Projects by Bruno Sericola
Cover of the book Click Here by Bruno Sericola
Cover of the book Bayesian Biostatistics by Bruno Sericola
Cover of the book Using Evidence of Student Learning to Improve Higher Education by Bruno Sericola
Cover of the book The Human Footprint by Bruno Sericola
Cover of the book Integrated Tracking, Classification, and Sensor Management by Bruno Sericola
Cover of the book Financial Advice and Investment Decisions by Bruno Sericola
Cover of the book Protein Engineering Handbook by Bruno Sericola
Cover of the book In Defense of Universal Human Rights by Bruno Sericola
Cover of the book More Than Money by Bruno Sericola
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy