Understanding Markov Chains

Examples and Applications

Nonfiction, Science & Nature, Mathematics, Statistics
Cover of the book Understanding Markov Chains by Nicolas Privault, Springer Singapore
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Nicolas Privault ISBN: 9789811306594
Publisher: Springer Singapore Publication: August 3, 2018
Imprint: Springer Language: English
Author: Nicolas Privault
ISBN: 9789811306594
Publisher: Springer Singapore
Publication: August 3, 2018
Imprint: Springer
Language: English

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

More books from Springer Singapore

Cover of the book High-Resolution Microwave Imaging by Nicolas Privault
Cover of the book A Tutorial Introduction to VHDL Programming by Nicolas Privault
Cover of the book Digital TV and Multimedia Communication by Nicolas Privault
Cover of the book Economy-Wide Modeling of Water at Regional and Global Scales by Nicolas Privault
Cover of the book A Research Report on the Development of China’s Manufacturing Sector (2016) by Nicolas Privault
Cover of the book Experimental and Kinetic Modeling Study of Cyclohexane and Its Mono-alkylated Derivatives Combustion by Nicolas Privault
Cover of the book Hydrogen Generation from Ethanol using Plasma Reforming Technology by Nicolas Privault
Cover of the book Bangladeshi Migration to Singapore by Nicolas Privault
Cover of the book Sustainable Luxury by Nicolas Privault
Cover of the book Proceedings of GeoShanghai 2018 International Conference: Ground Improvement and Geosynthetics by Nicolas Privault
Cover of the book Proceedings of International Conference on ICT for Sustainable Development by Nicolas Privault
Cover of the book India Bangladesh Domestic Politics by Nicolas Privault
Cover of the book Image and Graphics Technologies and Applications by Nicolas Privault
Cover of the book Language Across the Curriculum & CLIL in English as an Additional Language (EAL) Contexts by Nicolas Privault
Cover of the book Researching Conflict, Drama and Learning by Nicolas Privault
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy