Preview this item
Preview this item
Checking...

# Markov chains : from theory to implementation and experimentation

Author: Paul A Gagniuc Hoboken, NJ : John Wiley & Sons, [2017] eBook : Document : EnglishView all editions and formats 'A fascinating and instructive guide to Markov chains for experienced users and newcomers alike This unique guide to Markov chains approaches the subject along the four convergent lines of mathematics, implementation, simulation, and experimentation. It introduces readers to the art of stochastic modeling, shows how to design computer implementations, and provides extensive worked examples with case studies. Markov Chains: From Theory to Implementation and Experimentation begins with a general introduction to the history of probability theory in which the author uses quantifiable examples to illustrate how probability theory arrived at the concept of discrete-time and the Markov model from experiments involving independent variables. An introduction to simple stochastic matrices and transition probabilities is followed by a simulation of a two-state Markov chain. The notion of steady state is explored in connection with the long-run distribution behavior of the Markov chain. Predictions based on Markov chains with more than two states are examined, followed by a discussion of the notion of absorbing Markov chains. Also covered in detail are topics relating to the average time spent in a state, various chain configurations, and n-state Markov chain simulations used for verifying experiments involving various diagram configurations. - Fascinating historical notes shed light on the key ideas that led to the development of the Markov model and its variants - Various configurations of Markov Chains and their limitations are explored at length - Numerous examples'from basic to complex'are presented in a comparative manner using a variety of color graphics - All algorithms presented can be analyzed in either Visual Basic, Java Script, or PHP - Designed to be useful to professional statisticians as well as readers without extensive knowledge of probability theory Covering both the theory underlying the Markov model and an array of Markov chain implementations, within a common conceptual framework, Markov Chains: From Theory to Implementation and Experimentation is a stimulating introduction to and a valuable reference for those wishing to deepen their understanding of this extremely valuable statistical tool. Paul A. Gagniuc, PhD, is Associate Professor at Polytechnic University of Bucharest, Romania. He obtained his MS and his PhD in genetics at the University of Bucharest. Dr. Gagniuc's work has been published in numerous high profile scientific journals, ranging from the Public Library of Science to BioMed Central and Nature journals. He is the recipient of several awards for exceptional scientific results and a highly active figure in the review process for different scientific areas.  Read more... (not yet rated) 0 with reviews - Be the first.

## Find a copy in the library

Finding libraries that hold this item...

## Details

Genre/Form: Electronic books Print version:Gagniuc, Paul A.Markov chains.Hoboken, NJ : John Wiley & Sons, 2017(DLC) 2017011637 Document, Internet resource Internet Resource, Computer File Paul A Gagniuc Find more information about: Paul A Gagniuc 9781119387572 1119387574 9781119387596 1119387590 982373850 1 online resource From observation to simulation -- Building the stochastic matrix -- Predictions by using 2-state Markov chains -- Predictions by using N-state Markov chains -- Absorbing Markov chains -- The average time spent in each state -- Discussions on different configurations of chains -- The simulation of an N-state Markov chain. Paul A. Gagniuc.

### Abstract:

A fascinating and instructive guide to Markov chains for experienced users and newcomers alike This unique guide to Markov chains approaches the subject along the four convergent lines of  Read more...

## Reviews

User-contributed reviews

Be the first.

## Similar Items

### Related Subjects:(3)

Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

### Primary Entity

<http://www.worldcat.org/oclc/982373850> # Markov chains : from theory to implementation and experimentation
a schema:MediaObject, schema:CreativeWork, schema:Book ;
library:oclcnum "982373850" ;
library:placeOfPublication <http://id.loc.gov/vocabulary/countries/nju> ;
schema:about <http://experiment.worldcat.org/entity/work/data/4014319258#Topic/markov_processes> ; # Markov processes
schema:about <http://experiment.worldcat.org/entity/work/data/4014319258#Topic/mathematics_probability_&_statistics_general> ; # MATHEMATICS--Probability & Statistics--General
schema:author <http://experiment.worldcat.org/entity/work/data/4014319258#Person/gagniuc_paul_a> ; # Paul A. Gagniuc
schema:bookFormat schema:EBook ;
schema:datePublished "2017" ;
schema:description "'A fascinating and instructive guide to Markov chains for experienced users and newcomers alike This unique guide to Markov chains approaches the subject along the four convergent lines of mathematics, implementation, simulation, and experimentation. It introduces readers to the art of stochastic modeling, shows how to design computer implementations, and provides extensive worked examples with case studies. Markov Chains: From Theory to Implementation and Experimentation begins with a general introduction to the history of probability theory in which the author uses quantifiable examples to illustrate how probability theory arrived at the concept of discrete-time and the Markov model from experiments involving independent variables. An introduction to simple stochastic matrices and transition probabilities is followed by a simulation of a two-state Markov chain. The notion of steady state is explored in connection with the long-run distribution behavior of the Markov chain. Predictions based on Markov chains with more than two states are examined, followed by a discussion of the notion of absorbing Markov chains. Also covered in detail are topics relating to the average time spent in a state, various chain configurations, and n-state Markov chain simulations used for verifying experiments involving various diagram configurations. - Fascinating historical notes shed light on the key ideas that led to the development of the Markov model and its variants - Various configurations of Markov Chains and their limitations are explored at length - Numerous examples'from basic to complex'are presented in a comparative manner using a variety of color graphics - All algorithms presented can be analyzed in either Visual Basic, Java Script, or PHP - Designed to be useful to professional statisticians as well as readers without extensive knowledge of probability theory Covering both the theory underlying the Markov model and an array of Markov chain implementations, within a common conceptual framework, Markov Chains: From Theory to Implementation and Experimentation is a stimulating introduction to and a valuable reference for those wishing to deepen their understanding of this extremely valuable statistical tool. Paul A. Gagniuc, PhD, is Associate Professor at Polytechnic University of Bucharest, Romania. He obtained his MS and his PhD in genetics at the University of Bucharest. Dr. Gagniuc's work has been published in numerous high profile scientific journals, ranging from the Public Library of Science to BioMed Central and Nature journals. He is the recipient of several awards for exceptional scientific results and a highly active figure in the review process for different scientific areas."@en ;
schema:description "From observation to simulation -- Building the stochastic matrix -- Predictions by using 2-state Markov chains -- Predictions by using N-state Markov chains -- Absorbing Markov chains -- The average time spent in each state -- Discussions on different configurations of chains -- The simulation of an N-state Markov chain."@en ;
schema:exampleOfWork <http://worldcat.org/entity/work/id/4014319258> ;
schema:genre "Electronic books"@en ;
schema:inLanguage "en" ;
schema:isSimilarTo <http://worldcat.org/entity/work/data/4014319258#CreativeWork/markov_chains> ;
schema:name "Markov chains : from theory to implementation and experimentation"@en ;
schema:productID "982373850" ;
schema:url <http://VH7QX3XE2P.search.serialssolutions.com/?V=1.0&L=VH7QX3XE2P&S=JCs&C=TC0001834148&T=marc&tab=BOOKS> ;
schema:url <http://onlinelibrary.wiley.com/book/10.1002/9781119387596> ;
schema:url <http://0-onlinelibrary.wiley.com.pugwash.lib.warwick.ac.uk/doi/book/10.1002/9781119387596> ;
schema:url <http://public.ebookcentral.proquest.com/choice/publicfullrecord.aspx?p=4908192> ;
schema:url <http://dx.doi.org/10.1002/9781119387596> ;
schema:url <http://swbplus.bsz-bw.de/bsz493821244cov.htm> ;
schema:url <https://onlinelibrary.wiley.com/doi/book/10.1002/9781119387596> ;
schema:url <http://www.myilibrary.com?id=1020902> ;
schema:url <http://rbdigital.rbdigital.com> ;
schema:workExample <http://worldcat.org/isbn/9781119387596> ;
schema:workExample <http://worldcat.org/isbn/9781119387572> ;
wdrs:describedby <http://www.worldcat.org/title/-/oclc/982373850> ;
.

### Related Entities

<http://experiment.worldcat.org/entity/work/data/4014319258#Person/gagniuc_paul_a> # Paul A. Gagniuc
a schema:Person ;
schema:familyName "Gagniuc" ;
schema:givenName "Paul A." ;
schema:name "Paul A. Gagniuc" ;
.

<http://experiment.worldcat.org/entity/work/data/4014319258#Topic/mathematics_applied> # MATHEMATICS--Applied
a schema:Intangible ;
schema:name "MATHEMATICS--Applied"@en ;
.

<http://experiment.worldcat.org/entity/work/data/4014319258#Topic/mathematics_probability_&_statistics_general> # MATHEMATICS--Probability & Statistics--General
a schema:Intangible ;
schema:name "MATHEMATICS--Probability & Statistics--General"@en ;
.

<http://worldcat.org/entity/work/data/4014319258#CreativeWork/markov_chains>
a schema:CreativeWork ;
rdfs:label "Markov chains." ;
schema:description "Print version:" ;
schema:isSimilarTo <http://www.worldcat.org/oclc/982373850> ; # Markov chains : from theory to implementation and experimentation
.

<http://worldcat.org/isbn/9781119387572>
a schema:ProductModel ;
schema:isbn "1119387574" ;
schema:isbn "9781119387572" ;
.

<http://worldcat.org/isbn/9781119387596>
a schema:ProductModel ;
schema:isbn "1119387590" ;
schema:isbn "9781119387596" ;
.

Content-negotiable representations