skip to content
Markov processes and controlled Markov chains Preview this item
ClosePreview this item
Checking...

Markov processes and controlled Markov chains

Author: Zhenting Hou; Jerzy A Filar; Anyue Chen
Publisher: Dordrecht : Kluwer Academic Publishers, [2002] ©2002
Edition/Format:   eBook : Document : Conference publication : EnglishView all editions and formats
Database:WorldCat
Summary:

Researchers in Markov processes and controlled Markov chains have been aware of the synergies between these two subject areas. This volume highlights these synergies and emphasizes the contributions  Read more...

Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

 

Find a copy online

Links to this item

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Genre/Form: Electronic books
Conference papers and proceedings
Congresses
Additional Physical Format: Print version:
International Workshop on Markov Processes and Controlled Markov Chains (1999 : Changsha, Hunan Sheng, China).
Markov processes and controlled Markov chains
(DLC) 2002030027
(OCoLC)50323026
Material Type: Conference publication, Document, Internet resource
Document Type: Internet Resource, Computer File
All Authors / Contributors: Zhenting Hou; Jerzy A Filar; Anyue Chen
ISBN: 9781461302650 146130265X
OCLC Number: 889240270
Description: 1 online resource (x, 511 pages) : illustrations
Contents: Preface. Part I: Markov processes. 1. Branching exit Markov system and their applications to partial differential equations; E.B. Dynkin. 2. Feller transition functions, resolvent decomposition theorems, and their application in unstable denumerable Markov processes; A. Chen, et al. 3. Identifying Q-processes with a given finite mu-invariant measure; P.K. Pollett. 4. Convergence property of standard transition functions; H. Zhang, et al. 5. Markov skeleton processes; H. Zhenting, et al. 6. Piecewise deterministic Markov processes and semi-dynamic systems; G. Liu. Part II: Controlled Markov chains and decision processes. 7. Average optimality for adaptive Markov control processes with unbounded costs and unknown disturbance distribution; J.A. Minjarez-Sosa. 8. Controlled Markov chains with utility functions; S. Iwamoto, et al. 9. Classification problems in MDPs; L.C.M. Kallenberg. 10. Optimality conditions for CTMDP with average cost criterion; X. Guo, W. Zhu. 11. Optimal and nearly optimal policies in Markov decision chains with nonnegative rewards and risk-sensitive expected total-reward criterion; R. Cavazos-Cadena, R. Montes-de-Oca. 12. Interval methods for uncertain Markov decision processes; M. Kurano, et al. 13. Constrained discounted semi-Markov decision processes; E.A. Feinberg. 14. Linear program for communication MDPs with multiple constraints; J.A. Filar, X. Guo. 15. Optimal switching problem for Markov chains; A.A. Yushkevich. 16.Approximations of a controlled diffusion model for renewable resource exploitation; S. Pasquali, W.J. Runggaldier. Part III: Stochastic processes and martingales. 17. A Fleming-Viot process with unbounded selection, II; S.N. Ethier, T. Shiga. 18. Boundary theory for superdiffusions; S.E. Kuznetsov. 19. On solutions of backward stochastic differential equations with jumps and stochastic control; S. Rong. 20. Doob's inequality and lower estimation of the maximum of martingales; L. Zhichan. 21. The Hausdorff measure of the level sets of Brownian motion on the Sierpinski carpet; Y. Chenggui, C. Xuerong. 22. Monotonic approximation of the Gittins index; X. Wang. Part IV: Applications to finance, control systems an other related fields. 23. Optimal consumption-investment decisions allowing for bankruptcy: A brief survey; S.P. Sethi. 24. The hedging strategy of an Asian option; Z. Yang, J. Zou. 25. The pricing of options to exchange one asset for another; C. Chen, et al. 26. Finite horizon portfolio risk models with probability criterion; Y. Lin, et al. 27. Long term average control of a local time process; M.S. Mendiondo, R.H. Stockbridge. 28. Singularly perturbed hybrid control systems approximated by structured linear programs; A. Haurie, et al. 29. The effect of stochastic disturbance on the solitary waves; J. Li, et al. 30. Independent candidate for Tierney model of H-M algorithms; P. Chen. 31. How rates of convergence for Gibbs fields depend on the interaction and the kinds of scanning used;
Responsibility: edited by Zhenting Hou, Jerzy A. Filar, and Anyue Chen.
More information:

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.

Similar Items

Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


Primary Entity

<http://www.worldcat.org/oclc/889240270> # Markov processes and controlled Markov chains
    a schema:CreativeWork, schema:Book, schema:MediaObject ;
    library:oclcnum "889240270" ;
    library:placeOfPublication <http://id.loc.gov/vocabulary/countries/ne> ;
    schema:about <http://dewey.info/class/519.233/e22/> ;
    schema:about <http://experiment.worldcat.org/entity/work/data/1042791#Topic/markov_processes> ; # Markov processes
    schema:bookFormat schema:EBook ;
    schema:creator <http://experiment.worldcat.org/entity/work/data/1042791#Meeting/international_workshop_on_markov_processes_and_controlled_markov_chains_1999_changsha_hunan_sheng_china> ; # International Workshop on Markov Processes and Controlled Markov Chains (1999 : Changsha, Hunan Sheng, China)
    schema:datePublished "2002" ;
    schema:editor <http://experiment.worldcat.org/entity/work/data/1042791#Person/chen_anyue> ; # Anyue Chen
    schema:editor <http://experiment.worldcat.org/entity/work/data/1042791#Person/filar_jerzy_a_1949> ; # Jerzy A. Filar
    schema:editor <http://experiment.worldcat.org/entity/work/data/1042791#Person/hou_zhenting> ; # Zhenting Hou
    schema:exampleOfWork <http://worldcat.org/entity/work/id/1042791> ;
    schema:genre "Conference publication"@en ;
    schema:genre "Conference papers and proceedings"@en ;
    schema:genre "Electronic books"@en ;
    schema:inLanguage "en" ;
    schema:isSimilarTo <http://www.worldcat.org/oclc/50323026> ;
    schema:name "Markov processes and controlled Markov chains"@en ;
    schema:productID "889240270" ;
    schema:url <http://dx.doi.org/10.1007/978-1-4613-0265-0> ;
    schema:workExample <http://worldcat.org/isbn/9781461302650> ;
    schema:workExample <http://dx.doi.org/10.1007/978-1-4613-0265-0> ;
    wdrs:describedby <http://www.worldcat.org/title/-/oclc/889240270> ;
    .


Related Entities

<http://experiment.worldcat.org/entity/work/data/1042791#Meeting/international_workshop_on_markov_processes_and_controlled_markov_chains_1999_changsha_hunan_sheng_china> # International Workshop on Markov Processes and Controlled Markov Chains (1999 : Changsha, Hunan Sheng, China)
    a bgn:Meeting, schema:Event ;
    schema:location <http://experiment.worldcat.org/entity/work/data/1042791#Place/changsha_hunan_sheng_china> ; # Changsha, Hunan Sheng, China)
    schema:name "International Workshop on Markov Processes and Controlled Markov Chains (1999 : Changsha, Hunan Sheng, China)" ;
    .

<http://experiment.worldcat.org/entity/work/data/1042791#Person/chen_anyue> # Anyue Chen
    a schema:Person ;
    schema:familyName "Chen" ;
    schema:givenName "Anyue" ;
    schema:name "Anyue Chen" ;
    .

<http://experiment.worldcat.org/entity/work/data/1042791#Person/filar_jerzy_a_1949> # Jerzy A. Filar
    a schema:Person ;
    schema:birthDate "1949" ;
    schema:familyName "Filar" ;
    schema:givenName "Jerzy A." ;
    schema:name "Jerzy A. Filar" ;
    .

<http://experiment.worldcat.org/entity/work/data/1042791#Person/hou_zhenting> # Zhenting Hou
    a schema:Person ;
    schema:familyName "Hou" ;
    schema:givenName "Zhenting" ;
    schema:name "Zhenting Hou" ;
    .

<http://experiment.worldcat.org/entity/work/data/1042791#Place/changsha_hunan_sheng_china> # Changsha, Hunan Sheng, China)
    a schema:Place ;
    schema:name "Changsha, Hunan Sheng, China)" ;
    .

<http://experiment.worldcat.org/entity/work/data/1042791#Topic/markov_processes> # Markov processes
    a schema:Intangible ;
    schema:name "Markov processes"@en ;
    .

<http://worldcat.org/isbn/9781461302650>
    a schema:ProductModel ;
    schema:isbn "146130265X" ;
    schema:isbn "9781461302650" ;
    .

<http://www.worldcat.org/oclc/50323026>
    a schema:CreativeWork ;
    rdfs:label "Markov processes and controlled Markov chains" ;
    schema:description "Print version:" ;
    schema:isSimilarTo <http://www.worldcat.org/oclc/889240270> ; # Markov processes and controlled Markov chains
    .


Content-negotiable representations

Close Window

Please sign in to WorldCat 

Don't have an account? You can easily create a free account.