skip to content
Discrete dynamic programming with a small interest rate. Preview this item
ClosePreview this item
Checking...

Discrete dynamic programming with a small interest rate.

Author: Bruce L Miller; Arthur F Jr Veinott; STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
Publisher: Ft. Belvoir Defense Technical Information Center 31 MAY 1968.
Edition/Format:   Print book : English
Database:WorldCat
Summary:
In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result  Read more...
Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

 

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Document Type: Book
All Authors / Contributors: Bruce L Miller; Arthur F Jr Veinott; STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
OCLC Number: 227497920
Notes: Prepared in cooperation with the RAND Corp., Santa Monica, Calif., Contract F44620-67-C-0045; Grant NSF-GK-1420.
Description: 15 pages

Abstract:

In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result constructively by devising a finite policy improvement method for finding stationary optimal policies. The algorithm is based on a new representation of the vector of expected discounted returns under a stationary policy as a power series in the interest rate for all small enough rho> 0. (Author).

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.
Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


Primary Entity

<http://www.worldcat.org/oclc/227497920> # Discrete dynamic programming with a small interest rate.
    a schema:Book, schema:CreativeWork ;
    library:oclcnum "227497920" ;
    library:placeOfPublication <http://id.loc.gov/vocabulary/countries/vau> ;
    library:placeOfPublication <http://experiment.worldcat.org/entity/work/data/102106421#Place/ft_belvoir> ; # Ft. Belvoir
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/money> ; # Money
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/operations_research> ; # Operations Research
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/algorithms> ; # Algorithms
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/decision_theory> ; # Decision theory
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/statistical_processes> ; # Statistical processes)
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/theorems> ; # Theorems
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/optimization> ; # Optimization
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/power_series> ; # Power series
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Topic/dynamic_programming> ; # (Dynamic programming
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Thing/stationary_processes> ; # STATIONARY PROCESSES
    schema:about <http://experiment.worldcat.org/entity/work/data/102106421#Thing/interest_rates> ; # INTEREST RATES
    schema:bookFormat bgn:PrintBook ;
    schema:contributor <http://experiment.worldcat.org/entity/work/data/102106421#Person/veinott_arthur_f_jr> ; # Arthur F Jr Veinott
    schema:contributor <http://experiment.worldcat.org/entity/work/data/102106421#Organization/stanford_univ_calif_dept_of_operations_research> ; # STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
    schema:contributor <http://viaf.org/viaf/110960411> ; # Bruce L. Miller
    schema:datePublished "1968" ;
    schema:datePublished "31 MAY 1968" ;
    schema:description "In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result constructively by devising a finite policy improvement method for finding stationary optimal policies. The algorithm is based on a new representation of the vector of expected discounted returns under a stationary policy as a power series in the interest rate for all small enough rho> 0. (Author)."@en ;
    schema:exampleOfWork <http://worldcat.org/entity/work/id/102106421> ;
    schema:inLanguage "en" ;
    schema:name "Discrete dynamic programming with a small interest rate."@en ;
    schema:productID "227497920" ;
    schema:publication <http://www.worldcat.org/title/-/oclc/227497920#PublicationEvent/ft_belvoirdefense_technical_information_center31_may_1968> ;
    schema:publisher <http://experiment.worldcat.org/entity/work/data/102106421#Agent/defense_technical_information_center> ; # Defense Technical Information Center
    wdrs:describedby <http://www.worldcat.org/title/-/oclc/227497920> ;
    .


Related Entities

<http://experiment.worldcat.org/entity/work/data/102106421#Agent/defense_technical_information_center> # Defense Technical Information Center
    a bgn:Agent ;
    schema:name "Defense Technical Information Center" ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Organization/stanford_univ_calif_dept_of_operations_research> # STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
    a schema:Organization ;
    schema:name "STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH." ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Person/veinott_arthur_f_jr> # Arthur F Jr Veinott
    a schema:Person ;
    schema:familyName "Veinott" ;
    schema:givenName "Arthur F Jr" ;
    schema:name "Arthur F Jr Veinott" ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Thing/interest_rates> # INTEREST RATES
    a schema:Thing ;
    schema:name "INTEREST RATES" ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Thing/stationary_processes> # STATIONARY PROCESSES
    a schema:Thing ;
    schema:name "STATIONARY PROCESSES" ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Topic/dynamic_programming> # (Dynamic programming
    a schema:Intangible ;
    schema:name "(Dynamic programming"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Topic/operations_research> # Operations Research
    a schema:Intangible ;
    schema:name "Operations Research"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/102106421#Topic/statistical_processes> # Statistical processes)
    a schema:Intangible ;
    schema:name "Statistical processes)"@en ;
    .

<http://viaf.org/viaf/110960411> # Bruce L. Miller
    a schema:Person ;
    schema:familyName "Miller" ;
    schema:givenName "Bruce L." ;
    schema:name "Bruce L. Miller" ;
    .


Content-negotiable representations

Close Window

Please sign in to WorldCat 

Don't have an account? You can easily create a free account.