skip to content
Discrete dynamic programming with a small interest rate. Preview this item
ClosePreview this item
Checking...

Discrete dynamic programming with a small interest rate.

Author: Bruce L Miller; Arthur F Jr Veinott; STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
Publisher: Ft. Belvoir Defense Technical Information Center 31 MAY 1968.
Edition/Format:   Print book : EnglishView all editions and formats
Database:WorldCat
Summary:
In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result  Read more...
Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

 

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Document Type: Book
All Authors / Contributors: Bruce L Miller; Arthur F Jr Veinott; STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
OCLC Number: 227497920
Notes: Prepared in cooperation with the RAND Corp., Santa Monica, Calif., Contract F44620-67-C-0045; Grant NSF-GK-1420.
Description: 15 pages

Abstract:

In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result constructively by devising a finite policy improvement method for finding stationary optimal policies. The algorithm is based on a new representation of the vector of expected discounted returns under a stationary policy as a power series in the interest rate for all small enough rho> 0. (Author).

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.
Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


Primary Entity

<http://www.worldcat.org/oclc/227497920> # Discrete dynamic programming with a small interest rate.
    a schema:Book, schema:CreativeWork ;
   library:oclcnum "227497920" ;
   library:placeOfPublication <http://id.loc.gov/vocabulary/countries/vau> ;
   library:placeOfPublication <http://experiment.worldcat.org/entity/work/data/3768507252#Place/ft_belvoir> ; # Ft. Belvoir
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Thing/stationary_processes> ; # STATIONARY PROCESSES
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/decision_theory> ; # Decision theory
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/operations_research> ; # Operations Research
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/optimization> ; # Optimization
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/power_series> ; # Power series
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/statistical_processes> ; # Statistical processes)
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Thing/interest_rates> ; # INTEREST RATES
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/theorems> ; # Theorems
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/algorithms> ; # Algorithms
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/money> ; # Money
   schema:about <http://experiment.worldcat.org/entity/work/data/3768507252#Topic/dynamic_programming> ; # (Dynamic programming
   schema:bookFormat bgn:PrintBook ;
   schema:contributor <http://experiment.worldcat.org/entity/work/data/3768507252#Person/miller_bruce_l> ; # Bruce L. Miller
   schema:contributor <http://experiment.worldcat.org/entity/work/data/3768507252#Organization/stanford_univ_calif_dept_of_operations_research> ; # STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
   schema:contributor <http://experiment.worldcat.org/entity/work/data/3768507252#Person/veinott_arthur_f_jr> ; # Arthur F Jr Veinott
   schema:datePublished "1968" ;
   schema:datePublished "31 MAY 1968" ;
   schema:description "In a fundamental paper on stationary finite state and action Markovian decision processes, Blackwell defines an optimal policy to be one that maximizes the expected total discounted rewards for all sufficiently small interest rates rho> 0. He also establishes the existence of a stationary optimal policy by a limit process that does not give a finite algorithm. The purpose of this paper is to prove this result constructively by devising a finite policy improvement method for finding stationary optimal policies. The algorithm is based on a new representation of the vector of expected discounted returns under a stationary policy as a power series in the interest rate for all small enough rho> 0. (Author)."@en ;
   schema:exampleOfWork <http://worldcat.org/entity/work/id/3768507252> ;
   schema:inLanguage "en" ;
   schema:name "Discrete dynamic programming with a small interest rate."@en ;
   schema:productID "227497920" ;
   schema:publication <http://www.worldcat.org/title/-/oclc/227497920#PublicationEvent/ft_belvoirdefense_technical_information_center31_may_1968> ;
   schema:publisher <http://experiment.worldcat.org/entity/work/data/3768507252#Agent/defense_technical_information_center> ; # Defense Technical Information Center
   wdrs:describedby <http://www.worldcat.org/title/-/oclc/227497920> ;
    .


Related Entities

<http://experiment.worldcat.org/entity/work/data/3768507252#Agent/defense_technical_information_center> # Defense Technical Information Center
    a bgn:Agent ;
   schema:name "Defense Technical Information Center" ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Organization/stanford_univ_calif_dept_of_operations_research> # STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH.
    a schema:Organization ;
   schema:name "STANFORD UNIV CALIF Dept. of OPERATIONS RESEARCH." ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Person/miller_bruce_l> # Bruce L. Miller
    a schema:Person ;
   schema:familyName "Miller" ;
   schema:givenName "Bruce L." ;
   schema:name "Bruce L. Miller" ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Person/veinott_arthur_f_jr> # Arthur F Jr Veinott
    a schema:Person ;
   schema:familyName "Veinott" ;
   schema:givenName "Arthur F Jr" ;
   schema:name "Arthur F Jr Veinott" ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Thing/stationary_processes> # STATIONARY PROCESSES
    a schema:Thing ;
   schema:name "STATIONARY PROCESSES" ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Topic/dynamic_programming> # (Dynamic programming
    a schema:Intangible ;
   schema:name "(Dynamic programming"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Topic/operations_research> # Operations Research
    a schema:Intangible ;
   schema:name "Operations Research"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/3768507252#Topic/statistical_processes> # Statistical processes)
    a schema:Intangible ;
   schema:name "Statistical processes)"@en ;
    .


Content-negotiable representations

Close Window

Please sign in to WorldCat 

Don't have an account? You can easily create a free account.