Everand Logo

Welcome to Everand!

  • Discover millions of ebooks, audiobooks, and so much more with a free trial

    Only $11.99/month after trial. Cancel anytime.

    Introduction to Stochastic Dynamic Programming
    Introduction to Stochastic Dynamic Programming
    Introduction to Stochastic Dynamic Programming
    Ebook130 pages2 hours

    Introduction to Stochastic Dynamic Programming

    By Sheldon M. Ross

    ()

    Read preview

    About this ebook

    Introduction to Stochastic Dynamic Programming presents the basic theory and examines the scope of applications of stochastic dynamic programming. The book begins with a chapter on various finite-stage models, illustrating the wide range of applications of stochastic dynamic programming. Subsequent chapters study infinite-stage models: discounting future returns, minimizing nonnegative costs, maximizing nonnegative returns, and maximizing the long-run average return. Each of these chapters first considers whether an optimal policy need exist—providing counterexamples where appropriate—and then presents methods for obtaining such policies when they do. In addition, general areas of application are presented. The final two chapters are concerned with more specialized models. These include stochastic scheduling models and a type of process known as a multiproject bandit. The mathematical prerequisites for this text are relatively few. No prior knowledge of dynamic programming is assumed and only a moderate familiarity with probability— including the use of conditional expectation—is necessary.
    LanguageEnglish
    PublisherAcademic Press
    Release dateJul 10, 2014
    ISBN9781483269092
    Introduction to Stochastic Dynamic Programming
    Author

    Sheldon M. Ross

    Dr. Sheldon M. Ross is a professor in the Department of Industrial and Systems Engineering at the University of Southern California. He received his PhD in statistics at Stanford University in 1968. He has published many technical articles and textbooks in the areas of statistics and applied probability. Among his texts are A First Course in Probability, Introduction to Probability Models, Stochastic Processes, and Introductory Statistics. Professor Ross is the founding and continuing editor of the journal Probability in the Engineering and Informational Sciences. He is a Fellow of the Institute of Mathematical Statistics, a Fellow of INFORMS, and a recipient of the Humboldt US Senior Scientist Award.

    Read more from Sheldon M. Ross

    Related to Introduction to Stochastic Dynamic Programming

    Related ebooks

    Mathematics For You

    View More
    View More

    Related podcast episodes

    Related articles

    • Article

      Why I Hate Monte Carlo Analysis and Other Financial Projections

      Aug 14, 2019

      I'm not a fan of financial plans that use straight-line projections or Monte Carlo risk analysis to support investment proposals. Here's why: They can lull people into a false sense of security or lead them to believe that the stock market is the ans

      5 min read

    • Article

      Math’s Beautiful Monsters: How a destructive idea paved the way for modern math.

      Apr 3, 2014

      Much like its creator, Karl Weierstrass’ monster came from nowhere. After four years at university spent drinking and fencing, Weierstrass had left empty handed. He eventually took a teaching course and spent most of the 1850s as a schoolteacher in B

      10 min read

    • Article

      Math After COVID-19

      Apr 28, 2020

      Math After COVID-19
      4 min read

    • Article

      Math’s Beautiful Monsters

      Oct 26, 2017

      Much like its creator, Karl Weierstrass’ monster came from nowhere. After four years at university spent drinking and fencing, Weierstrass had left empty handed. He eventually took a teaching course and spent most of the 1850s as a schoolteacher in B

      10 min read

    • Article

      The Deepest Uncertainty: When a hypothesis is neither true nor false.

      Jun 6, 2013

      Georg Cantor died in 1918 in a sanatorium in Halle, Germany. A pre-eminent mathematician, he had laid the foundation for the theory of infinite numbers in the 1870s. At the time, his ideas received hostile opposition from prominent mathematicians in

      4 min read

    • Article

      Physicists Attack Math’s $1,000,000 Question

      Apr 4, 2017

      Physicists are attempting to map the distribution of the prime numbers to the energy levels of a particular quantum system.

      4 min read

    • Article

      Business applications For Quantum computing

      May 1, 2022

      COMPUTERS DO ARITHMETIC. Underlying every amazing application of computers today is math, calculated using binary digits or ‘bits.’ The original computers of the early 1950s could perform about 465 multiplications per second — much faster than the ‘h

      11 min read

    • Article

      Pen To Paper

      Feb 2, 2024

      Over the last couple of months, I have been working with a number of junior engineers at senior undergraduate and junior postgraduate level. While their enthusiasm has never been in question, I am shocked by the lack of basic skills I am seeing. The

      7 min read

    • Article

      Missing Links

      Aug 5, 2022

      Over the last couple of months, I have been working with a number of junior engineers at senior undergraduate level and junior post graduate level. While their enthusiasm has never been in question, I am shocked by the lack of basic skills I am seein

      7 min read

    • Article

      Microcontrollers In Amateur Radio

      Aug 1, 2022

      My way of teaching about program data has always been a little different than the way most approach the subject. As you may know, pointers in C are a special type of variable that allows you to access data in a very efficient manner. Indeed, many com

      6 min read

    • Article

      Clever CAD Coding For Clients And Cigars

      Apr 2, 2024

      Credit: http://openscad.org Tam Hanna’s minimal creative capability makes him ideally suited to teaching all kinds of workarounds for problems that require the use of creativity. Catch up by ordering back issues on page 58! The experiments performed

      7 min read

    • Article

      Dynamic Drive Part Two

      Dec 2, 2022

      Dynamic Drive Part Two
      6 min read

    • Article

      Tactical Appreciation

      Aug 15, 2018

      Tactical Appreciation
      5 min read

    Related categories

    Reviews for Introduction to Stochastic Dynamic Programming

    0 ratings

    0 ratings0 reviews

    What did you think?

    Tap to rate

    Review must be at least 10 words

      Book preview

      Introduction to Stochastic Dynamic Programming - Sheldon M. Ross

      Enjoying the preview?
      Page 1 of 1