Title
Selected Topics On Continuoustime Controlled Markov Chains And Markov Games (Icp Advanced Texts In Mathematics),Used
Sold by Ergodebooks, an authorized reseller.
Returns accepted within 30 days | support@ergodebooks.com
Shipping Information
- Free Standard Shipping — United States only
- Processing Time: 3–5 business days
- Estimated Delivery: 6–10 business days after dispatch
- Double-boxed, fully insured & discreetly packaged
- Tracking number sent via email once dispatched
Returns & Refund
Returns accepted within 30 days of delivery.
Damaged or Defective Item
Free return shipping + replacement or full refund
Wrong Item Received
Free return shipping + replacement or full refund
Change of Mind
Return shipping at customer's expense · 25% restocking fee applies
This book concerns continuoustime controlled Markov chains, also known as continuoustime Markov decision processes. They form a class of stochastic control problems in which a single decisionmaker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decisionmakers (or players) try to optimize their own objective function. Both decisionmaking processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, selfcontained, uptodate analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., bias, overtaking, sensitive discount, and Blackwell optimality) is presented. A particular emphasis is made on the application of the results herein: algorithmic and computational issues are discussed, and applications to population models and epidemic processes are shown.This book is addressed to students and researchers in the fields of stochastic control and stochastic games. Moreover, it could be of interest also to undergraduate and beginning graduate students because the reader is not supposed to have a high mathematical background: a working knowledge of calculus, linear algebra, probability, and continuoustime Markov chains should suffice to understand the contents of the book.
⚠️ WARNING (California Proposition 65):
This product may contain chemicals known to the State of California to cause cancer, birth defects, or other reproductive harm.
For more information, please visit www.P65Warnings.ca.gov.