Continuous-Time Markov Chains and Applications A Two-Time-Scale Approach /

This book gives a systematic treatment of singularly perturbed systems that naturally arise in control and optimization, queueing networks, manufacturing systems, and financial engineering. It presents results on asymptotic expansions of solutions of Komogorov forward and backward equations, propert...

Full description

Bibliographic Details
Main Authors: Yin, G. George. (Author), Zhang, Qing. (Author)
Corporate Author: SpringerLink (Online service)
Format: Electronic
Language:English
Published: New York, NY : Springer New York : Imprint: Springer, 2013.
Edition:Second edition.
Series:Stochastic Modelling and Applied Probability, 37
Subjects:
Online Access:https://ezaccess.library.uitm.edu.my/login?url=http://dx.doi.org/10.1007/978-1-4614-4346-9
LEADER 03884nam a22005415i 4500
001 13033
003 DE-He213
005 20131001115014.0
007 cr nn 008mamaa
008 121116s2013 xxu| s |||| 0|eng d
020 # # |a 9781461443469  |9 978-1-4614-4346-9 
024 7 # |a 10.1007/978-1-4614-4346-9  |2 doi 
050 # 4 |a QA273.A1-274.9 
050 # 4 |a QA274-274.9 
072 # 7 |a PBT  |2 bicssc 
072 # 7 |a PBWL  |2 bicssc 
072 # 7 |a MAT029000  |2 bisacsh 
082 0 4 |a 519.2  |2 23 
100 1 # |a Yin, G. George.  |e author. 
245 1 0 |a Continuous-Time Markov Chains and Applications  |b A Two-Time-Scale Approach /  |c by G. George Yin, Qing Zhang.  |h [electronic resource] : 
250 # # |a Second edition. 
264 # 1 |a New York, NY :  |b Springer New York :  |b Imprint: Springer,  |c 2013. 
300 # # |a XXI, 427 p. 13 illus.  |b online resource. 
336 # # |a text  |b txt  |2 rdacontent 
337 # # |a computer  |b c  |2 rdamedia 
338 # # |a online resource  |b cr  |2 rdacarrier 
347 # # |a text file  |b PDF  |2 rda 
490 1 # |a Stochastic Modelling and Applied Probability,  |v 37  |x 0172-4568 ; 
505 0 # |a Prologue and Preliminaries: Introduction and overview- Mathematical preliminaries -- Markovian models -- Two-Time-Scale Markov Chains: Asymptotic Expansions of Solutions for Forward Equations -- Occupation Measures: Asymptotic Properties and Ramification -- Asymptotic Expansions of Solutions for Backward Equations -- Applications:MDPs, Near-optimal Controls, Numerical Methods, and LQG with Switching: Markov Decision Problems -- Stochastic Control of Dynamical Systems -- Numerical Methods for Control and Optimization -- Hybrid LQG Problems -- References -- Index.-. 
520 # # |a This book gives a systematic treatment of singularly perturbed systems that naturally arise in control and optimization, queueing networks, manufacturing systems, and financial engineering. It presents results on asymptotic expansions of solutions of Komogorov forward and backward equations, properties of functional occupation measures, exponential upper bounds, and functional limit results for Markov chains with weak and strong interactions. To bridge the gap between theory and applications, a large portion of the book is devoted to� applications in controlled dynamic systems, production planning, and numerical methods for controlled Markovian systems with large-scale and complex structures in the real-world problems. This second edition �has been updated throughout and includes two new chapters on asymptotic expansions of solutions for backward equations and hybrid LQG problems. The chapters on analytic and probabilistic properties of two-time-scale Markov chains have been almost completely rewritten and the notation has been streamlined and simplified. This book is written for applied mathematicians, engineers, operations researchers, and applied scientists. Selected material from the book can also be used for a one semester advanced graduate-level course in applied probability and stochastic processes. 
650 # 0 |a Mathematics. 
650 # 0 |a Mathematical optimization. 
650 # 0 |a Distribution (Probability theory). 
650 # 0 |a Engineering mathematics. 
650 1 4 |a Mathematics. 
650 2 4 |a Probability Theory and Stochastic Processes. 
650 2 4 |a Calculus of Variations and Optimal Control; Optimization. 
650 2 4 |a Operations Research, Management Science. 
650 2 4 |a Appl.Mathematics/Computational Methods of Engineering. 
700 1 # |a Zhang, Qing.  |e author. 
710 2 # |a SpringerLink (Online service) 
773 0 # |t Springer eBooks 
776 0 8 |i Printed edition:  |z 9781461443452 
830 # 0 |a Stochastic Modelling and Applied Probability,  |v 37  |x 0172-4568 ; 
856 4 0 |u https://ezaccess.library.uitm.edu.my/login?url=http://dx.doi.org/10.1007/978-1-4614-4346-9 
912 # # |a ZDB-2-SMA 
950 # # |a Mathematics and Statistics (Springer-11649)