Download Free Large Deviations For Markov Chains Book in PDF and EPUB Free Download. You can read online Large Deviations For Markov Chains and write the review.

Offers an introduction to large deviations. This book is divided into two parts: theory and applications. It presents basic large deviation theorems for i i d sequences, Markov sequences, and sequences with moderate dependence. It also includes an outline of general definitions and theorems.
This book studies the large deviations for empirical measures and vector-valued additive functionals of Markov chains with general state space. Under suitable recurrence conditions, the ergodic theorem for additive functionals of a Markov chain asserts the almost sure convergence of the averages of a real or vector-valued function of the chain to the mean of the function with respect to the invariant distribution. In the case of empirical measures, the ergodic theorem states the almost sure convergence in a suitable sense to the invariant distribution. The large deviation theorems provide precise asymptotic estimates at logarithmic level of the probabilities of deviating from the preponderant behavior asserted by the ergodic theorems.
The book is devoted to the results on large deviations for a class of stochastic processes. Following an introduction and overview, the material is presented in three parts. Part 1 gives necessary and sufficient conditions for exponential tightness that are analogous to conditions for tightness in the theory of weak convergence. Part 2 focuses on Markov processes in metric spaces. For a sequence of such processes, convergence of Fleming's logarithmically transformed nonlinear semigroups is shown to imply the large deviation principle in a manner analogous to the use of convergence of linear semigroups in weak convergence. Viscosity solution methods provide applicable conditions for the necessary convergence. Part 3 discusses methods for verifying the comparison principle for viscosity solutions and applies the general theory to obtain a variety of new and known results on large deviations for Markov processes. In examples concerning infinite dimensional state spaces, new comparison principles are de
Applies the well-developed tools of the theory of weak convergenceof probability measures to large deviation analysis--a consistentnew approach The theory of large deviations, one of the most dynamic topics inprobability today, studies rare events in stochastic systems. Thenonlinear nature of the theory contributes both to its richness anddifficulty. This innovative text demonstrates how to employ thewell-established linear techniques of weak convergence theory toprove large deviation results. Beginning with a step-by-stepdevelopment of the approach, the book skillfully guides readersthrough models of increasing complexity covering a wide variety ofrandom variable-level and process-level problems. Representationformulas for large deviation-type expectations are a key tool andare developed systematically for discrete-time problems. Accessible to anyone who has a knowledge of measure theory andmeasure-theoretic probability, A Weak Convergence Approach to theTheory of Large Deviations is important reading for both studentsand researchers.
This is an introductory course on the methods of computing asymptotics of probabilities of rare events: the theory of large deviations. The book combines large deviation theory with basic statistical mechanics, namely Gibbs measures with their variational characterization and the phase transition of the Ising model, in a text intended for a one semester or quarter course. The book begins with a straightforward approach to the key ideas and results of large deviation theory in the context of independent identically distributed random variables. This includes Cramér's theorem, relative entropy, Sanov's theorem, process level large deviations, convex duality, and change of measure arguments. Dependence is introduced through the interactions potentials of equilibrium statistical mechanics. The phase transition of the Ising model is proved in two different ways: first in the classical way with the Peierls argument, Dobrushin's uniqueness condition, and correlation inequalities and then a second time through the percolation approach. Beyond the large deviations of independent variables and Gibbs measures, later parts of the book treat large deviations of Markov chains, the Gärtner-Ellis theorem, and a large deviation theorem of Baxter and Jain that is then applied to a nonstationary process and a random walk in a dynamical random environment. The book has been used with students from mathematics, statistics, engineering, and the sciences and has been written for a broad audience with advanced technical training. Appendixes review basic material from analysis and probability theory and also prove some of the technical results used in the text.
Many situations exist in which solutions to problems are represented as function space integrals. Such representations can be used to study the qualitative properties of the solutions and to evaluate them numerically using Monte Carlo methods. The emphasis in this book is on the behavior of solutions in special situations when certain parameters get large or small.
This book consists of two synergistic parts. The first half develops the theory of large deviations from the beginning (iid random variables) through recent results on the theory for processes with boundaries, keeping to a very narrow path: continuous-time, discrete-state processes. By developing only what is needed for the applications, the theory is kept to a manageable level, both in terms of length and in terms of difficulty. Within its scope, the treatment is detailed, comprehensive and self-contained. As the book shows, there are sufficiently many interesting applications of jump Markov processes to warrant a special treatment. The second half is a collection of applications developed at Bell Laboratories. The applications cover large areas of the theory of communication networks: circuit-switched transmission, packet transmission, multiple access channels, and the M/M/1 queue. Aspects of parallel computation are covered as well: basics of job allocation, rollback-based parallel simulation, assorted priority queueing models that might be used in performance models of various computer architectures, and asymptotic coupling of processors. These applications are thoroughly analyzed using the tools developed in the first half of the book. Features: A transient analysis of the M/M/1 queue; a new analysis of an Aloha model using Markov modulated theory; new results for Erlang's model; new results for the AMS model; analysis of "serve the longer queue", "join the shorter queue" and other simple priority queues; and a simple analysis of the Flatto-Hahn-Wright model of processor-sharing.
Publisher Description
This is the second printing of the book first published in 1988. The first four chapters of the volume are based on lectures given by Stroock at MIT in 1987. They form an introduction to the basic ideas of the theory of large deviations and make a suitable package on which to base a semester-length course for advanced graduate students with a strong background in analysis and some probability theory. A large selection of exercises presents important material and many applications. The last two chapters present various non-uniform results (Chapter 5) and outline the analytic approach that allows one to test and compare techniques used in previous chapters (Chapter 6).