![Page 1: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/1.jpg)
Monte Carlo Methods
Part IV: Markov Chains Monte Carlo
Spring Semester 2013/14, Department of Applied Mathematics, University of Crete
Instructor: Harmandaris Vagelis, email: [email protected]
![Page 2: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/2.jpg)
MC Methods, Ch. 4: Markovian Chains
Basic Definitions:
Markov Chains
![Page 3: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/3.jpg)
MC Methods, Ch. 4: Markovian Chains
Essentials of Markov Chains Monte Carlo (MCMC) algorithms:
Markov Chains
![Page 4: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/4.jpg)
MC Methods, Ch. 4: Markovian Chains
Markov Chains
Essentials of Markov Chains Monte Carlo (MCMC) algorithms:
![Page 5: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/5.jpg)
MC Methods, Ch. 4: Markovian Chains
The MCMC principle:
Metropolis – Hastings Algorithm
![Page 6: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/6.jpg)
MC Methods, Ch. 4: Markovian Chains
Metropolis – Hastings Algorithm
Requirements:
![Page 7: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/7.jpg)
MC Methods, Ch. 4: Markovian Chains
Metropolis – Hastings Algorithm
The Algorithm:
![Page 8: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/8.jpg)
MC Methods, Ch. 4: Markovian Chains
Properties:
Metropolis – Hastings Algorithm
![Page 9: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/9.jpg)
MC Methods, Ch. 4: Markovian Chains
Random Walk Metropolis
![Page 10: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/10.jpg)
MC Methods, Ch. 4: Markovian Chains
Random Walk Metropolis
![Page 11: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/11.jpg)
MC Methods, Ch. 4: Markovian Chains
Random Walk Metropolis
![Page 12: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/12.jpg)
MC Methods, Ch. 4: Markovian Chains
Histograms - Estimators:
Random Walk Metropolis
![Page 13: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/13.jpg)
MC Methods, Ch. 4: Markovian Chains
Basic Idea:
Gibbs Sampler
![Page 14: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/14.jpg)
MC Methods, Ch. 4: Markovian Chains
Random Gibbs Sampler:
Gibbs Sampler
![Page 15: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/15.jpg)
MC Methods, Ch. 4: Markovian Chains
Important Aspects:
Gibbs Sampler
![Page 16: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/16.jpg)
MC Methods, Ch. 4: Markovian Chains
General Comments:
Gibbs Sampler
One special case of Metropolis-Hastings is very popular and does not require any choice of step size.
Gibbs sampling is the composition of a sequence of M-H transition operators, each of which acts upon a single component of the state space.
By themselves, these operators are not ergodic, but in aggregate they typically are.
Most commonly, the proposal distribution is taken to be the conditional distribution, given the rest of the state. This causes the acceptance ratio to always be one and is often easy because it is low-dimensional.
![Page 17: Monte Carlo Methodsvagelis/Courses/EM385/MC_Ch4_Markov-Chains-… · MC Methods, Ch. 4: Markovian Chains GeneralComments: Gibbs Sampler One special case of Metropolis-Hastings is](https://reader033.vdocuments.net/reader033/viewer/2022060317/5f0c66dc7e708231d4353896/html5/thumbnails/17.jpg)
MC Methods, Ch. 4: Markovian Chains
Monte Carlo Strategies in Scientific Computing, J. Liu, Springer, New York, 2001.
Monte Carlo Statistical Methods, C. Robert, G. Casella, Springer, New York,
2004.
Stochastic Methods: A Handbook for the Natural and Social Sciences, C.
Gardiner, Springer, New York, 2009.
Bibliography