Bayesian Data Analysis, Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, and Donald B. Rubin, 2013 (Chapman & Hall) - A standard textbook for Bayesian inference, with extensive coverage of MCMC algorithms and their theoretical basis.