News and Publications

News

Recent Publications (Ph.D. research, 2013-…)

See my Google Scholar profile for more information.

D.P. Kingma
Variational Inference and Deep Learning: A New Synthesis
Ph.D. Thesis
[Dropbox link]

T. Salimans, A. Karpathy, X. Chen, D.P. Kingma
PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications
The International Conference on Learning Representations (ICLR), Toulon, 2017
[arXiv preprint]

X. Chen, D.P. Kingma, T. Salimans, Y. Duan, P. Dhariwal, J. Schulman, I. Sutskever, P. Abbeel
Variational Lossy Autoencoder
The International Conference on Learning Representations (ICLR), Toulon, 2017
[arXiv preprint]

D.P. Kingma, T. Salimans, R. Jozefowicz, I. Sutskever, M. Welling
Improving Variational Autoencoders with Inverse Autoregressive Flow
Advances in Neural Information Processing Systems 29 (NIPS), Barcelona, 2016
[arXiv preprint]

T. Salimans, D.P. Kingma
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Advances in Neural Information Processing Systems 29 (NIPS), Barcelona, 2016
[arXiv preprint]

D.P. Kingma, T. Salimans, M. Welling
Variational Dropout and the Local Reparameterization Trick
Advances in Neural Information Processing Systems 28 (NIPS), Montreal, 2015
[arXiv preprint]

T. Salimans, D.P. Kingma, M. Welling
Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
Proceedings of the International Conference on Machine Learning (ICML), Lille, 2015
[arXiv preprint]

D.P. Kingma, J. Ba
Adam: A Method for Stochastic Optimization
The International Conference on Learning Representations (ICLR), San Diego, 2015
[arXiv preprint]

D.P. Kingma, D.J. Rezende, S. Mohamed, M. Welling
Semi-Supervised Learning with Deep Generative Models
Advances in Neural Information Processing Systems 27 (NIPS), Montreal, 2014
[arXiv preprint]

D.P. Kingma, M. Welling
Efficient Gradient-Based Inference through Transformations between Bayes Nets and Neural Nets
Proceedings of the International Conference on Machine Learning (ICML), Beijing, 2014
[arXiv preprint]

D.P. Kingma, M. Welling
Auto-Encoding Variational Bayes
The International Conference on Learning Representations (ICLR), Banff, 2014
[arXiv preprint]

D.P. Kingma, M. Welling
Stochastic Gradient VB and the Variational Auto-Encoder
2nd International Conference on Learning Representationsm (ICLR), Banff, 2014
[PDF]
(Alternative title of “Auto-Encoding Variational Bayes”)

Earlier Publications (M.Sc. thesis, 2009-2010):

D.P. Kingma, Y. LeCun
Regularized Estimation of Image Statistics by Score Matching
Advances in Neural Information Processing Systems 23 (NIPS), Vancouver, 2010, 1126-1134
[PDF]

D.P. Kingma
Improving Score Matching for Regularized Estimation of Image Statistics
M.Sc. Thesis, Universiteit Utrecht, 2010
[PDF]