variational methods for logistic regressionmadigan/g6102/notes/variational.pdfvariational methods...
TRANSCRIPT
![Page 1: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/1.jpg)
Variational Methods forLogistic Regression
(thanks to Tommi Jaakola for the original notes)
![Page 2: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/2.jpg)
![Page 3: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/3.jpg)
![Page 4: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/4.jpg)
![Page 5: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/5.jpg)
![Page 6: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/6.jpg)
![Page 7: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/7.jpg)
![Page 8: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/8.jpg)
![Page 9: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/9.jpg)
particular value of λ
![Page 10: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/10.jpg)
![Page 11: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/11.jpg)
![Page 12: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/12.jpg)
where does this quadratic bound come from?
consider a Taylor expansion of a convex function f(z) around z0:
![Page 13: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/13.jpg)
convex in x2
![Page 14: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/14.jpg)
![Page 15: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/15.jpg)
![Page 16: Variational Methods for Logistic Regressionmadigan/G6102/NOTES/variational.pdfVariational Methods for Logistic Regression (thanks to Tommi Jaakola for the original notes) ... variational](https://reader030.vdocuments.net/reader030/viewer/2022040609/5ecbbf3bed7da421ca6591e1/html5/thumbnails/16.jpg)