convolutional neural networks: epic fails

18
Convolutional Neural Networks: Epic Fails Laura E. Boucheron College of Engineering Klipsch School of Electrical & Computer Engineering

Upload: others

Post on 04-Nov-2021

20 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Convolutional Neural Networks: Epic Fails

Convolutional Neural Networks: Epic Fails

Laura E. Boucheron

College of Engineering Klipsch School of Electrical & Computer Engineering

Page 2: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%)

Electric Guitar(98.90%)

All figures on this slide taken from the reference at the top

Page 3: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%)

Electric Guitar(98.90%)

All figures on this slide taken from the reference at the top

Page 4: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%) Penguin (99.99%)

Electric Guitar(98.90%)

Electric Guitar(99.99%)

All figures on this slide taken from the reference at the top

Page 5: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%) Penguin (99.99%)

Electric Guitar(98.90%)

Electric Guitar(99.99%)

Other >99.5% confidence predictions:

Remote control Baseball

All figures on this slide taken from the reference at the top

Page 6: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%) Penguin (99.99%)

Electric Guitar(98.90%)

Electric Guitar(99.99%)

Other >99.5% confidence predictions:

Remote control Baseball

Freight car African grey

All figures on this slide taken from the reference at the top

Page 7: Convolutional Neural Networks: Epic Fails

Nguyen, A., Yosinski, J., & Clune, J. (2015). Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 427-436).

Penguin (99.99%) Penguin (99.99%)

Electric Guitar(98.90%)

Electric Guitar(99.99%)

Other >99.5% confidence predictions:

Remote control Baseball

Freight car African grey

Cheetah Jackfruit

All figures on this slide taken from the reference at the top

Page 8: Convolutional Neural Networks: Epic Fails

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013). Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199.

School Bus

All figures on this slide taken from the reference at the top

Page 9: Convolutional Neural Networks: Epic Fails

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013). Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199.

School Bus

All figures on this slide taken from the reference at the top

Page 10: Convolutional Neural Networks: Epic Fails

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013). Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199.

School Bus Ostrich

All figures on this slide taken from the reference at the top

Page 11: Convolutional Neural Networks: Epic Fails

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013). Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199.

School Bus OstrichPerturbation

All figures on this slide taken from the reference at the top

Page 12: Convolutional Neural Networks: Epic Fails

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013). Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199.

Correct Perturbation Ostrich Correct Perturbation Ostrich

All figures on this slide taken from the reference at the top

Page 13: Convolutional Neural Networks: Epic Fails

Engstrom, L., Tran, B., Tsipras, D., Schmidt, L., & Madry, A. (2017). A rotation and a translation suffice: Fooling cnns with simple transformations. arXiv preprint arXiv:1712.02779.

revolver vulture

All figures on this slide taken from the reference at the top

Page 14: Convolutional Neural Networks: Epic Fails

Engstrom, L., Tran, B., Tsipras, D., Schmidt, L., & Madry, A. (2017). A rotation and a translation suffice: Fooling cnns with simple transformations. arXiv preprint arXiv:1712.02779.

revolver vulture

All figures on this slide taken from the reference at the top

Page 15: Convolutional Neural Networks: Epic Fails

Engstrom, L., Tran, B., Tsipras, D., Schmidt, L., & Madry, A. (2017). A rotation and a translation suffice: Fooling cnns with simple transformations. arXiv preprint arXiv:1712.02779.

revolver

mousetrap

vulture

orangutan

All figures on this slide taken from the reference at the top

Page 16: Convolutional Neural Networks: Epic Fails

Rosenfeld, A., Zemel, R., & Tsotsos, J. K. (2018). The elephant in the room. arXiv preprint arXiv:1808.03305.

All figures on this slide taken from the reference at the top

Page 17: Convolutional Neural Networks: Epic Fails

Rosenfeld, A., Zemel, R., & Tsotsos, J. K. (2018). The elephant in the room. arXiv preprint arXiv:1808.03305.

All figures on this slide taken from the reference at the top

Page 18: Convolutional Neural Networks: Epic Fails

Rosenfeld, A., Zemel, R., & Tsotsos, J. K. (2018). The elephant in the room. arXiv preprint arXiv:1808.03305.

All figures on this slide taken from the reference at the top