ai chatbots and conversational commerce · chatbot milabot: chatbot developed by the montreal...
TRANSCRIPT
![Page 1: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/1.jpg)
Kecerdasan Bisnis Terapan
AI Chatbots and
Conversational Commerce
HusniLab. Riset JTIF UTM
Sumber awal: http://mail.tku.edu.tw/myday/teaching/1071/BI/1071BI12_Business_Intelligence.pptx
![Page 2: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/2.jpg)
Business Intelligence (BI)
2
Introduction to BI and Data Science
Descriptive Analytics
Predictive Analytics
Prescriptive Analytics
1
3
5
4
Big Data Analytics
2
6 Future Trends
![Page 3: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/3.jpg)
AI Chatbots and
Conversational Commerce
3
![Page 4: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/4.jpg)
Outline• AI Chatbots
• Conversational Commerce
• Bot Platform Ecosystem
4
![Page 5: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/5.jpg)
AI and
Cognitive Computing
5Source: http://research.ibm.com/cognitive-computing/
![Page 6: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/6.jpg)
Artificial Intelligence (A.I.) Timeline
6Source: https://digitalintelligencetoday.com/artificial-intelligence-timeline-infographic-from-eliza-to-tay-and-beyond/
![Page 7: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/7.jpg)
Chatbots: Evolution of UI/UX
7Source: https://bbvaopen4u.com/en/actualidad/want-know-how-build-conversational-chatbot-here-are-some-tools
![Page 8: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/8.jpg)
AI Chatbot for Conversational
Commerce8
![Page 9: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/9.jpg)
ChatbotDialogue SystemIntelligent Agent
9
![Page 10: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/10.jpg)
Chatbot
10Source: https://www.mdsdecoded.com/blog/the-rise-of-chatbots/
![Page 11: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/11.jpg)
Dialogue System
11Source: Serban, I. V., Lowe, R., Charlin, L., & Pineau, J. (2015). A survey of available corpora for building data-driven dialogue systems. arXiv
preprint arXiv:1512.05742.
![Page 12: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/12.jpg)
Can machines
think?(Alan Turing ,1950)
12Source: Cahn, Jack. "CHATBOT: Architecture, Design, & Development."
PhD diss., University of Pennsylvania, 2017.
![Page 13: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/13.jpg)
Chatbot“online human-computer
dialog systemwith
natural language.”
13Source: Cahn, Jack. "CHATBOT: Architecture, Design, & Development."
PhD diss., University of Pennsylvania, 2017.
![Page 14: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/14.jpg)
Chatbot Conversation Framework
14Source: https://chatbotslife.com/ultimate-guide-to-leveraging-nlp-machine-learning-for-you-chatbot-531ff2dd870c
![Page 15: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/15.jpg)
Conversational Commerce
15
![Page 16: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/16.jpg)
From E-Commerce
to Conversational Commerce:
Chatbotsand
Virtual Assistants
16Source: http://www.guided-selling.org/from-e-commerce-to-conversational-commerce/
![Page 17: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/17.jpg)
Conversational Commerce: eBay AI Chatbots
17Source: https://www.forbes.com/sites/rachelarthur/2017/07/19/conversational-commerce-ebay-ai-chatbot/
![Page 18: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/18.jpg)
Hotel Chatbot
18Source: https://sdtimes.com/amazon/guest-view-capitalize-amazon-lex-available-general-public/
![Page 19: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/19.jpg)
19Source: http://www.guided-selling.org/from-e-commerce-to-conversational-commerce/
H&M’s Chatbot on Kik
![Page 20: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/20.jpg)
20Source: http://www.guided-selling.org/from-e-commerce-to-conversational-commerce/
Uber’s Chatbot on Facebook’s Messenger
Uber’s chatbot on Facebook’s messenger
- one main benefit: it loads much faster than the Uber app
![Page 21: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/21.jpg)
Savings Bot
21Source: https://chatbotsmagazine.com/artificial-intelligence-ai-and-fintech-part-1-7cae1e67dc13
![Page 22: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/22.jpg)
Mastercard Makes Commerce More Conversational
22Source: https://newsroom.mastercard.com/press-releases/mastercard-makes-commerce-more-conversational-with-launch-of-chatbots-for-banks-and-merchants/
![Page 23: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/23.jpg)
Bot Platform
Ecosystem23
![Page 24: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/24.jpg)
24Source: https://www.oreilly.com/ideas/infographic-the-bot-platform-ecosystem
![Page 25: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/25.jpg)
25Source: https://www.oreilly.com/ideas/infographic-the-bot-platform-ecosystem
![Page 26: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/26.jpg)
26Source: https://venturebeat.com/2016/08/11/introducing-the-bots-landscape-170-companies-4-billion-in-funding-thousands-of-bots/
![Page 27: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/27.jpg)
27Source: https://medium.com/@RecastAI/2017-messenger-bot-landscape-a-public-spreadsheet-gathering-1000-messenger-bots-f017fdb1448a /
![Page 28: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/28.jpg)
The Bot Lifecycle
28Source: https://chatbotsmagazine.com/the-bot-lifecycle-1ff357430db7
![Page 29: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/29.jpg)
ChatbotsBot Maturity Model
29Source: https://www.capgemini.com/2017/04/how-can-chatbots-meet-expectations-introducing-the-bot-maturity/
Customers want to have simpler means to interact with businesses and get faster response to a question or complaint.
![Page 30: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/30.jpg)
Chatbot Architectures
• Information Retrieval based Bot (IR-Bot)
• Task Oriented Bot (Task-Bot)
• Chitchat-Bot (Chatbot)
30
![Page 31: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/31.jpg)
Watson DeepQA Architecture
31Source: Ferrucci, David, Eric Brown, Jennifer Chu-Carroll, James Fan, David Gondek, Aditya A. Kalyanpur, Adam Lally et al.
"Building Watson: An overview of the DeepQA project." AI magazine 31, no. 3 (2010): 59-79.
![Page 32: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/32.jpg)
ALICE and AIML
32Source: http://www.alicebot.org/aiml.html
![Page 33: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/33.jpg)
AIML (Artificial Intelligence Markup Language)
<category>
<pattern>HELLO</pattern>
<template>Hi, I am a robot</template>
</category>
33Source: http://www.alicebot.org/aiml.html
![Page 34: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/34.jpg)
AIML (Artificial Intelligence Markup Language)
• <aiml>
– the tag that begins and ends an AIML document
• <category>
– the tag that marks a "unit of knowledge" in an Alicebot's knowledge base
• <pattern>
– used to contain a simple pattern that matches what a user may say or type to an Alicebot
• <template>
– contains the response to a user input34Source: http://www.alicebot.org/aiml.html
![Page 35: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/35.jpg)
<category><pattern>WHAT ARE YOU</pattern><template>
<think><set name="topic">Me</set></think>I am the latest result in artificial intelligence,which can reproduce the capabilities of the human brainwith greater speed and accuracy.
</template></category>
35
AIML (Artificial Intelligence Markup Language)
Source: http://www.alicebot.org/aiml.html
![Page 36: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/36.jpg)
Deep Learning for Dialogues
Intent ClassificationIntent LSTM
LSTM (Long-Short Term Memory)GRU (Gated Recurrent Unit)
36Source: Hakkani-Tür, Dilek, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang. "Multi-domain joint semantic frame parsing using bi-directional
RNN-LSTM." In Proceedings of The 17th Annual Meeting of the International Speech Communication Association. 2016.
![Page 37: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/37.jpg)
Dialogue Utterance
37
An example utterance with annotations of semantic slots in
IOB format (S), domain (D), and intent (I),
B-dir and I-dir denote the director name.
Source: Hakkani-Tür, Dilek, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang. "Multi-domain joint semantic frame parsing using bi-directional
RNN-LSTM." In Proceedings of The 17th Annual Meeting of the International Speech Communication Association. 2016.
![Page 38: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/38.jpg)
End-to-end Memory Network Model for Multi-turn SLU
38Source: Chen, Yun-Nung, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, and Li Deng. "End-to-end memory networks with knowledge carryover for
multi-turn spoken language understanding." In Proceedings of Interspeech. 2016.
![Page 39: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/39.jpg)
39Source: Chen, Yun-Nung, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, and Li Deng. "End-to-end memory networks with knowledge carryover for
multi-turn spoken language understanding." In Proceedings of Interspeech. 2016.
![Page 40: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/40.jpg)
Deep Learning for SLU (Spoken Language Understanding)
40Source: Hakkani-Tür, Dilek, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang. "Multi-domain joint semantic frame parsing using bi-directional
RNN-LSTM." In Proceedings of The 17th Annual Meeting of the International Speech Communication Association. 2016.
![Page 41: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/41.jpg)
Encoder-decoder model for joint intent detection and slot filling
41Source: Liu, Bing, and Ian Lane. "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling."
arXiv preprint arXiv:1609.01454 (2016).
(a) with no aligned inputs.
![Page 42: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/42.jpg)
42Source: Liu, Bing, and Ian Lane. "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling."
arXiv preprint arXiv:1609.01454 (2016).
(b) with aligned inputs.
Encoder-decoder model for joint intent detection and slot filling
![Page 43: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/43.jpg)
43Source: Liu, Bing, and Ian Lane. "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling."
arXiv preprint arXiv:1609.01454 (2016).
(c) with aligned inputs and attention
Encoder-decoder model for joint intent detection and slot filling
![Page 44: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/44.jpg)
End-to-End Task-Completion Neural Dialogue Systems
44Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
Reinforcement learning is used to train all components in an end-to-end fashion
![Page 45: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/45.jpg)
SlotIntent
45Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
![Page 46: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/46.jpg)
46Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
SlotIntent
![Page 47: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/47.jpg)
47
Sample dialogues generated by rule-based and RL agents
Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
![Page 48: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/48.jpg)
48
Sample dialogues generated by rule-based and RL agents
Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
![Page 49: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/49.jpg)
Sample dialogues generated by rule-based and RL agents
49Source: Li, Xuijun, Yun-Nung Chen, Lihong Li, and Jianfeng Gao. "End-to-end task-completion neural dialogue systems."
arXiv preprint arXiv:1703.01008 (2017).
![Page 50: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/50.jpg)
A Deep Reinforcement Learning Chatbot
Iulian V. Serban, Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim, Michael Pieper, Sarath
Chandar, Nan Rosemary Ke, Sai Mudumba, Alexandre de Brebisson Jose M. R. Sotelo, Dendi Suhubdy,
Vincent Michalski, Alexandre Nguyen, Joelle Pineauand Yoshua Bengio
Montreal Institute for Learning Algorithms, Montreal, Quebec, Canada
50Source: Serban, Iulian V., Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al.
"A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349 (2017).
![Page 51: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/51.jpg)
A Deep Reinforcement Learning Chatbot
MILABOT: Chatbot developed by the
Montreal Institute for Learning Algorithms (MILA)
for the Amazon Alexa Prize competition
51Source: Serban, Iulian V., Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al.
"A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349 (2017).
![Page 52: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/52.jpg)
MILABOT Dialogue manager control flow
52Source: Serban, Iulian V., Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al.
"A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349 (2017).
1 2 3
Q: “What is your name?”R: "I am an Alexa Prize Socialbo”
![Page 53: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/53.jpg)
53Source: Serban, Iulian V., Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al.
"A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349 (2017).
![Page 54: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/54.jpg)
MILABOT Computational graph
for scoring model
54Source: Serban, Iulian V., Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al.
"A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349 (2017).
model selection policies based on both action-value function and stochastic policy parametrizations
![Page 55: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/55.jpg)
Facebook AI Research : bAbI Project
• The (20) QA bAbI tasks
• The (6) dialog bAbI tasks
• The Children’s Book Test
• The Movie Dialog dataset
• The WikiMovies dataset
• The Dialog-based Language Learning dataset
• The SimpleQuestions dataset
55Source: https://research.fb.com/projects/babi/
![Page 56: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/56.jpg)
Facebook bAbI QA Datasets1 Mary moved to the bathroom.
2 John went to the hallway.
3 Where is Mary? bathroom 1
4 Daniel went back to the hallway.
5 Sandra moved to the garden.
6 Where is Daniel? hallway 4
7 John moved to the office.
8 Sandra journeyed to the bathroom.
9 Where is Daniel? hallway 4
10 Mary moved to the hallway.
11 Daniel travelled to the office.
12 Where is Daniel? office 11
13 John went back to the garden.
14 John moved to the bedroom.
15 Where is Sandra? bathroom 8
1 Sandra travelled to the office.
2 Sandra went to the bathroom.
3 Where is Sandra? bathroom 2
56Source: https://research.fb.com/projects/babi/
![Page 57: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/57.jpg)
Facebook bAbI QA Datasets
57Source: Weston, Jason, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merriënboer, Armand Joulin, and Tomas Mikolov. "Towards
AI-complete question answering: A set of prerequisite toy tasks." arXiv preprint arXiv:1502.05698 (2015).
![Page 58: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/58.jpg)
Facebook bAbI QA Datasets
58Source: Weston, Jason, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merriënboer, Armand Joulin, and Tomas Mikolov. "Towards
AI-complete question answering: A set of prerequisite toy tasks." arXiv preprint arXiv:1502.05698 (2015).
![Page 59: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/59.jpg)
Facebook bAbI QA Datasets
59Source: Weston, Jason, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merriënboer, Armand Joulin, and Tomas Mikolov. "Towards
AI-complete question answering: A set of prerequisite toy tasks." arXiv preprint arXiv:1502.05698 (2015).
![Page 60: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/60.jpg)
Learning End-to-End Goal-Oriented Dialog
60
![Page 61: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/61.jpg)
1 hi hello what can i help you with today
2 can you make a restaurant reservation with italian cuisine for six people in a cheap price range i'm on it
3 <SILENCE> where should it be
4 rome please ok let me look into some options for you
5 <SILENCE> api_call italian rome six cheap
61Source: https://research.fb.com/projects/babi/
Facebook bAbI Dialogue Datasets
![Page 62: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/62.jpg)
62Source: Bordes, Antoine, and Jason Weston. "Learning End-to-End Goal-Oriented Dialog." arXiv preprint arXiv:1605.07683 (2016).
![Page 63: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/63.jpg)
The Dialog bAbI Tasks
63Source: Bordes, Antoine, and Jason Weston. "Learning End-to-End Goal-Oriented Dialog." arXiv preprint arXiv:1605.07683 (2016).
![Page 64: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/64.jpg)
64Source: Bordes, Antoine, and Jason Weston. "Learning End-to-End Goal-Oriented Dialog." arXiv preprint arXiv:1605.07683 (2016).
The Dialog bAbI Tasks
![Page 65: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/65.jpg)
65Source: Bordes, Antoine, and Jason Weston. "Learning End-to-End Goal-Oriented Dialog." arXiv preprint arXiv:1605.07683 (2016).
The Dialog bAbI Tasks
![Page 66: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/66.jpg)
Short Text
Conversation(STC)
66
![Page 67: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/67.jpg)
Short Text Conversation Task (STC-3)
Chinese Emotional Conversation Generation (CECG) Subtask
67Source: http://coai.cs.tsinghua.edu.cn/hml/challenge.html
![Page 68: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/68.jpg)
NTCIR Short Text ConversationSTC-1, STC-2, STC-3
68Source: https://waseda.app.box.com/v/STC3atNTCIR-14
![Page 69: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/69.jpg)
Short Text Conversation (NTCIR-13 STC2)Retrieval-based
69Source: http://ntcirstc.noahlab.com.hk/STC2/stc-cn.htm
![Page 70: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/70.jpg)
Short Text Conversation (NTCIR-13 STC2)
Generation-based
70Source: http://ntcirstc.noahlab.com.hk/STC2/stc-cn.htm
![Page 71: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/71.jpg)
Short Text Conversation(STC-3)
• Emotional Conversation Generation
• Dialogue Quality
• Nugget Detection subtasks using Chinese and English dialogue data
71Source: http://research.nii.ac.jp/ntcir/ntcir-14/tasks.html
![Page 72: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/72.jpg)
NTCIR-14 Short Text Conversation
Task (STC-3)
• Three new subtasks
– Chinese Emotional Conversation Generation (CECG)
– Dialogue Quality (DQ)(for Chinese and English)
– Nugget Detection (ND)(for Chinese and English)
72Source: http://research.nii.ac.jp/ntcir/ntcir-14/tasks.html
![Page 73: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/73.jpg)
Given post: 爱狗还会做饭的男人,最帅了!
The man who cooks and loves dogs is very handsome!
Response Chinese / Translated EnglishEmotion
ClassCoherence
and FluencyEmotion
Consistency Label
Response 1 会做饭的男人是很帅的啊。The man who cooks is handsome.
喜欢Like
Yes Yes 2
Response 2 哈哈,我也觉得。Haha, I feel the same way.
喜欢Like
Yes No 1
Response 3 这是哪部电影里的?Which movie is this from?
厌恶Disgust
No Yes 0
Response 4 哈哈,你也是。Haha, the same to you.
喜欢Like
No No 0
Response 5 我爱你会。I love you, will you.
厌恶Disgust
No Yes 0
Response 6 这是同主义同的道!This is the same way of the same doctrine!
厌恶Disgust
No No 0
73Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/evaluation_metric/
![Page 74: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/74.jpg)
NLPCC Emotion Classification Challenge
6 classes (64%)
• 0: Other
• 1: Like
• 2: Sadness
• 3: Disgust
• 4: Anger
• 5: Happiness
74Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/dataset_description/
![Page 75: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/75.jpg)
Chinese Emotional Conversation Generation (CECG)
Post(Given)
Emotion Category (Given)
Response(to be generated)
爱狗还会做饭的男人,最帅了!The man who cooks and loves dogs is very handsome!
喜欢Like
会做饭的男人是很帅的啊。The man who cooks is handsome.
爸爸,明天是六一啦,带我出去玩吧!Daddy, tomorrow is June 1th Children‘s Day. Please take me out to play!
喜欢Like
好,一定带。Yes, of course.
被特别在乎的人忽略,会很难过,而装做不在乎,会更难过。It's sad to be ignored by someone that you really care, and it's harder to pretend that you don't care.
悲伤Sadness
因为在乎,所以在乎。I am concerned with it, because I care about it.
冰天雪地的哈尔滨!你要冻死我咋地?!?!Harbin is in the snow! Are you going to freeze me to death?!?!
喜欢Like
注意保暖,小心别感冒!Keep warm. Watch out for getting cold!
本来想学一把沧桑,结果令我更忧伤。I wanted to learn the vicissitudes of life, but I became sadder.
悲伤Sadness
这是一个悲伤的故事。It a sad story.
今天一整天都在海边训练。虽然很累,但还是很开心的!I have been training at the seaside all day. Though very tired, I still very happy!
快乐Happiness
是的呢,开心!Yeah, happy!
75Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/task_definition/
![Page 76: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/76.jpg)
Chinese Emotional Conversation Generation
(CECG)Dataset
• 1,110,000 Weibo post-response pairs
– [[[post,post_label],[response,response_label]],[[post,post_label],[response,response_label]],...].
76Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/dataset_description/
![Page 77: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/77.jpg)
Fluency judgement on responses with repetitive words
77
Source: Huang, Minlie, Zuoxian Ye, and Hao Zhou. "Overview of the NLPCC 2017 Shared Task: Emotion Generation Challenge." In National CCF Conference on Natural Language Processing and Chinese Computing (NLPCC), pp. 926-936. Springer, Cham, 2017.
![Page 78: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/78.jpg)
Sample responses generated by Seq2Seq and ECM
(Emotional Chatting Machine)
78Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 79: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/79.jpg)
Sample responses generated by Seq2Seq and ECM
(Emotional Chatting Machine)
79Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 80: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/80.jpg)
Emotional Short Text Conversation(ESTC)
Dataset
80Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 81: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/81.jpg)
Conversations with/without considering emotionEmotional Chatting Machine (ECM)
• User: Worst day ever. I arrived late because of the traffic.
1. Basic Seq2Seq: You were late.
2. ECM (Like): I am always here to support you.
3. ECM (Happy): Keep smiling! Things will get better.
4. ECM (Sad): It’s depressing.
5. ECM (Disgust): Sometimes life just sucks.
6. ECM (Angry): The traffic is too bad!
81Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 82: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/82.jpg)
Overview of Emotional Chatting Machine (ECM)
82Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 83: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/83.jpg)
Overview of Emotional Chatting Machine (ECM)
83Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 84: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/84.jpg)
Overview of Emotional Chatting Machine (ECM)
84Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 85: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/85.jpg)
Data flow of the decoder with an internal memory
85Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 86: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/86.jpg)
Data flow of the decoder with an external memory
86Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 87: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/87.jpg)
Sample responses generated by Seq2Seq and ECM
(Emotional Chatting Machine)
87Source: Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. "Emotional chatting machine:
emotional conversation generation with internal and external memory." arXiv preprint arXiv:1704.01074 (2017).
![Page 88: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/88.jpg)
Chinese Emotional Conversation Generation
(CECG)Evaluation Metric
• Emotion Consistency
– whether the emotion class of a generated response is the same as the pre-specified class.
• Coherence
– whether the response is appropriate in terms of both logically coherent and topic relevant content.
• Fluency
– whether the response is fluent in grammar and acceptable as a natural language response.
88Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/evaluation_metric/
![Page 89: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/89.jpg)
Chinese Emotional Conversation Generation (CECG)Evaluation Metric
IF Coherence and Fluency
IF Emotion Consistency
LABEL 2
ELSE
LABEL 1
ELSE
LABEL 0
89Source: http://coai.cs.tsinghua.edu.cn/hml/challenge/evaluation_metric/
![Page 90: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/90.jpg)
Sequence-to-sequence Learning with Attention for Generation-based STC
90Source: Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. "Rich Short Text Conversation Using Semantic
Key Controlled Sequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing (2018).
![Page 91: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/91.jpg)
General Framework of Controllable Short-Text-Conversation Generation
with External Memory
91Source: Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. "Rich Short Text Conversation Using Semantic
Key Controlled Sequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing (2018).
![Page 92: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/92.jpg)
Controllable Short Text Conversation Examples
92Source: Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. "Rich Short Text Conversation Using Semantic
Key Controlled Sequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing (2018).
![Page 93: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/93.jpg)
Comments Generated Using Different Semantic key Mapping Methods
93Source: Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. "Rich Short Text Conversation Using Semantic
Key Controlled Sequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing (2018).
![Page 94: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/94.jpg)
Generated Responses of Knowledge Introduction by External Memory
94Source: Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. "Rich Short Text Conversation Using Semantic
Key Controlled Sequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing (2018).
![Page 95: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/95.jpg)
How to Build Chatbots
95Source: Igor Bobriakov (2018), https://activewizards.com/blog/a-comparative-analysis-of-chatbots-apis/
![Page 96: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/96.jpg)
Chatbot Frameworks and AI Services
• Bot Frameworks
– Botkit
– Microsoft Bot Framework
– Rasa NLU
• AI Services
– Wit.ai
– api.ai
– LUIS.ai
– IBM Watson96Source: Igor Bobriakov (2018), https://activewizards.com/blog/a-comparative-analysis-of-chatbots-apis/
![Page 97: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/97.jpg)
Chatbot Frameworks
97Source: Igor Bobriakov (2018), https://activewizards.com/blog/a-comparative-analysis-of-chatbots-apis/
![Page 98: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/98.jpg)
98Source: Igor Bobriakov (2018), https://activewizards.com/blog/a-comparative-analysis-of-chatbots-apis/
![Page 99: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/99.jpg)
RasaConversational AI
99
![Page 102: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/102.jpg)
Rasa Core High-Level Architecture
102Source: https://rasa.com/docs/core/architecture/
![Page 103: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/103.jpg)
Rasa the OSS to build conversational software with ML
103Source: Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
https://github.com/RasaHQ/rasa-workshop-pydata-berlin
![Page 104: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/104.jpg)
Rasa NLU: Natural Language Understanding
104Source: Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
![Page 105: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/105.jpg)
Rasa Core: Dialogue Handling
105Source: Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
![Page 106: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/106.jpg)
Rasa Core: Dialogue Handling
106Source: Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
![Page 107: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/107.jpg)
Rasa Core: Dialogue Training
107Source: Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
![Page 109: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/109.jpg)
Learning Semantic Textual Similarity from Conversations
109Source: Yinfei Yang, Steve Yuan, Daniel Cer, Sheng-yi Kong, Noah Constant, Petr Pilar, Heming Ge, Yun-Hsuan Sung, Brian Strope, and
Ray Kurzweil (2018). "Learning Semantic Textual Similarity from Conversations." arXiv preprint arXiv:1804.07754.
![Page 110: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/110.jpg)
TF-Hub ModulesSentence Embedding
Universal Sentence Encoder
110https://tfhub.dev/
![Page 111: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/111.jpg)
Semantic Similarity with TF-HubUniversity Sentence Encoder
111https://colab.research.google.com/github/tensorflow/hub/blob/master/examples/colab/semantic_similarity_with_tf_hub_universal_encoder.ipynb
![Page 112: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/112.jpg)
Semantic Textual Similarity
112https://colab.research.google.com/github/tensorflow/hub/blob/master/examples/colab/semantic_similarity_with_tf_hub_universal_encoder.ipynb
![Page 114: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/114.jpg)
GRAM-CNNBioNER
• GRAM-CNN is a novel end-to-end approach for biomedical NER tasks. To automatically label a word, this method uses the local information around the word. Therefore, the GRAM-CNN method doesn't require any specific knowledge or feature engineering and can be theoretically applied to all existing NER problems.
• The GRAM-CNN approach was evaluated on three well-known biomedical datasets containing different BioNER entities. It obtained an F1-score of 87.38% on the Biocreative II dataset, 86.65% on the NCBI dataset, and 72.57% on the JNLPBA dataset. Those results put GRAM-CNN in the lead of the biological NER methods.
• Pre-trained embedding are from: – https://github.com/cambridgeltl/BioNLP-2016
114Source: Zhu, Qile, Xiaolin Li, Ana Conesa, and Cécile Pereira. "GRAM-CNN: a deep learning approach with local context for named
entity recognition in biomedical text." Bioinformatics 34, no. 9 (2017): 1547-1554. https://github.com/valdersoul/GRAM-CNN
![Page 115: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/115.jpg)
Summary• AI Chatbots
• Conversational Commerce
• Bot Platform Ecosystem
115
![Page 116: AI Chatbots and Conversational Commerce · Chatbot MILABOT: Chatbot developed by the Montreal Institute for Learning Algorithms (MILA) for the Amazon Alexa Prize competition 51 Source:](https://reader036.vdocuments.net/reader036/viewer/2022062414/5ed148c1a225a048a515d501/html5/thumbnails/116.jpg)
References• Yun-Nung Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, and Li Deng (2016), "End-to-end memory networks with knowledge
carryover for multi-turn spoken language understanding." In Proceedings of Interspeech.
• Hakkani-Tür, Dilek, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang. "Multi-domain jointsemantic frame parsing using bi-directional RNN-LSTM." In Proceedings of The 17th Annual Meeting of the International SpeechCommunication Association. 2016.
• Jeongkyu Shin (2016), Building AI Chat bot with Python 3 and TensorFlow, PyCon APAC 2016.
• Ankit Kumar, Ozan Irsoy, Jonathan Su, James Bradbury, Robert English, Brian Pierce, Peter Ondruska, Ishaan Gulrajani, and RichardSocher (2015). "Ask me anything: Dynamic memory networks for natural language processing." arXiv preprint arXiv:1506.07285.
• Antoine Bordes and Jason Weston (2016), "Learning End-to-End Goal-Oriented Dialog." arXiv preprint arXiv:1605.07683.
• Jason Weston, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merriënboer, Armand Joulin, and Tomas Mikolov (2015),"Towards AI-complete question answering: A set of prerequisite toy tasks." arXiv preprint arXiv:1502.05698.
• Iulian V. Serban, Chinnadhurai Sankar, Mathieu Germain, Saizheng Zhang, Zhouhan Lin, Sandeep Subramanian, Taesup Kim et al(2017). "A Deep Reinforcement Learning Chatbot." arXiv preprint arXiv:1709.02349.
• Xuijun Li, Yun-Nung Chen, Lihong Li, and Jianfeng Gao (2017), "End-to-end task-completion neural dialogue systems." arXiv preprintarXiv:1703.01008.
• Jack Cahn (2017), "CHATBOT: Architecture, Design, & Development." PhD diss., University of Pennsylvania.
• Ferrucci, David, Eric Brown, Jennifer Chu-Carroll, James Fan, David Gondek, Aditya A. Kalyanpur, Adam Lally et al.(2010) ". BuildingWatson: An overview of the DeepQA project" AI magazine 31, no. 3 (2010): 59-79.
• Kato, Makoto P., and Yiqun Liu (2017), "Overview of NTCIR-13." In Proceedings of the 13th NTCIR Conference. 2017.
• Huang, Minlie, Zuoxian Ye, and Hao Zhou (2017). "Overview of the NLPCC 2017 Shared Task: Emotion Generation Challenge."In National CCF Conference on Natural Language Processing and Chinese Computing (NLPCC), pp. 926-936. Springer, Cham, 2017.
• Zhou, Hao, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. (2017) "Emotional chatting machine: emotional conversationgeneration with internal and external memory." arXiv preprint arXiv:1704.01074.
• Yu, Kai, Zijian Zhao, Xueyang Wu, Hongtao Lin, and Xuan Liu. (2018)"Rich Short Text Conversation Using Semantic Key ControlledSequence Generation." IEEE/ACM Transactions on Audio, Speech, and Language Processing.
• Justina Petraitytė (2018), Deprecating the state machine: building conversational AI with the Rasa stack, PyData Berlin 2018.
• Yinfei Yang, Steve Yuan, Daniel Cer, Sheng-yi Kong, Noah Constant, Petr Pilar, Heming Ge, Yun-Hsuan Sung, Brian Strope, and RayKurzweil (2018). "Learning Semantic Textual Similarity from Conversations." arXiv preprint arXiv:1804.07754.
116