human-centered ai: reliable, safe & trustworthy
TRANSCRIPT
![Page 1: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/1.jpg)
Human-Centered AI: Reliable, Safe & Trustworthy
Ben Shneiderman @benbendc
Founding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer Science
Member, National Academy of Engineering
National Academy of Sciences workshop for Air Force Research LaboratoriesHuman-AI Teaming Through Warfighter-Centered Designs, July 28, 2021
Photo: BK Adams
![Page 2: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/2.jpg)
What is Human-Centered AI?
![Page 3: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/3.jpg)
What is Human-Centered AI?
Amplify, Augment, Empower & Enhance People
![Page 4: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/4.jpg)
HCAI Framework
![Page 5: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/5.jpg)
Designing the User Interface
First Edition: 1986
Balancing automation & human control
![Page 6: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/6.jpg)
Designing the User Interface
First Edition: 1986
Balancing automation & human control
Human control
Computerautomation
![Page 7: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/7.jpg)
Designing the User Interface
Sixth Edition: 2016
Ensuring human control while increasing automation
![Page 8: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/8.jpg)
Designing the User Interface
Sixth Edition: 2016
Ensuring human control while increasing automation
Computer Automation
High
Human Control
High Low
Low
IJHCI (2020) https://doi.org/10.1080/10447318.2020.1741118
![Page 9: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/9.jpg)
HCAI Framework
![Page 10: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/10.jpg)
HCAI Framework
![Page 11: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/11.jpg)
HCAI Framework
![Page 12: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/12.jpg)
Design Metaphors
![Page 13: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/13.jpg)
Design Metaphors
![Page 14: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/14.jpg)
“Robots are simply not people”: Margaret Boden“Humans, not robots, are responsible agents”: Joanna Bryson
• Responsibility: Only humans are liable, legally and morally
• Distinctive capabilities of computers: sophisticated algorithms, huge databases, superhuman sensors, information abundant displays, & powerful effectors
• Human creativity: passion, empathy, humility & intuition
![Page 15: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/15.jpg)
DoD Directive 3000.09: Autonomy in Weapon Systems
- Autonomous and semi-autonomous weapon systems shall be designed to allow commanders and operators to exercise appropriate levels of human judgment over the use of force.- Designed with appropriate … human-machine interfaces and controls - Design autonomous and semi-autonomous weapon systems in such a manner as to minimize the probability and consequences of failures that could lead to unintended engagements or to loss of control of the system. - Readily understandable to trained operators, provide traceable feedback on system status, and provide clear procedures for trained operators to activate and deactivate system functions
![Page 16: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/16.jpg)
Supertools
Spelling correction
Digital Camera Controls Navigation Choices Texting/Search Autocompletion
![Page 17: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/17.jpg)
Supertool: Bloomberg Terminal
![Page 18: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/18.jpg)
Nutri Ninja Blender
Panasonic Rice Cooker
Cuisinart Grind & Brew Coffee Maker
Miele Dishwasher
General Electric Dryer
General Electric Washer
Coffee maker, Rice cooker, Blender Dishwasher, Clothes Washer/Dryer
Active Appliances
![Page 19: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/19.jpg)
Active Appliance: Implanted Cardiac Pacemakers
![Page 20: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/20.jpg)
Tele-Bot: NASA Mars Rovers
![Page 21: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/21.jpg)
Tele-Bot: Da Vinci Surgical System
https://www.davincisurgery.com/
“Robots don’t perform surgery. Your surgeon performs surgery with da Vinci by using instruments that he or she guides via a console.”
![Page 22: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/22.jpg)
Control Center: Hospital
![Page 23: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/23.jpg)
Control Center: Counter Terrorism
![Page 24: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/24.jpg)
Governance Structures
![Page 25: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/25.jpg)
Governance Structures for Human-Centered AI
ACM TIIS (Oct 2020) https://dl.acm.org/doi/10.1145/3419764
![Page 26: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/26.jpg)
Summary
![Page 27: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/27.jpg)
Malicious Actors
Bias
Flawed Software
Thre
ats
Human ValuesRights, Justice & Dignity
Individual GoalsSelf-efficacy, Creativity, Responsibility & Social Connections
Design AspirationsReliable, Safe & Trustworthy
Team, Organization, Industry & Government
Researchers
Developers
BusinessLeaders
Policy Makers
Users
Stak
ehol
ders
HCAIFramework
(Part 2)
DesignMetaphors
(Part 3)
GovernanceStructures
(Part 4)
Human-Centered AI
Oxford University Press (January 2022) https://hcil.umd.edu/human-centered-ai/
![Page 28: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/28.jpg)
HCAI Framework
![Page 29: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/29.jpg)
Design Metaphors
![Page 30: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/30.jpg)
Governance Structures for Human-Centered AI
ACM TIIS (Oct 2020) https://dl.acm.org/doi/10.1145/3419764
![Page 31: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/31.jpg)
Human-Centered Artificial Intelligence: Reliable, safe & trustworthy, International Journal of Human-Computer Interaction 36, 6 (March 2020). https://doi.org/10.1080/10447318.2020.1741118
Design lessons from AI’s two grand goals: Human emulation and useful applications, IEEE Transactions on Technology & Society 1, 2 (June 2020). https://ieeexplore.ieee.org/document/9088114
Bridging the gap between ethics and practice: Guidelines for reliable, safe, and trustworthy Human-Centered AI systems, ACM Trans. on Interactive Intelligent Systems 10, 4 (Oct 2020). https://dl.acm.org/doi/10.1145/3419764
Human-Centered Artificial Intelligence: Three fresh ideas, AIS Trans. on Human-Computer Interaction 12, 3 (Oct 2020). https://aisel.aisnet.org/thci/vol12/iss3/1/
Human-Centered AI, NAS ISSUES 37, 2 (Winter 2021). https://issues.org/human-centered-ai/
Summary & resources: https://hcil.umd.edu/human-centered-ai/
![Page 32: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/32.jpg)
The Future is Human-Centered
Google Group https://groups.google.com/g/human-centered-ai
Twitter Account@HumanCenteredAI
Websitehttps://hcai.site
![Page 33: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/33.jpg)
The Future is Human-Centered
![Page 34: Human-Centered AI: Reliable, Safe & Trustworthy](https://reader030.vdocuments.net/reader030/viewer/2022012020/61688e57d394e9041f708d8d/html5/thumbnails/34.jpg)
Human-AI Teaming for Peacemakers/Peackeepers
• Negotiation, conflict resolution, discussion, deliberation• Collaboration, partnership, diplomacy, cooperation
Yet, the National Security Commission on AI wrote• “to defend and compete in the coming era of AI-accelerated
competition and conflict…to win the AI era” (35 instances of win)