space: the final frontier crisis space/resource allocation

38
1 PAL © 2003 Carnegie Mellon University frontier Crisis space/resource allocation LTI/CSD: Jaime Carbonell, Scott Fahlman, Eugene Fink LTI: Bob Frederking, Greg Jorstad, Ulas Bardak, Thuc Vu, Richard Wang Implicitly: Yiming Yang, William Cohen, Lori Levin, Steve Smith,… December 18, 2003

Upload: fineen

Post on 08-Feb-2016

61 views

Category:

Documents


0 download

DESCRIPTION

Space: The final frontier Crisis space/resource allocation. December 18, 2003. LTI/CSD: Jaime Carbonell, Scott Fahlman, Eugene Fink LTI: Bob Frederking, Greg Jorstad, Ulas Bardak, Thuc Vu, Richard Wang Implicitly: Yiming Yang, William Cohen, Lori Levin, Steve Smith,…. Jaime Carbonell. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Space: The final frontier      Crisis space/resource allocation

1PAL © 2003 Carnegie Mellon University

Space: The final frontier Crisis space/resource

allocation

LTI/CSD: Jaime Carbonell, Scott Fahlman, Eugene FinkLTI: Bob Frederking, Greg Jorstad, Ulas Bardak,

Thuc Vu, Richard WangImplicitly: Yiming Yang, William Cohen, Lori Levin, Steve Smith,…

December 18, 2003

Page 2: Space: The final frontier      Crisis space/resource allocation

2PAL © 2003 Carnegie Mellon University

People

Jaime Carbonell Scott Fahlman

Bob Frederking Richard Wang

E-mail understanding

Thuc VuUlas BardakGreg JorstadEugene Fink

Space allocation

Page 3: Space: The final frontier      Crisis space/resource allocation

3PAL © 2003 Carnegie Mellon University

Purpose

Automated allocation of office space andrelated resources to office users, in bothcrisis and routine situations.

• Satisfy work-related needs ofindividual users and groups

• Maximize user satisfaction• Ensure fair allocation of space

Page 4: Space: The final frontier      Crisis space/resource allocation

4PAL © 2003 Carnegie Mellon University

Urgent space allocation

Toxic Cloud!

- Alloc. solvable?

- Decomposable?

- Cope with surprise: not internet-wired, dispersed,…

Wean Hall

Page 5: Space: The final frontier      Crisis space/resource allocation

5PAL © 2003 Carnegie Mellon University

Main steps

• Elicitation of user preferences

• Near-optimal allocation based onpartial knowledge of preferences

• Mediation of trades among users

• Negotiations with users

Page 6: Space: The final frontier      Crisis space/resource allocation

6PAL © 2003 Carnegie Mellon University

Demo

Page 7: Space: The final frontier      Crisis space/resource allocation

7PAL © 2003 Carnegie Mellon University

Main challenges • How to represent and reason about space

• How to optimize space allocation conditioned on resources, constraints, preferences, and forecasts

• How to cope with uncertainty, such as partial knowledge of preferences, contingency planning based on possible exogenous events, and prediction of negotiation outcomes

• How to learn what works and why

• How to cope with surprise, such as crises, degraded space, new constraints, new preferences, new utility functions, and new optimization criteria

Page 8: Space: The final frontier      Crisis space/resource allocation

8PAL © 2003 Carnegie Mellon University

Knowledge representation

• Need to represent:» Facts: People, departments, equipment, affinity groups,…» Spatial relations: 2D and 3D maps, connectivity, functions,…» Constraints: Minimal space/person, labs w/plumbing and power,…» Preferences: Proximity relations, windows, equipment,…» Utilities: Cost and benefit of satisfying preferences, elasticities,…» Episodes: Past space planning with utilities and outcomes,

including justifications for decisions, retractions,…» Optimization criteria: As first-class objects, so as to reason about

what to optimize and how to assign weights and priorities

• Need to reflect on:» What does not the system know that it needs to know: To

trigger active learning, user interactions,…» What-if scenarios: For multi-user negotiation, to assess the

completeness of the system’s knowledge,…

Page 9: Space: The final frontier      Crisis space/resource allocation

9PAL © 2003 Carnegie Mellon University

Pervasive learning

• Learning at the factual level» By being told: Constraints, preferences, facts,…» By negotiation and examples: Preference weights, utilities,…

• Learning at the planning level» Mode selection: When to plan, when to seek information,

when to negotiate, when to optimize, when to validate,…» Operator selection: How to select best actions within modes» Historical learning: What to reuse/transfer longitudinally

• Learning at the meta level» Self assessment: Utility of the learning (e.g. idiosyncratic

versus general), accuracy of the learning, permanence,…» Targeting the learner: On maximizing expected future

discounted utility, on correcting flaws (unlearning),…

Page 10: Space: The final frontier      Crisis space/resource allocation

10PAL © 2003 Carnegie Mellon University

First fifteen months• Non-crisis space allocation

» Add users to an existing occupied building» Allocate offices in a new building

• Respecting constraints and preferences» Unary: Size, windows, internet, bio-isolation,…» N-ary: Proximity to co-workers, quiet,…

• Optimizing global utility» Maximize preference satisfaction» Minimize moving users already in place

• Coping with uncertainty» Use ranges, defaults, what-if planning» Elicit preferences and trade-offs» Support single-user and multi-user negotiations

Page 11: Space: The final frontier      Crisis space/resource allocation

11PAL © 2003 Carnegie Mellon University

Architecture

Page 12: Space: The final frontier      Crisis space/resource allocation

12PAL © 2003 Carnegie Mellon University

Main modules• Natural-language e-mail communications• Representation of user preferences, which

includes defaults and learned knowledge• Representation of (uncertain) knowledge

of available space and related resources• Optimization based on available knowledge• Intelligent elicitation of user preferences

and information about available space• Single-user and multi-user negotiations• Bartering office space among users• Speed-up and quality learning

Page 13: Space: The final frontier      Crisis space/resource allocation

13PAL © 2003 Carnegie Mellon University

Initial results

• Understanding of space-related e-mail

• Limited representation of space and related resources without uncertainty

• Optimization based on simple preferences

Page 14: Space: The final frontier      Crisis space/resource allocation

14PAL © 2003 Carnegie Mellon University

Initial results: E-mail

understanding

Extraction System

Template Generator

SpaceE-mail

SpaceTemplate

ExtractionRules

ExtractedText

Page 15: Space: The final frontier      Crisis space/resource allocation

15PAL © 2003 Carnegie Mellon University

E-mail example Johnson wants to move to wean, he prefers the room

5102. He wants that room for conducting his experiments. His room will be filled with chemical bottles and equipment. He would like to be on the 5th floor, or higher than the 6th floor, but definitely not lower than the fourth floor please. He prefers the size of his room to be between 10–25 square meters. He will be moving into the room starting 2/28/2004 until May 24, 2004. He likes to have at least a window in his room, if possible. His room should have at least 2 doors. His room does not need internet, but definitely need electricity and 5–10 sinks. He would like to be above the Wean Engineering Library, and below his advisor's office. He would also like to be around 50 to 100 yards away from the building's entrance.

Page 16: Space: The final frontier      Crisis space/resource allocation

16PAL © 2003 Carnegie Mellon University

Extraction rules• Noun phrase identifier

» A rule-based noun phrase chunker utilizing the part-of-speech tags from the tagger

• Name identifier » Identifies names; tolerant of uncased names» Compared with BBN IdentiFinder as baseline

(IdentiFinder was trained on newswire text)» Evaluated on 124 e-mails (test set);

precision/recall based on entire name:

91%89%Our name identifier

65%54%BBN IdentiFinderPrecisionRecall

Page 17: Space: The final frontier      Crisis space/resource allocation

17PAL © 2003 Carnegie Mellon University

Extraction rules

• Negative scope identifier » Determines what part of the sentence has

negated meaning» … but not too far away from his classmates…

• Quantity identifier » Identifies quantities along with logical attributes» … must be a hundred fifty five square feet…

Page 18: Space: The final frontier      Crisis space/resource allocation

18PAL © 2003 Carnegie Mellon University

Extracted textrequester: Johnsonfiller: chemical bottles and equipmentpurpose: conducting his experimentsbuilding: weanroom: 5102date_start: 2/28/2004date_end: May 24, 2004floor_min: the 6th floor | the fourth floorfloor: the 5th floorsize_range: 10–25 square meterswindow_min: a windowentrance_min: 2 doorsentrance: the building's entranceplumbing_range: 5–10internet_neg: internetelectric: electricityrel_above: the Wean Engineering Libraryrel_beneath: his advisor's officedist3_range: 50 to 100 yardsdist3_from: the building's entrance

Page 19: Space: The final frontier      Crisis space/resource allocation

19PAL © 2003 Carnegie Mellon University

Space template after

normalization[Request_Allocation requester: (#Johnson#) filler: (#chemical bottles and equipment#) purpose: (#conducting his experiments#) building: (WEH) room: (5102) floor: (5|>6|>4) size: (>108|<269) start_date: (Sat Feb 28 2004) end_date: (Mon May 24 2004) window: (+) entrance: (+|>2) internet: (-) plumbing: (+|>5|<10) electric: (+) above: (#the Wean Engineering Library#) beneath: (#his advisor's office#) distance: ((>150|<300)(#the building's entrance#))]

Page 20: Space: The final frontier      Crisis space/resource allocation

20PAL © 2003 Carnegie Mellon University

Initial results: Representation

• List of available offices

• Database of basic office properties(size, windows, internet connections,…)

• On-demand computation of other properties(distance between offices, accessibility,…)

Page 21: Space: The final frontier      Crisis space/resource allocation

21PAL © 2003 Carnegie Mellon University

Initial results: Conversion from

AutoCad

• Identify the position of each office• Compute the office areas• Identify the office numbers• Find the shortest paths between offices

DBDB

AutoCadRADAR/Space

Representation

AutoCad maps include line drawings andfree-floating text for office numbers.

Page 22: Space: The final frontier      Crisis space/resource allocation

22PAL © 2003 Carnegie Mellon University

• Transitions:» Assign a user to an office» Remove a user from an office» Exchange locations of two users

Initial results:

Optimization Application of simulated annealing.

• State: Assignment of users to offices; a user may be in a specific office or have no office

• Objective function: Weighted count of unsatisfied user preferences

Page 23: Space: The final frontier      Crisis space/resource allocation

23PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge

» Uncertain knowledge of user preferences » Uncertain knowledge of available space» Allocation of space and related resources» Possible communications with usersUse of Scone for knowledge representation

and inference of implicit information

Page 24: Space: The final frontier      Crisis space/resource allocation

24PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail

» Use of Scone knowledge base» Handling multiple requests in one e-mail» Handling user responses to earlier e-mails» Identifying unclear places in e-mails and

asking users for clarification

Page 25: Space: The final frontier      Crisis space/resource allocation

25PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies

» User-friendly explanations» Politeness and diplomacy

Page 26: Space: The final frontier      Crisis space/resource allocation

26PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge

» Find an allocation with a (near-)largest expected value of the objective function

» Estimate the standard deviation of the resulting expected value

» Determine what additional information may reduce the standard deviation

Page 27: Space: The final frontier      Crisis space/resource allocation

27PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Preference elicitation and negotiation

» Select questions that reduce uncertainty» Estimate probabilities of possible replies» Reduce the number of e-mails to users

Page 28: Space: The final frontier      Crisis space/resource allocation

28PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation, with respect to

» Novice users» Helpful users» Busy users

Page 29: Space: The final frontier      Crisis space/resource allocation

29PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation• Soft commitments and cancellations

» Support different levels of commitment» If breaking a commitment to a user,

negotiate appropriate compensation

Page 30: Space: The final frontier      Crisis space/resource allocation

30PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation• Soft commitments and cancellations• Bartering among users

» Allow users to offer office-space trades» Identify prospective multi-user trades

Page 31: Space: The final frontier      Crisis space/resource allocation

31PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation• Soft commitments and cancellations• Bartering among users• Interaction with human administrators

» Providing relevant information» Asking help with complex decisions» Supporting multiple administrators

Page 32: Space: The final frontier      Crisis space/resource allocation

32PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation• Soft commitments and cancellations• Bartering among users• Interaction with human administrators• Learning new knowledge and strategies

» User preferences» Negotiation strategies» E-mail understanding

Page 33: Space: The final frontier      Crisis space/resource allocation

33PAL © 2003 Carnegie Mellon University

Future tasks• Representation of relevant knowledge• Understanding of space-related e-mail• Generation of e-mail replies• Optimization based on partial knowledge• Elicitation of preferences and negotiation• Fairness of space allocation• Soft commitments and cancellations• Bartering among users• Interaction with human administrators• Learning new knowledge and strategies• Graphical user interface

» Visualization» Spatial input

Page 34: Space: The final frontier      Crisis space/resource allocation

34PAL © 2003 Carnegie Mellon University

Schedule of initial versions

• Knowledge representation (March 2004)• Understanding e-mail (March 2004)• Generation of e-mail replies (March 2004)• Partial-knowledge optimization (May 2004)• Elicitation of preferences (May 2004)• Fairness of space allocation (December 2004)• Soft commitments and cancellations (2005)• Bartering among users (2005)• Interaction with human administrators (2005)• Learning new knowledge (long term)• Graphical user interface (long term)

Page 35: Space: The final frontier      Crisis space/resource allocation

35PAL © 2003 Carnegie Mellon University

Interaction with other systems

• Scheduling» Determine the availability of specific users» Anticipate the needs of users and groups

• E-mail» Identify and prioritize space-related e-mails» Estimate response times of specific users

• Webmaster» Provide on-line information about space

• User studies» Evaluate user satisfaction» Improve interaction with users

Page 36: Space: The final frontier      Crisis space/resource allocation

36PAL © 2003 Carnegie Mellon University

Evaluation

• Allocation quality

• Speed and scalability

• Uncertainty tolerance

• Surprise tolerance

• User-friendliness

Page 37: Space: The final frontier      Crisis space/resource allocation

37PAL © 2003 Carnegie Mellon University

To be continued…

Page 38: Space: The final frontier      Crisis space/resource allocation

38PAL © 2003 Carnegie Mellon University

Allocation quality

Maximizing quality of space allocation ai• Subject to time constraints, available

extrinsic data, available task information, and communication constraints

• Comparison with the results of omniscient unconstrained optimization aopt

0 0 0( ) ( )( | , , ) [0,1]

( ) ( )b i

i mb opt

C a C aQ a t t k rC a C a