0900 taylor

8/2/2019 0900 Taylor

1/18

TfL Journey AngelTfL Journey Angel

Context Aware Decision SupportContext Aware Decision Support

Marcus Taylor

[email protected]

8/2/2019 0900 Taylor

2/18

Page 2Confidential -27 Sep 2007

The Transport for London BriefThe Transport for London Brief

Demonstrator NameDemonstrator Name Mobile avatar solutionMobile avatar solution Journey AngelJourney Angel

DescriptionDescription This demonstrator will deliver a mobile avatar system prototype that willThis demonstrator will deliver a mobile avatar system prototype that willassist the passenger throughout his time in London: preassist the passenger throughout his time in London: pre--journey, injourney, in--

journey and postjourney and post--journey.journey.

The software uses a smart mobile client to produce a mobile avatar withThe software uses a smart mobile client to produce a mobile avatar withspeech capability.speech capability.

The Avatar will support advisory/decision support actions including:The Avatar will support advisory/decision support actions including:

Installation, configuration and personalisation of AvatarInstallation, configuration and personalisation of Avatar

Incident alertingIncident alerting

Delay alertingDelay alerting

Planning supportPlanning support

The client software will communicate to the server system for updatedThe client software will communicate to the server system for updatedcontent.content.

The Avatar will do pseudo realistic lip synching.The Avatar will do pseudo realistic lip synching. Loquendo will be used for real time text to speechLoquendo will be used for real time text to speech

8/2/2019 0900 Taylor

3/18


TechnologyTechnology

ClientClient

N73

Symbian

Flash

Loquendo

MRIX

ServerServer

EjabberD (XMPP compliant jabber IM server)

Erlang/OTP

8/2/2019 0900 Taylor

4/18


What behind Journey Angel ?What behind Journey Angel ?

TheJourney Angel is a powerful platform for distributedTheJourney Angel is a powerful platform for distributedcontextcontext--aware information spreading, usingaware information spreading, using

Standard technologies (Erlang, Jabber, Flash)

Decentralized management

Intrinsicallyrobust architecture

Scalability

Those characteristics are critical forThose characteristics are critical for TFLTFL: they need a: they need a

solution to manage customized messaging to millions ofsolution to manage customized messaging to millions of

travellers everyday....travellers everyday.... ...and Journey Angel gives such a solution...and Journey Angel gives such a solution

8/2/2019 0900 Taylor

5/18


The target (from TFL perspective)The target (from TFL perspective)

The system allows users to:The system allows users to: Get travel information

Plan trips according to their future activities

Get context-aware information about delays, diversions, alerts

and similar

Get additional (mostlyunspecified) customised information, e.g.

advertisement, weather, commercial....

It is likely thatIt is likely that TFLTFL would like to develop the systemwould like to develop the systeminto to ainto to a real product...real product...

...and there are many other use...and there are many other use--cases that can becases that can beaddressed by context aware system....addressed by context aware system....

8/2/2019 0900 Taylor

6/18


The final system: what we have nowThe final system: what we have now

8VHU3UR[\

-3

7UDIILF

%%&

'LYHUVLRQV

6\VWHP&RQILJXUDWLRQ

:HE,QWHUIDFHPDQDJ

/RFDWLRQ

9HKLFOH

9HKLFOH

/RFDWLRQ

5RXWH

5RXWH

8VHU5RXWHV

L&DO6HUYHU

:HE,QWHUIDFH6LP

8/2/2019 0900 Taylor

7/18


Journey Angel: DeviceJourney Angel: Device

Journey Angel on the device uses theJourney Angel on the device uses the

following:following:

MRIX to provide integration between the UI,

TTS, server-side and native device applications(calendar and contacts)

XMPP to communicate with the server

Flash for the User Interface Loquendo for Text To Speech

8/2/2019 0900 Taylor

8/18


Device side architectureDevice side architecture

;033FRPPXQLFDWLRQZLWKVHUYHU

)ODVKEDVHG8,

05,;

1DWLYH$JHQGD

1DWLYH&RQWDFWV

/RFDWLRQ7DFNHU

/RTXHQGR

8/2/2019 0900 Taylor

9/18


TfL Start Menu (TVF)TfL Start Menu (TVF)

MenuMenu

Take me HomeTake me Home

Take me toTake me to

Meet withMeet with

Where am I?Where am I?

What next?What next? SettingsSettings

ExitExit

Text/Voice/Face Menu

14:01

07:3205:00

Traversing HorizontallyTraversing Horizontally

Weather, Calendar, Alerts,Weather, Calendar, Alerts,

Map/Itinerary and PoIsMap/Itinerary and PoIs

Scroll VerticallyScroll Vertically

Details, rewind, playbackDetails, rewind, playback

8/2/2019 0900 Taylor

10/18


MRIX: Integrating server and Flash UIMRIX: Integrating server and Flash UI

An MRIX script provides communication between theAn MRIX script provides communication between the

server and Flash UIserver and Flash UI

The script runs in the background communicating withThe script runs in the background communicating with

the serverthe server

Messages received can be personalised and thenMessages received can be personalised and thenconverted to speechconverted to speech

Once in audio form the Flash UI can be told to 'speakOnce in audio form the Flash UI can be told to 'speak

the message'the message'

8/2/2019 0900 Taylor

11/18


MRIX: Integrating Flash UI and native appsMRIX: Integrating Flash UI and native apps

MRIX enables the built in Contacts and Agenda to beMRIX enables the built in Contacts and Agenda to be

usedused

Routes can be automatically retrieved based on anRoutes can be automatically retrieved based on an

appointment in the agendaappointment in the agenda

Contacts can be 'tagged' with network information,Contacts can be 'tagged' with network information,such as Cell ID and Bluetooth Access Point to helpsuch as Cell ID and Bluetooth Access Point to help

locate a personlocate a person

8/2/2019 0900 Taylor

12/18


Journey Angel: BackendJourney Angel: Backend

Journey Angel relies on a backend infrastructure basedJourney Angel relies on a backend infrastructure based

onon

XMPP (Jabber) communication protocol (Ejabberd)

Erlang server applications

Interfaces to information feeds

8/2/2019 0900 Taylor

13/18


Behind the scenes...Behind the scenes...

$GYHUW %%&QHZV

:HDWKHU -RXUQH\3ODQQHU7UDIILF

(MDEEHUG%DFNHQGDSSOLFDWLRQV

8/2/2019 0900 Taylor

14/18


Backend Applications: proxiesBackend Applications: proxies

5HDO(QWLWLHV

9LUWXDO,PDJHV

$YDWDUSUR[\

$YDWDUSUR[\

%86SUR[\

6WDWLRQSUR[\

5HDO:RUOG

6HUYHUVLGH5HSUHVHQWDWLRQ

8/2/2019 0900 Taylor

15/18


Backend Applications: interfacesBackend Applications: interfaces

-RXUQH\SODQQHU

%%&QHZV:HDWKHUIRUHFDVW

7UDIILF,QIRUPDWLRQ

-3LQWHUIDFH

%%&QHZVLQWHUIDFH

:HDWKHULQWHUIDFH

7UDIILFLQWHUIDFH

8/2/2019 0900 Taylor

16/18


Internal communicationInternal communication

-3LQWHUIDFH

%%&QHZVLQWHUIDFH

7UDIILFLQWHUIDFH

%%&QHZVFKDWURRP

-3FKDWURRP

7UDIILFFKDWURRP

$YDWDUSUR[\ $YDWDU

SUR[\%86SUR[\

6WDWLRQSUR[\

:HDWKHULQWHUIDFH

:HDWKHUFKDWURRP

8/2/2019 0900 Taylor

17/18


The SystemThe System

8VHU3UR[\

-3

7UDIILF

%%&

'LYHUVLRQV

6\VWHP&RQILJXUDWLRQ

:HE,QWHUIDFHPDQDJ

/RFDWLRQ

9HKLFOH9HKLFOH

/RFDWLRQ

5RXWH

5RXWH

8VHU5RXWHV

L&DO6HUYHU

:HE,QWHUIDFH6LP

8/2/2019 0900 Taylor

18/18


ConclusionsConclusions

The system demonstrates how it is possible to deliverThe system demonstrates how it is possible to deliver

real time decision support systems to mobile users byreal time decision support systems to mobile users by

combining Jabber, XMPP, 3G and Smart Phones usingcombining Jabber, XMPP, 3G and Smart Phones using

SymbianSymbian

The use of Erlang/OTP has enabled us to deliver aThe use of Erlang/OTP has enabled us to deliver a

feature rich, robust and functioning system in shortfeature rich, robust and functioning system in short

timescalestimescales

The system has the potential to provide personal angelsThe system has the potential to provide personal angels

for horizontal and vertical applications such as finance,for horizontal and vertical applications such as finance,health, logistics where the context and timeliness ofhealth, logistics where the context and timeliness of

information constitute value.information constitute value.

0900 taylor

Documents