toward a generalized notion of audio as part of the ... filemodel of modeling actions event 6. jens...

Research Group Information Systemsand Enterprise Modeling

Institute for Computer Science and Business Information Systems (ICB)

University of Duisburg-Essen, Germany

Institut für Informatik undWirtschaftsinformatik (ICB)

Making modeling cognitively better manageable by enhancing modeling languages with audible and sensual means of expression

Toward a generalized notion of audio as part of the concrete syntax of business process modeling languages

Dr. Jens Gulden

Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven

Agenda

1 Motivation

2 State-of-the-art

3 Enhanced notion of model syntax

4 Configuration approach and prototype

5 Conclusion

2


DSMLs / BPMLs incorporate a semantically rich body of knowledge about the modeled domain

Imaginative capabilities required to understand models, associatively 'feel into' the domain

Assumption: multiple perception channels activate imaginative capabilities better than vision only

Conceptual semantics based on bodily metaphors → Embodied Cognition [JohnsonLakoff1999]

Desirable: more than visual access to models

Multiple perception channels to represent content

Define non-visual presentation syntax, e. g. audio

Related research [HermannRitter1999] [Vickers11] [Hildebrandt13]

1. Motivation

3


Concrete syntax specified as static mapping between model concepts and visual appearance

2. State-of-the-art

Car Wheel3..8

hasWheels

Concepts SymbolsMapping

CarMappingType: NodeSymbol

WheelMappingType: NodeSymbol

HasWheelsMappingType: LineArrow

4



2. State-of-the-art

Car Wheel3..8

hasWheels





4

Eclipse GMF



2. State-of-the-art

Car Wheel3..8

hasWheels





Eclipse GMF

MetaEdit+

4



2. State-of-the-art

Car Wheel3..8

hasWheels





Eclipse GMF

MetaEdit+

XModeler

4


Different mode of perception besides visual impressions

Linear, time-based nature, e. g. audio passively perceived, not actively like visualizations

occurrences at specific events during language use

Syntax as interaction process between user and model

Traditional: ternary relation concept

Enhanced notion: quartary relation concept

Demand for a general model of modeling events

3. Enhanced notion of modeling language syntax

(Type, Instance) → Symbol

(Type, Instance, Event) → Symbol, Sound, …

5


Formally describe events and states that occur during modeling

Events are results of modeling actions performed by humans

Potentially more than one event per action

Each event can be associated with a sensual impression

Suggested dimensions, e. g.:

Type (person, business object, action, ...)

Action (by human modeler during modeling)

Action status (started, pending, success, ...)

Model of modeling actions

Event

6


Model of modeling actions: Many questions

In which situations should the occurrence of audio be actively caused by actions of modelers?

Which model elements should make sound without interaction?

Is audio to be used at design time and/or instantiation time? Can there be a unified view on both?

How can the set of actions be conceptualized that are possibly carried out during modeling?

Which states (emptiness of a model, error states, constraints) should be associated with audio?

7


CRUD actions performed by modelers

CREATE

READ (select)

UPDATE (modify)

DELETE

Action stati, different possible depending on object

STARTED

PENDING

SUCCESSFUL

UNSUCCESSFUL

4. Configuration approach

8


GUI mockup for configuration

9


Prototype for demonstration

Model by D. Zheleva and D. Wojtysiak

10


Concrete audio syntax for modeling languages can formally be described, if notion of syntax definition is widened to a procedural view

Results are generally applicable

Other perception channels (e. g. force-feedback, light/temperature environment, olfactory impression)

Potential for extensions

More complex notion of model concepts to represent, e. g. patterns of multiple objects

More complex notion of actions performed by a user, e. g. compound refactoring actions

5. Conclusion

11


Thank you very much –

Jens [email protected]

Thank you

12


[HermannRitter1999]

Thomas Hermann, Helge Ritter: Listen to your data: Model-based sonification for data analysis. In: G. E. Lasker (ed.), Advances in intelligent computing and multimedia systems, Int. Inst. for Advanced Studies in System research and cybernetics, Baden-Baden, 1999, pp. 189–194

[JohnsonLakoff1999]Mark Johnson, George Lakoff: Philosophy in the Flesh, Basic books, New York, 1999

[GuldenRutz07]

Jens Gulden, Holger Rutz: Proposal for an XML format representing Time, Positions and Parts of Audio Waveforms. In: M. Baalman, S. Schampijer (eds.), Proceedings of the Linux Audio Conference 2007 (LAC'07), Berlin, 2007, pp. 1-12

[Vickers11]

Paul Vickers: Sonification for process monitoring. In: T. Hermann, A. Hunt, and J. G. Neuhoff (eds.), The Sonification Handbook, Logos Berlin, 2011, pp. 455–492

[Hildebrandt13]

Tobias Hildebrandt: Towards Enhancing Business Process Monitoring with Sonification. In: N. Lohmann et al. (eds.), Business Process Management Workshops, BPM 2013 International Workshops, Springer, Berlin, 2013

Literature

13

toward a generalized notion of audio as part of the ... filemodel of modeling actions event 6. jens...

Documents