matthew gough - brunel university londonpeople.brunel.ac.uk › bst › documents ›...

21
MATTHEW GOUGH Notation Reloaded: eXtensible Dance Scripting Notation ABSTRACT This paper presents a new form of dance notation that has a hand written and machine readable format: eXtensible Dance Scripting Notation (xdsn). The notation system is designed to be quick to write, simple to learn and able to handle complex, emergent and deconstructivist dance works. The machine readable format of xdsn is platform independent, searchable, and well formed to encourage the development of dance notation software. An overview of the system is given illustrating its context in current contemporary dance ontology and as a mechanism for notation driven avatar animation. eXtensible Dance Scripting Notation was developed by the author of this paper in direct response to a proposal from Michael Klein for alternative methods of dance scripting. The system (version 0.3), is currently in localised use and will be developed at the School of Computing Sciences, University of East Anglia, Norwich. This work will be undertaken as a Phd Research project under the leadership of Professor John Glauert. I - BACKGROUND Michael Klein [1] proposed that multiple choreographers’ timelines, dynamic lines, space-diagrams and scribbles could be examined to develop a common scripting language. This choreographic scripting language could then be used to develop and plan dance works. Although he advocated a paper based, left to right reading format his intention was avoid a linear notation system that would potentially prevent the scripting of complex and emergent works. Klein asserts that: Visualisation is a broader problem these days as now [sic] longer everything is logically determinable. In science problems of complexity, quantum physics, chaos theory, etc. give us 'un-visualsable'[sic] ideas to deal with. How can even a concept of relative time be meaningfully represented. It seems like a certain 'class of visualisation' stopped with relativity theory. Nevertheless this hasn't stopped us to notate along [sic], scribble on drawing pads, making lines to imagine a performer's path, dots to make clear that there is a stress in movement and 'really, really, really black dots' to 'double stress' an event. Klein [1] Hagendoorn supports this view claiming, '[t]he more complex a system becomes, the more information is needed to describe it, in terms of a choreography: the more instructions one has to give to the dancers' [2].

Upload: others

Post on 25-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

MATTHEW GOUGH

Notation Reloaded: eXtensible Dance Scripting Notation

ABSTRACT

This paper presents a new form of dance notation that has a hand written and machine readable format: eXtensible Dance Scripting Notation (xdsn). The notation system is designed to be quick to write, simple to learn and able to handle complex, emergent and deconstructivist dance works. The machine readable format of xdsn is platform independent, searchable, and well formed to encourage the development of dance notation software. An overview of the system is given illustrating its context in current contemporary dance ontology and as a mechanism for notation driven avatar animation. eXtensible Dance Scripting Notation was developed by the author of this paper in direct response to a proposal from Michael Klein for alternative methods of dance scripting. The system (version 0.3), is currently in localised use and will be developed at the School of Computing Sciences, University of East Anglia, Norwich. This work will be undertaken as a Phd Research project under the leadership of Professor John Glauert.

I - BACKGROUND

Michael Klein [1] proposed that multiple choreographers’ timelines, dynamic lines, space-diagrams and scribbles could be examined to develop a common scripting language. This choreographic scripting language could then be used to develop and plan dance works. Although he advocated a paper based, left to right reading format his intention was avoid a linear notation system that would potentially prevent the scripting of complex and emergent works. Klein asserts that:

Visualisation is a broader problem these days as now [sic] longer everything is logically determinable. In science problems of complexity, quantum physics, chaos theory, etc. give us 'un-visualsable'[sic] ideas to deal with. How can even a concept of relative time be meaningfully represented. It seems like a certain 'class of visualisation' stopped with relativity theory. Nevertheless this hasn't stopped us to notate along [sic], scribble on drawing pads, making lines to imagine a performer's path, dots to make clear that there is a stress in movement and 'really, really, really black dots' to 'double stress' an event. Klein [1]

Hagendoorn supports this view claiming, '[t]he more complex a system becomes, the more information is needed to describe it, in terms of a choreography: the more instructions one has to give to the dancers' [2]. However, the perception of complexity is dependant on the observer, for whilst it is possible to illustrate complex systems (by grouping and linking) the act itself negates their complexity. Conversely, ostensibly simple looking systems can potentially be hugely complex. It can be argued therefore, when notating complex dance works the ability to define events is more important than the ability to illustrate their complex links.

William Forsythe's deconstructivist works clearly illustrate the challenges to traditional notation systems when documenting complex or emergent choreography. When using Laban Notation to document William Forsythe's Artifact II (1984) Sandra Aberkaln used colour to define structured improvisations (tasks), set choreography and choreographic directives open to dancer choice [3]. Although Aberkaln's solution demonstrates that adaptation of existing systems is possible, it only adds to the

Page 2: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

difficulty of mastering such systems and reduces the speed of notation. Any new system of notation (in order to be useful) must be able to handle such functions natively and quickly to aid the planning and development of new choreographies.

Royce Neagle's review of dance notation software [4] highlights the need for any new notation to be designed with software development and avatar animation in mind. Aside from the difficulties of converting abstract symbol (glyph) based notations into computer based languages, Neagle also reveals the inability of current machine readable notation scores to be searched for specific content. For the purposes of dance research and analysis, the ability to search a database of machine readable notation would be a huge advantage when examining an artist's body of work. Searchable and well formed data would also ease integration and communication with existing software, facilitate new software development and provide clear mapping points for avatar animation systems.

 

II - CONCEPT & GOALS

To facilitate development a clear set of concepts and goals were laid out. The notation should:

be simple to learn and quick to write. be dual format (hand written and machine readable). be able to handle complex, emergent deconstructivist works. be capable of scripting and planning dance works in addition to

documentation. read from left to right (allowing alignment with music scores and timeline

based software). be capable of preserving the choreographer's unique approach. be extendable to allow notation of new or work specific concepts or terms. allow the inclusion of drawings, scribbles or any abstract symbols whilst

retaining the notations machine readable capabilities. allow referencing of supporting materials such as video, photographs, sound,

text etc. have a well formed machine readable syntax to facilitate data mining [5],

software development and avatar animation. allow the creation of machine readable scores and notation software with

minimal resources. be platform and software independent. allow human comprehension of the machine readable format.

The notation should inform, not instruct.

III - THE SCORE

The design requirements for the notation score called for a similar approach to western music notation. Benesh Movement Notation [6] and Sutton Dance Writing [7] both use scores based on the five staff music stave. Although this arrangement is useful when presenting the notation alongside music scores, this advantage is gradually being negated by the use of electronically composed music and sound scapes which have no written score. The limitations of western music notation when notating emergent forms can be inferred by the various adaptations of the system made by the 20th century avant garde composers such as John Cage, Steve Reich

Page 3: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

and Karlheinz Stockhausen [8]. An analysis of choreographic scribbles alongside 20th century music scores revealed several parallels in the use of abstract symbols and textual instructions. The work of Stockhausen was particularly informative in this context, especially the score for Kontakte für elektronische Klänge, Klavier und Schlagzeug (1960). Dack claims that 'The "realisation" score [sic] of Kontakte is, in effect, a published version of his principal sketches and work-plans.' [9] Dack's assertion is due in part to the 'boxed in' scribbles used to represents sound events, unrefined and ambiguous they appear to be 'workings out' rather than finished notation. The final design for the new score draws on Stockhausen's work for its form and the visual design theory of Edward R. Tufte as a guide to arranging the content [10][11][12].

The basic score for the notation system consists of a single stave, single staff and bar lines:

The formal, yet open design of the score allows maximum flexibility of use whilst remaining simple to implement and interpret. The score has several guidelines:

use the single staff or multiple staves to separate different elements (e.g. dynamics, comments, floor plan).

group events that occur in a close time frame. nest events that are related and / or occur together. define what element/s are most important and then specify secondary,

tertiary elements and so on. script as you work, let the score reflect your working process be concise.

As long as the notation occurs within the basic score it is possible to make a machine readable version of the scripting.

Notes on the score:

The single staff can occur at any point on the stave, the default position is centre stave:

Page 4: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

When multiple staves occur in the same timeline bar lines run across the staves and link them together:

The end of a stave is signified by a bar without a staff. This is the 'at rest' bar and may be used at throughout the score. When making detailed notations to describe a specific movement event, the 'at rest' bar should be used to define the start and end positions. This is particularly relevant when using the notation to animate avatars as

Page 5: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

many animation packages use a standing avatar as default. This notation does not have a default body position.

To indicate a stave has finished (whilst other staves remain) or the absence of events in a bar, the staff is continued but the stave is not drawn:

Comments on the movement, performance based tasks, sound effects, lighting effects, props, floor plans (etc) can be placed on the score. The length of the bars can be specified in terms of time (hh:mm:ss), music time signatures, or left open to interpretation. These markings should be placed immediately after the bar line at the top of the stave.

The single staff can also be used to guide the creation of one and three dimensional scores [13] that embody post structuralist principles. With the range of scripting approaches available, it is possible to document, plan or script dance works whilst retaining the 'essence' of a work and documenting the choreographer's working process.

 

IV - THE NOTATION

The xdsn system draws on the strengths of existing notation systems [14] utilising word, abstract symbol and numerical notation markings. Because xdsn aims to imply rather than instruct, movement can be separated from body location and limbs can be notated without specifying which side (e.g. leg). If very concise notation is required combinations of the symbols can be used to define what, why, where and how an event happens. For example, first arabesque 'could' be notated as:

Page 6: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

In order to ease the transformation of the hand written notation into the machine readable format, the hand written notation is grouped into defined elements and values. Only the values are used in the hand written score allowing the elements to be derived from them and added during conversion into the machine readable format. An overview of the elements and values is given below.

IMPULSE

The impulse element is based on the work of Longstaff [15][16], Nakata [17], Bernstein [18][19], Kandinsky [20][21] and Jeannerod [22].

To notate the orientation of movement in three dimensional (Euclidean) space, Euler angles (Pitch, Roll, Yaw), with an axis rotation (_) are used. The Euler angles and rotation are given as a set of four numerical values:

Pitch (y axis) Yaw (z axis) Roll (x axis) Axis-rotation (_, around the z-axis)

The values are written as four sets of three digit numbers from 000 to 360 (a full circle being 360 degrees) in negative and positive numbers. The movement direction is clockwise and upward for positive numbers, anti clockwise and downward for negative numbers. To understand how this works try the following exercise:

Stand up with you palm facing your thigh (this is the start position for each set of values), the right wrist is the body location leading the movement.

090 000 000 000 - the wrist impulse is 90° (degrees) pitch, the arm rises to elbow level in front of you. you palm is facing the left.

Page 7: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

090 090 000 000 - 90° pitch 90° yaw, the arm comes to elbow level and out to the side in one continuous motion. you palm is facing the front.

090 090 090 000 - 90° pitch 90° yaw 90° rotation. same as above except now the palm is facing the ceiling.

090 045 090 045 - 90° pitch 45° yaw 90° rotation, 45° axis-rotation. same as above, the axis-rotation (_) means that this impulse starts at 45° angle from the start point (z).

Due to the nature of the impulse element it is not possible to derive the location of other body parts form the notation (unless given) nor understand 'where you are going' without following the full passage. Hutchinson Guest describes the situation as being on a boat at sea '... tacking this way and that, ... But to avoid getting lost one has to determine the boat's position, to relate to points on the globe, to know one's latitude and longitude. At some point movement also needs to be similarly defined' [23]. Although such definitions are important for the repeatable reconstruction of set works, many modern works are not as clearly defined. Focus has shifted away from where the dancer moves through the space, to how they move through their body in a defined space. The impulse element reflects this change. To speed up the writing process up to two zeroes can be stripped from the values as needed.

Because the four numerical values of the impulse element relate to Euler angles and rotation matrices they can be converted to Quaternions, a standard method for describing motion in computer animation and motion capture data. One advantage of this method is that little interpolation is needed when using the notation for computer animation or converting motion capture data into human readable notation scores.

PATH

The path element is used to describe the path a movement takes (impulse defines direction). Although the path element has a defined set of values, these can be added to if required by the choreographer. When adding custom values they should be prefixed with the word 'path' in the first instance for reading clarity. The defined values for the path element are:

line, angle, rectangle, curve, circle, spiral, twist, zigzag, release, arbitrary, translation.

The path element can be used alone or in conjunction with other elements (090 000 000 000 curve).

MOVE

The move element is used to describe global movements that would otherwise involve extraneous notation. The values for the move element are:

rise, hop, leap, jump, step, walk, run, slide

the attribute is applied to the leading rather than the working leg:

hop with right knee in air: k_r hop

Page 8: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

leap left to right leg: ll_r leap kneel left knee on floor: k_l kneel

Remember that: hop= no change, leap= one foot to other foot, jump= both feet together. The move element can be used alone or in conjunction with other elements (090 000 000 000 curve slide).

Effort

The effort element is drawn directly from the work of Laban [24] and is used to describe movement dynamics. The values for the effort element have been design to work with the EMOTE model for effort and shape [25] and the work of Liwei Zhao [26]. The values are paired and only one value from each pair can be given.

direct / indirect strong / light sudden / sustained bound / free

The values can also be given a numerical value from minus ten to plus ten for more accurate description and EMOTE mapping.

The effort element can be used alone or in conjunction with other elements (090 000 000 000 curve slide sudden_10 free_-5).

BODY LOCATIONS

Because the elements relating to movement can be placed at any point on the score, a list of body parts must be specified. The body location elements are given below:

<w> wrist (undefined)<w_l> wrist left<w_r> wrist right <e> elbow (undefined)<e_l> elbow left<e_r> elbow right <s> shoulder (undefined)<s_l> shoulder left<s_r> shoulder right

The same notation model continues for other body parts: <hip> hip, <k> knee, <a> ankle, <ua> upper arm, <la> lower arm, <ul> upper leg, <ll> lower leg, <hand> hand, <foot> foot. Fingers and toes are notated from 1 to 5 (1 being the big toe or thumb) given the prefix 'm' (metatarsal / metacarpal) and used as a prefix of the hand or foot element, for example:

<m5_foot_l> little toe left foot

Each bone in the finger or toe can also be defined. The head and spine are identified and abbreviated as follows:

<head> head<vc> vertebral column (whole spine)

Page 9: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

<cerv> cervical spine<thor> thorasic spine<lumb> lumber spine<sacr> sacral spine

The short form should be used (with or without the angle brackets <>) and not the longer description. Although body locations are set the system allows any point to be defined by the choreographer according to need. This should be noted on the score and the same form used consistently, e.g. '<liver>=body location' then just the short form 'liver' can be used throughout the score.

PRESSURE POINT (WEIGHT)

In everyday use the term weight is often synonymous with the term mass. However, mass is different. What you weigh has to do with gravity; your mass is measured without gravity. To define mass more specifically, it is necessary to use Newton's second law of motion: F = Ma.

Weight: the force that gravity exerts on a body of mass Mass: the amount of matter an object contains Centre of gravity: the point through which the force of gravity seems

to act (the balance point) in uniform gravity - it is equal to the centre of mass

What we perceive when we 'feel weight' in a movement is the change of location at which we can 'feel' the force of gravity act. We cannot transfer this force as it acts on all parts of our body. Because we are unable to perceive our centre of gravity (as it can lie outside the body) it is unsuitable for notation and this is the reason why we have the term 'weight'. However, rather than 'weight' the element used is pressure point <pp>. This re labeling means the element can be used to identify where the 'weight' is, and for describing any point of contact where pressure is given or received (such as lifting or supporting). Using a combination of impulse, path , body location and pressure point elements it should be possible to notate the complex weight bearing and dynamic shifting found in contact improvisation.

The pressure point element, as with the other elements, can occur at multiple body locations at the same time.

NOTES ON THE NOTATION:

The impulse element is not confined by the angles or degrees of freedom available in the human body (unlike human movement simulation software). During real human motion we adapt the position of related joints or whole body alignment to allow greater rotational freedom. This can be observed clearly in salsa style dancing and contact improvisation. Limited degrees of freedom should be used to describe how the body behaves not how it moves, it is the limiting of degrees of freedom that defines the style of movement not how it is generated. The unusual implementation of the impulse element is intended to be used with a novel, epikinetic framework for avatar animation that synthesises rather than simulates human movement. Instead of replicating 'how' the body moves (degrees of freedom or visual impressions such as motion texture), the framework models the mechanisms that 'drive' movement using algorithms to simulate and synthesize motion impulse. Using this combined approach (the framework and notation) it should be possible to create real time, autonomous avatar animation with a high level of movement fidelity using minimal

Page 10: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

resources. Epikinetic modelling is based on Hypokinetic and Hyperkinetic Kinesthesia with particular reference to Sydenham's Chorea.

Traditionally dance notations work with a single kinesphere, 'whole body' approach. This new notation system deconstructs the body into multiple autonomous kinespheres with individual as well as grouped movement potential.

Any part of the body can determine momentum and direction, generating chains of movement that are refracted from one bodily part to another, simultaneously coordinating and isolating movements in bewilderingly complex configurations. The bodies can be seen as polyphonies instruments that can generate movement from any point rather than take impetus from the arms, or legs around a vertical trunk. Forsythe [27]

Hermans claims that '[i]n using the available DOF's (degrees of freedom) at every joint, it is possible to develop a refined and articulated moving body. It is a way of generating local movements in a highly coordinated system' [28]. Yet this coordination simply describes how the body works in normal motion. Forsythe's approach, rather than creating a coordinated whole strives towards an un-coordinated interrelated whole. A polyphony of disparate independent points connected by limitations of the human body (degrees of freedom) and physics (gravity, mass, force).

The notation is not a fixed form presentation. The syntax and lexis is set, but extensible and defined in such as way as to allow individual approaches as to how the notation is written and the score implemented. A hand written xdsn score for an improvisation is shown below:

Page 11: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

V - MACHINE READABLE SCORES & NOTATION

Despite the existence of various notation software products [29] early attempts to convert notation into machine readable code ran into several difficulties. Problems included abstract symbol to Euler angle and quaternion conversion [30], cross platform operability [31] and complexity of software development [32]. Because the new notation has been developed with machine readability as part of the design requirements a more rapid and low cost software development period should result.

The machine readable file format of the score and notation uses XML and SVG; XML (eXtensible Markup Language) is used to encode the score and written content [33]SVG (Scalable Vector Graphics) is used to encode drawings and scribbles [34]

Why XML

XML has been designed to describe data. Using this format, files will be searchable, hardware / software independent and be able to share and exchange data with multiple systems. The advantages are:

the ability to search the notation for dance analysis and research no restriction on operating systems (mac, windows, unix, linux etc compatible) a file format that can be created with existing / free tools a file format that encourages new software development

Page 12: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

a file format that music, lighting, video, and emergent technology artists can utilise

The use of XML to describe human movement has been proposed and investigated for use in animating virtual avatars for some time. HumanML [35] attempts to codify human thought, emotion, gestures, attitude, intent and many other aspects of the human condition. However, it is overly complex for quick notation and unsuitable in terms of limited gesture description for the purposes of dance notation.

Attempts to turn sign language notation [36][37] into an XML format have been more successful. This is in part due to the limited number of limbs used, constrained degrees of freedom and formal vocabulary that sign languages use [38][39]. Not only can these systems be used for 'real time' animation of sign language notation for web and kiosk services but the transformation of motion capture data into xml sign languages notation. The only working XML notation relating specifically to dance notation is the Country Dance animation project [40] in which XML and Java [41] are used to show overhead views of Country dance patterns. Clearly such an interpretation is too limited for contemporary choreographic needs.

Two different projects have presented mock-up Labanotation in XML format but they have not been developed, nor do they conform to the conventions of the written Labanotation score [42][43]. However the problem does not lie in XML's suitability for encoding stave based notation. As MusicXML [44] demonstrates, XML can be successfully used to represent symbol based notations and scores and can be applied to a wide range of applications and custom built software. Indeed, during the design of the machine readable format for the new notation, an XML based mark up for Labanotation was designed as a proof of concept. It is believed that the Dance Notation Bureau in association with the Ohio State University is developing an xml based implementation of Labanotation but at time of writing no details were available.

The design of the xml notation markup has been optimised for human reading. The design should ease the creation and comprehension of machine readable scores (or conversion of existing documented dance works) by hand and encourage experimentation with the system and file format. The machine readable format is essentially the handwritten score with 'tags' [45] (the elements) encapsulating the content (the values).

The XML mark up is bar centric rather than part centric, this is to say, the time frame that events happen in is given precedence over the time line in which they occur. This layout is to ease human reading and creation of the markup. The creation of the XML based file requires only a text editor and a web browser, something every operating system provides for free. Therefore machine readable scores can be created from the hand written versions with a minimum of resources, the advantages of this situation are clear.

an example of the xml markup:

<?xml version="1.0" encoding="utf-8"?> <xdsn version="0.3" xmlns="extensible dance script notation">    <details>       <title>Lorem ipsum dolor sit amet</title>       <choreogrpaher>consectetuer adipiscing eli</choreogrpaher>       <License

Page 13: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

rdf:resource="http://creativecommons.org/licenses/by-sa/2.0/">attribution share alike</License>    </details>    <score title="Lorem ipsum dolor sit amet" inter_xds="xds_en">       <bar_1>          <stave_a> <!-- content above single staff line -->             <staff /> <!-- content below single staff line -->          </stave_a>          <stave_b>             <xds>                <note>Fusce tincidunt, neque eget cursus venenatis</note>             </xds>             <staff />          </stave_b>       </bar_1>       <bar_2>          <stave_a>             <staff />          </stave_a>          <stave_b>             <staff />          </stave_b>       </bar_2>    </score> </xdsn>

To see how the file works copy and paste the code into a text editor as a text file. Then save the file and rename the extension to .xml and open it in a web browser. Use the + and - to collapse and expand the element listings.

WHY SVG?

Because SVG is text based the image information can be placed inside the file format itself rather than depending on additional information. SVG is also scalable without loss of quality, this makes it suitable for printing scores in various sizes and formats from a single file. SVG data can be generated by random, fractal, algorithmic, evolutionary, geometric and other methods, allowing work to be devised according to the principles used. SVG can be data mined by human or machine to create movement (e.g. impulse, path, shape) via notation.

SVG is the most challenging element of the machine readable files for dancers. It can be found inside the scribble element which deals with drawings and scribbles on the timeline. The scribble element and SVG data for a wavy line and a slightly offset straight line look like this:

<scribble>    <svg xmlns="http://www.w3.org/2000/SVG" width="300" height="200">       <path d="M36 109 C33.335 94.3424 33.0489 65.7378 52 61 C80.7301 53.8175 91.7045 120.845 113 132 C147.027 149.824 200.959 78.2244 228 62" fill="none" stroke="rgb(0,0,0)" stroke-width="6" />       <path d="M189 161 C189 161 242.25 161.75 260 162" fill="none" stroke="rgb(0,0,0)" stroke-width="6" />

Page 14: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

   </svg> </scribble>

Although this code may look complex, it is in practice simple to deal with because although SVG data can be written by hand [46] , an SVG editor could be used if scripting directly into a computer or paper drawings could be scanned and converted into SVG files. The SVG data can then be 'cut and pasted' inside the scribble elements when writing machine readable files.

Although not all operating systems have SVG readers installed they are available for most platforms. It will be possible to combine an SVG / xml - editor, viewer and converter into one application that is free (or inexpensive) and platform independent (Java based) specifically for the purposes of this notation. Until such time there are many 3rd party options available for all systems both free or to purchase that may be used in the creation of machine readable scores.

As previously stated the SVG data can be converted to movement notation. This process can be automated or performed by hand. The notable aspect of these translations is that the choreographer can decide what elements map to each other retaining their individual and artistic interpretation of the source image, for example:

<polygon style="fill:black; opacity:0.5; stroke:none;" points=" 360 272 328 212 360 360" />

becomes:

<path>arbitrary  <effort>strong indirect free   <impulse>360 272 328 212</impulse>   <impulse>360 360 000 000</impulse>  </effort> </path>

possible transformations:

polygon = arbitrary line = line fill = weight opacity = space stroke = flow points = impulse data [mapped in sets of 4] x1 x2 y1 y2 = mapped to roll [x1] and pitch [y1] yaw [x2] axis rotation [y2]

In this instance no body locations are given so whilst providing a structure, there is little compositional information. The relationship between the hand written and machine readable scores view can be observed in the following files: dainaemik.gif [51kb] dainaemik.xml [360kb]

XDSN

The whole system is called eXtensible Dance Scripting Notation (xdsn). The name is both a composite of its constituent parts and a reflection of its possible implementations:

Page 15: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

When using the score in isolation: eXtensible Dance Scripting. When using the notation in isolation eXtensible Dance Notation. When using the score and the notation: eXtensible Dance Scripting Notation.

FUTURE DIRECTIONS

xdsn is currently in localised use and in the processes of being documented (the complete system has not been detailed here). It is envisioned that a basic working knowledge of the handwritten system can be taught in two days and as such the first open course for teaching the system will take place over a weekend in July 2004.

Version 0.4 of the machine readable format is nearing completion and will also be documented and made publicly available. Research in to the use of xsdn for avatar animation will be undertaken building on existing work with SiGML using C++, Open GL and Java. This research will include practical elements including motion capture / notation comparisons and live performances using real time computer generated scores interpreted by dancers via head mounted displays.

It is hoped that a version of eXtensible Dance Scripting will be used to develop a searchable library of 'meta logs' that illustrate several choreographers' choreographic processes. This work may be under taken in association with Daghdha Dance Company.

It could be argued that xdsn is a disruptive technology [47] . A simple, low cost solution for rapid development and experimentation xdsn is not designed to replace existing dance notation systems but complement them. Whereas an 'XML Labanotation' would be more suitable for animating existing scores, xdsn can be used to develop ideas and concepts with greater speed and ease of use. It should be possible to transform one type of xml based notation to another allowing a variety of methods for developing, documenting and sharing works.

With regards to developing editing applications for xdsn the process should be a simple adaptation of existing xml and SVG applications. There are some 250 specific elements of the xdsn lexis that will need to be implemented as opposed to the 800 plus symbols for Labanotation. This relatively small set of terms can be embedded in a simple 'what you see is what you get' format with automatic syntax highlighting and element identification. With the ability to export machine readable scores (*.xdsn files) and print visual xdsn scores it will ease the dissemination of dance scores. The software will also include the ability to search and analyse existing scores in 'one to one' or multiple 'side by side' comparisons for the purposes of dance research.

A technical sketch for an advanced dance notation editor (xdsn with support for future XML based Laban, Benesh and Eshkol-Wachman notation developments) will be used as a model for creating professional notation software. The sketch (developed by the author) facilitates seamless handwritten to machine readable notation in real-time for professional notators. Featuring handwriting and pattern recognition, real-time animated previewing, SVG editing (xml notation and PDF output), layers, nonlinear histories, and Tanzkurven editing it will provide a more 'intuitive' alternative to existing notation software.

Many thanks to the Body Space & Technology Journal review panel for their invaluable suggestions, www.article19.co.uk, Michael Klien, Davide Terlingo, Jeffrey Scott Longstaff, Anna Jattkowski-Hudson and Sheila Creevey.

Page 16: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

©-by-nc-sa 2004 M Gough

BIOGRAPHY

Matthew Gough MA, is an independent dance artist and researcher developing complex adaptive systems for autonomous human movement simulation / synthesis, and movement notation for avatar animation.

REFERENCES

[1] Klien, M. (2003) Fourum Post http://www.choreograph.net/forum/showthread.php?s=680f92dcf98ba4720c0356433306b426&threadid=209 last accessed April 2004. See also: http://www.choreograph.net/forum/showthread.php?s=e479ecd776999a14c08b50372c1889e1&threadid=652[2] Hagendoorn, IG (2002). Emergent Patterns in Dance Improvisation and Choreography. Proceedings of the International Conference on Complex Systems. InterJournal.[3] Bastien, M (2002) http://notation.free.fr/laban/contexte/entretien1_P_vo.html last accessed April 2004.[4] Neagle, R.J (2003) A survey on application for editing and animating dance notations. http://www.comp.leeds.ac.uk/royce/htmlpaper/nea-0303-001-sur.pdf last accessed April 2004.[5] Hand, D and Mannila, H (2001) Principles of Data Mining. MIT Press, Cambridge, MA.[6] Benesh, R and Benesh, J (1983) Reading Dance: The Birth of Choreology. McGraw-Hill Book Company Ltd.[7] Sutton, V (2002) Dance Writing_Brochure http://www.dancewriting.org/acrobat/infopack/DanceWriting_Brochure.pdf last accessed April 2004.[8] Fernström, M (1997)Music notation: an issue of purpose and use in traditional music http://www.ul.ie/~idc/library/papersreports/MikaelFernstrom/music01/music01.html last accessed April 2004.[9] Dack, J (1999) Karlheinz Stockhausen's Kontakte and Narrativity http://cec.concordia.ca/econtact/SAN/Dack.htm#technology[10] Tufte, E (2001) The Visual Display of Quantitative Information. Graphics Press, Cheshire, CT[11] Tufte, E (1997 ) Visual Explanations: Images and Quantities, Evidence and Narrative. Graphics Press, Cheshire, CT[12] Tufte, E (1991) Envisioning Information, Graphics Press, Cheshire, CT[13] Gough, M (2004) movement score http://www.article19.co.uk/mathew/2004_04.php#000187 last accessed April 2004.[14] Hutchinson Guest, A (1989) Choreographics: A Comparison of Dance Notation Systems from the Fifteenth Century to the Present. Routledge London and New York[15] Longstaff, J. S (2001) A ‘free space vector' approach to Laban's choreutics. In Movement and Dance Magazine of the Laban Guild 20 2 (10-11).[16] Longstaff, J. S (2001)Translating 'vector symbols' from Labans (1926) Choreographie in ICKL Proceedings 2001, Columbus: International Council of Kinetography Laban, 2001.[17] Nakata, T (2002)Generation of whole-body expressive movement based on somatical theories: Proceedings of the second international workshop on Epigemetic Robotics, pp.105-114, .[18] Bernstein, N. (1967) The co-ordination and regulation of movement. London: Pergamon Press[19] Bernstein, N (1935) The problem of the interrelation of co-ordination and localization. Archives of the biological sciences, 38, pp. 77-119

Page 17: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

[20] Kandinsky, W (1979) Point and Line to Plane, Dover.[21] Kandinsky, W (1926) Tanzkurven. Zu den Taenzen (Tanzen) der Palucca, Das Kunstblatt, vol. 10 p177[22] Jeannerod, M (1997) The Cognitive Neuroscience of Action. Oxford. Blackwell.[23] Hutchinson Guest, A (2002)Forum post, Discussion 39 http://dancenotation.org/DNB/theorybb/discussion24/24_01_Fox.html last accessed April 2004.[24] Laban, R., Lawrence, F. C.(1974) Effort: Economy in Body Movement. Plays, Inc., Boston,[25] Chi, D. Costa, M. Zhao, L. Badler, N.(2000) The EMOTE Model for Effort and Shape, Proceedings of SIGGRAPH 2000, ACM Computer Graphics Annual Conference, New Orleans, Louisiana, pp. 173-182.[26] Zhao, L (2001) Synthesis and Acuqisition of Laban Movement Analysis Qualitative Movement Parameters for Communicative Gestures, Technical Report, MS-CIS-01-24, Ph.D. Dissertation, Computer and Information Department, University of Pennsylvania,[27] Forsythe, W. (1999) Improvisation Technologies: A Tool for the Analytical Dance Eye. ZKM-Insitute for Visual Media.[28] Hermans, C (2001) Degrees of freedom (Df) within movement http://www.du.ahk.nl/mijnsite/papers/degreesoffreedom.htm last accessed April 2004.[29] Neagle, R (2003) A survey on application for editing and animating dance notations http://www.comp.leeds.ac.uk/royce/htmlpaper/nea-0303-001-sur.html last accessed April 2004.[30] Ryman, R (2001) Labanotation and Life Forms: Computer Animation as a Complement to Dance Notation in ICKL Proceedings 2001, Columbus: International Council of Kinetography Laban, 2001.[31] Gorchoff, G (2001) Adventures with Cross-software Platform Development in ICKL Proceedings 2001, Columbus: International Council of Kinetography Laban, 2001.[32] Barenholtz, J. Wolofsky, Z. Ganapathy, I. Calvert, T.W. and O’Hara, P. (1997) Computer Interpretation of Dance Notation, in Computing in the Humanities: Proceedings of the 3rd International Conference on Computing in the Humanities, Waterloo: University of Waterloo Press, pp. 235-241.[33] see http://www.w3.org/XML/[34] see http://www.w3.org/Graphics/SVG/[35] Brooks, R, Ruggiero., R. (2003) Are We Ready for the Next Web http://www.dmreview.com/editorial/newsletter_article.cfm?nl=dmdirect&articleId=7548 last accessed April 2004.[36] Sign Writing (a subset of sutton notation) http://www.signwriting.org/[37] HamNoSys (the Hamburg Notation System for sign language) http://www.sign-lang.uni-hamburg.de/Projekte/HamNoSys/HamNoSysErklaerungen/englisch/Contents.html last accessed April 2004.[38] Sign writing system markup language (swml) http://www.signwriting.org/forums/software/swml/swml01.html last accessed April 2004.[39] Signing Gesture Markup Language (SiGML) http://www.visicast.sys.uea.ac.uk/Papers/assets2000Final.pdf last accessed April 2004.[40] see http://countrydance.sourceforge.net/[41] see http://java.sun.com/[42] Cheng, L. and Robinson, J. (2001) Personal Contextual Awareness through Visual Focus http://www.intuac.com/userport/john/pubs/contextis.pdf[43] Hutzler, G. Gortais, B. Joly, P. (200) I danced With Machine Distributed Multimodal Interaction http://www.laas.fr/robea/GdansC.pdf

Page 18: MATTHEW GOUGH - Brunel University Londonpeople.brunel.ac.uk › bst › documents › matthewgough.doc  · Web viewRemember that: hop= no change, leap= one foot to other foot, jump=

[44] Muisc xml http://www.recordare.com/xml.html[45] XML Tuotorial http://www.w3schools.com/xml/default.asp[46] SVG Tuotorial http://www.w3schools.com/svg/default.asp[47] disruptive technology definition http://en.wikipedia.org/wiki/Disruptive_technology last accessed April 2004.