The trouble with codified knowledge...The trouble with codified knowledge...

(a) those that belong to (a) those that belong to the Emperorthe Emperor

(b) embalmed ones(b) embalmed ones

(c) those that are trained(c) those that are trained

(d) suckling pigs(d) suckling pigs

(e) mermaids(e) mermaids

(f) fabulous ones(f) fabulous ones

(g) stray dogs(g) stray dogs

(h) those that are included (h) those that are included in this classificationin this classification

(i) those that tremble as if(i) those that tremble as if they were mad they were mad

(j) innumerable ones (j) innumerable ones

(k) those drawn with a very (k) those drawn with a very fine camel's-hair brushfine camel's-hair brush

(l) others(l) others

(m) those that have just(m) those that have just broken a flower vase broken a flower vase

(n) those that resemble flies(n) those that resemble flies from a distance.” from a distance.”

Celestial Emporium of Benevolent KnowledgeCelestial Emporium of Benevolent Knowledge

““Animals may be divided as follows: Animals may be divided as follows:

Claims

Counterclaims

A new infrastructure makes waves…A new infrastructure makes waves…

cognitivecognitive

institutionalinstitutional

disciplinarydisciplinary

……literacies…literacies…

Co-Evolving Processes, Co-Evolving Processes, Practices & Technologies Practices & Technologies for Scholafor Scholarly Publishingrly Publishing

Simon Buckingham ShumSimon Buckingham Shum

Knowledge Media InstituteKnowledge Media InstituteOpen University, UKOpen University, UK

sbs@acm.orgsbs@acm.org

Collaborative work with Tamara Sumner (U. Colorado Collaborative work with Tamara Sumner (U. Colorado Boulder, USA)Boulder, USA), , Mike Wright (Unidata-UCAR,USA) Mike Wright (Unidata-UCAR,USA)

Malcolm Story & Gary Li (Open U., UK)Malcolm Story & Gary Li (Open U., UK)Continuity & Change in Scholarly PublishingContinuity & Change in Scholarly Publishing2525thth June, 2001 June, 2001 AmsterdamAmsterdam

OverviewOverview

OrientationOrientation

Journal of Interactive Media in Journal of Interactive Media in Education (JIME)Education (JIME)

Digital Document Discourse Digital Document Discourse Environment (Environment (DD33EE))

Scholarly Ontologies Project Scholarly Ontologies Project (ScholOnto)(ScholOnto)

OrientationOrientation

The broader projectThe broader project tools for constructing, contesting and discovering tools for constructing, contesting and discovering

meaningmeaning

2 ways to use technology2 ways to use technology (i) streamline the current model (e.g. JHEP)(i) streamline the current model (e.g. JHEP)

(ii) explore new possibilities and evaluate (ii) explore new possibilities and evaluate (e.g. Psycoloquy; JIME) (e.g. Psycoloquy; JIME)

JIMEJIME as a ‘new kid on the block’ as a ‘new kid on the block’ a ‘mobile exploration vehicle’a ‘mobile exploration vehicle’

unique mix of review technology+processunique mix of review technology+process

changing forms and roleschanging forms and roles

offers both process ideas and generic technologyoffers both process ideas and generic technology

Journal of Interactive Journal of Interactive Media in EducationMedia in Education

An Interactive JournalAn Interactive Journalfor Interactive Mediafor Interactive Media

www-jime.open.ac.ukwww-jime.open.ac.uk

jime@open.ac.ukjime@open.ac.uk

Peer review dimensionsPeer review dimensions

anonymousanonymous namednamed

appointedappointed open invitationopen invitation

1-shot1-shot conversationconversation

reviews discardedreviews discarded reviews preservedreviews preserved

reviewersreviewerson their ownon their own

reviewers reviewers interactinteract

author rightauthor rightof replyof reply

author noauthor noright of replyright of reply

anonymousanonymous

appointedappointed

1-shot1-shot

reviews discardedreviews discarded

reviewersreviewerson their ownon their own

author noauthor noright of replyright of reply

anonymousanonymous namednamed

appointedappointed open invitationopen invitation

1-shot1-shot conversationconversation

reviews discardedreviews discarded reviews preservedreviews preserved

reviewersreviewerson their ownon their own

reviewers reviewers interactinteract

author rightauthor rightof replyof reply

author noauthor noright of replyright of reply

JIME in a nutshellJIME in a nutshell

conversational open peer review conversational open peer review intrinsicintrinsic to to journal’s review model: journal’s review model: the social contractthe social contract

JIME’s peer review modelJIME’s peer review model

Private+Public / Conversational / Open Peer Private+Public / Conversational / Open Peer Review / Edited / Co-published with articleReview / Edited / Co-published with article

Reviewers Reviewers assigned assigned and and named/hyperlinkednamed/hyperlinked

Conversational/argumentation model (web)Conversational/argumentation model (web)

Hybrid 2-step process: private then publicHybrid 2-step process: private then public

Private emails to editor if preferredPrivate emails to editor if preferred

revision, publication + open for further revision, publication + open for further commentscomments

Intellectual trace of the article’s historyIntellectual trace of the article’s history

JIME in a nutshellJIME in a nutshell

conversational open peer review conversational open peer review intrinsicintrinsic to to journal’s review model: journal’s review model: the social contractthe social contract

authors encouraged to back claims about authors encouraged to back claims about technology with demonstrations/ technology with demonstrations/ walkthroughs for readers and reviewerswalkthroughs for readers and reviewers

Interactive demonstration of a CD-ROMInteractive demonstration of a CD-ROM

Readers can ‘play’ Readers can ‘play’ with the with the

construction of a construction of a painting, as painting, as

students were students were encouraged to doencouraged to do

Audio-visual slide presentation, walking Audio-visual slide presentation, walking the reader through a systemthe reader through a system

The author The author introduces the introduces the

multimedia multimedia system with a system with a

series of slides series of slides and commentary and commentary

(streaming (streaming audio)audio)

JIME in a nutshellJIME in a nutshell

conversational open peer review conversational open peer review intrinsicintrinsic to to journal’s review model: journal’s review model: the social contractthe social contract

authors encouraged to back claims about authors encouraged to back claims about technology with demonstrations/ technology with demonstrations/ walkthroughs for readers and reviewerswalkthroughs for readers and reviewers

articles tightly integrated with reviews in a articles tightly integrated with reviews in a web document-discussion interfaceweb document-discussion interface

edited review discussions co-published with edited review discussions co-published with final articlefinal article

Submission under review

PrePrint or Published

Peer review comments and

discussion:

tightly integrated +

co-published

JIME document user interface(generated by D3E from an HTML submission)

JIME email alert to new review commentJIME email alert to new review comment

Author links from text to discussionAuthor links from text to discussion

Submission under review

PrePrint or Published

Peer review comments and

discussion:

tightly integrated +

co-published

JIME document user interface(generated by D3E from an HTML submission)

DD33EpEprint serverrint servergenerating a generating a peer review peer review discussion space for discussion space for

an ePrint archive document…an ePrint archive document…

DD33E:E:Digital Document Digital Document

Discourse EnvironmentDiscourse Environment

d3e.open.ac.uk

““Open SourceOpen Sourcefrom the from the

Open University”Open University”

An arXiv eprintAn arXiv eprint

Peer review/commentary on an arXiv Peer review/commentary on an arXiv documentdocument

JIME changes…JIME changes… ……Author’s experienceAuthor’s experience

at least at least as much feedback as normalas much feedback as normal

typically gain an enormous amount from typically gain an enormous amount from defending against expert peersdefending against expert peers

sometimes need to be coaxed into sometimes need to be coaxed into responding!responding!

……Reviewer’s experienceReviewer’s experience engage in discussions with both authors and engage in discussions with both authors and

reviewersreviewers formulate reflective contributions to debates formulate reflective contributions to debates

in a timely, professional mannerin a timely, professional manner

JIME changes… JIME changes… (cont/d)(cont/d)

……Reader’s experienceReader’s experience insight into how to interpret the text (esp. insight into how to interpret the text (esp.

students)students) ‘‘dissenting voices’ are not silenceddissenting voices’ are not silenced

……the concept of a ‘Publication’the concept of a ‘Publication’ multimediamultimedia hypertext structures possiblehypertext structures possible content can now be distributed across the content can now be distributed across the

formal document and the discussion spaceformal document and the discussion space

Conversational Open Peer Review?Conversational Open Peer Review? ProsPros

Rigorous, accountable quality controlRigorous, accountable quality control At its best can promote interdisciplinary dialogueAt its best can promote interdisciplinary dialogue Reviewers can debate between themselvesReviewers can debate between themselves Works because journal Works because journal PoliciesPolicies and and PracticesPractices have have

evolved with the evolved with the TechnologyTechnology

ConsCons Both the technology and process are newBoth the technology and process are new More resource intensive for authors and reviewersMore resource intensive for authors and reviewers Better for discursive, multidisciplinary fields?Better for discursive, multidisciplinary fields?

KeyKey Technology enables new practices, but discourse Technology enables new practices, but discourse

analysis shows mixed evidence of changed working analysis shows mixed evidence of changed working practicespractices

Claims

Counterclaims

Emergent domain model grounded in perspectives

ScholOnto: Scholarly Ontologies Project ScholOnto: Scholarly Ontologies Project

A discourse-oriented digital library A discourse-oriented digital library server to mediate server to mediate scholarly claims and scholarly claims and argumentation argumentation (cf. link taxonomies theme)(cf. link taxonomies theme)

beyond primary metadata… perspectival semantic beyond primary metadata… perspectival semantic web web

literatures as conceptual networksliteratures as conceptual networks

research documents complemented by concept research documents complemented by concept maps summarising the key claims and maps summarising the key claims and argumentation argumentation

semantic layer over journal or eprint archivessemantic layer over journal or eprint archives

““semantic citation links” semantic citation links” novel forms of novel forms of scientometrics and information visualizationsscientometrics and information visualizations

structural templates for peer reviewstructural templates for peer review

claim humanagent software

justificationdocumentsemantic structurefree text

submitted by

asserts

existing claimconcept relationship

concept

has backing

or

Is Inconsistent With

Analyses

Is an Example ofModifies/Extends

ConfirmsIs Consistent With

Addresses

Encapsulates

Uses/Applies

PredictsEnvisages

Takes Issue With

RefutesRaises Problem

Argumentation Links

Non-Argumentation Links

Data

MethodologyLanguage

Analysis

SoftwareProblem

Idea

Theory/Model

Approach

Phenomenon

Data

MethodologyLanguage

Analysis

SoftwareProblem

Idea

Theory/Model

Approach

Phenomenon

Other issuesOther issues

““Would this work for me?…”Would this work for me?…”

Hypertextual il/literacyHypertextual il/literacy

Framework for co-evolving policies and Framework for co-evolving policies and practices with technologiespractices with technologies

Theories wrt. persistent discourseTheories wrt. persistent discourse

DD33E technical infrastructureE technical infrastructure

Journal of Interactive Media in EducationJournal of Interactive Media in Educationwwwwww––jime.open.ac.ukjime.open.ac.uk

Digital Document Discourse EnvironmentDigital Document Discourse Environmentd3e.open.ac.ukd3e.open.ac.uk

PhD on PhD on ePrintsePrints+Peer Review+Peer Review:: deadline deadline 1616thth July Julykmi.open.ac.uk/studentshipskmi.open.ac.uk/studentships

Scholarly Ontologies ProjectScholarly Ontologies Projectkmi.open.ac.uk/projects/scholontokmi.open.ac.uk/projects/scholonto