future_of_searching_for_scholarly_literature-semtech-2009

Erik Nemeth J. Paul Getty Trust © 2009 1

The Future of Searching for Scholarly Literature

Discipline-Specific Research Databases in Web 2.0 and the Semantic Web

or

Leveraging the “Prescience of Artists and the Art of Science”

Cross-Disciplinary Research in Neuroaesthetics

Erik Nemeth

Getty Research Institute, Los Angeles, California

Semantic Technology Conference 16 June 2009

San Jose, California


Leveraging the “Prescience of Artists and the Art of Science”

Cross-Disciplinary Research in Neuroaesthetics

visual information as incident on the

retina

2D 3D

discrete processing of color, form, and motion

Renaissance

Impressionism

Modernism


Outline – Modern Development of Neuroaesthetics

quantitative-qualitative divide

specialized metadata vs.

generalized full-text searching

neuroaesthetics

ontology

metadata

discipline-specific research databases

historical perspective

art historyvision science

humanitiessciences thesaurus visionartists


Prescience of Artists

and

the Art of Science

Outline – Preexistence of “Neuroaesthetics”

quantitative-qualitative divide

specialized metadata vs.

generalized full-text searching

neuroaesthetics

metadata


historical perspective

thesaurus


increasing divergence of the sciences

Historical basis for reestablishing an art-science grammar visual aesthetics

Sciences

Art

s

Modernism

perspective Leon Battista Alberti

Natural Philosophers

(pre- Socratics)

“capturing the actual visual sensation” Claude Monet

“eliminated color in his mobiles” Alexander Calder

Impressionism

Renaissance

mid-1500s

1400s

mid-1800s

2100s

mid-1800s early 1900s mid-1900s

early 1900s

chiaroscuro Dutch Masters

1600s Baroque

quantitative analysis

grammar for communicating across the art-science divide

Scientific Revolution

Logical PositivismPositivism

Psychology perception

Neuroscience response patterns

qualitative analysis

Art History research databases Vision Science

research databases


Art History Discipline-Specific Knowledge Base

2006 demand for

specialized metadata

Survey Results facilitate interdisciplinarity

selected monographs

journal lists

2008 demand for

specialized databases

What is it?

Why create it?

filtered material

increases relevance of search results

customized abstracting and indexing

thesaurusspecialized metadata

Actively Leverage Technology

Draw on user interaction to create content.

maintain an editorial role

search interface

enables fosters

Forge connections across research databases in the sciences.

Web 2.0 Semantic Web


World Wide Web(“Web 1.0”)

Web 2.0 and the Semantic Web

Semantic Web

Web 2.0

Users

open architecture

open access

Internet

automated linking ontology

machine readable

open collaboration


Participation of Scholars in the Evolving Infrastructure

searching for scholarly literature

publishing findings

“Black Box”

How are publications selected?

What is the indexing scheme?

Who is creating the metadata and managing the thesaurus?

editorial oversight

discipline-specific research database

publishing findings

creating metadata

submitting citations

editorial policy

editorial staff

“tagging”

searching for scholarly literature

thesaurus

ontology

“Web 1.0” and prior

Web 2.0

open collaboration open

access

open architecture


Applications in the Semantic We b to Enable Interdisciplinarity

cross-disciplinary searches for scholarly literature

cross-disciplinary correlation of datasets

metadata

ontology

raw dataneural

measurements

psychological assessments

linguists

art historians

psychologists

neuroscientists

published findings

analog / digital divide

?

published findings


concepts


concepts

metadata

literature

searchDSRDB

humanists

DSRDB

thesaurus thesaurus

perception

neural tissue

literature

artworks

life

visual world

qualitative / quantitative divide

?

concepts

theories

information

analyses

scientists

scholars scholars

search engine


Developing a Cross-Disciplinary Ontology

Knowledge Domains

Art History thesaurus

Neuroaesthetics ontology

Vision Science thesaurus

properties

Art History e.g. Art & Architecture Thesaurus (Getty)

Vision Science (optics, visual neuroscience, psychophysics)

e.g. http://www.liden.cc/Visionary/

explains

identifiesfunction of visiontheory

raw data

analysis

concept

correlates with

observation discovery

quantitative assessments experimental data

supports

predicts

correlates with


Towards an Ontology for Neuroaesthetics

What are the relationships between art history and vision science?

vision science

“qualitative” analysis

“quantitative” analysis

psychophysics

art history

visual neuroscienceconnoisseurship

art theory

artworksvisual

system

learned associations

artistic movements

artistic techniques

innate functions


depth perception

vision science

perspective



psychophysics

art history

vision centers

visual neurosciencekinetic artconnoisseurship

art theory

artworksvisual

system

predict

support

identify

explain

predicted

supported

identified

explained


artistic movements

artistic techniques

innate functions

Piero della Francesca Flagellation of Christ late 1450s

psychophysics mid 1800s

linear size and perspectives previous familiarity

interposition

Artists showed prescience in understanding the visual system.


Towards an Ontology for Neuroaesthetics

depth perception

vision science

perspective



psychophysics

art history

vision centers


art theory

artworksvisual

system

predict

support

identify

explain

predicted

supported

identified

explained


artistic movements

Marcel Duchamp Nude Descending a Staircase, No. 2 c. 1910

Newsome, Movshon, Britten motion selective neurons in monkeys

1990s

fMRI shows selective response to motion in the Middle Temporal area (V5)

artistic techniques

innate functions


Eventually, vision science will influence artists.

depth perception

vision science

perspective



psychophysics

art history

vision centers


art theory

discoveriesanticipate informartworks

visual system

predict

support

identify

explain

predicted

supported

identified

explained


artistic movements

artistic techniques

innate functions

Erik Nemeth J. Paul Getty Trust © 2009 15Erik Nemeth J. Paul Getty Trust © 2009 15

Towards an Ontology for Cultural Security

political science

“qualitative” assessments

“predictive” analyses

organized crime

archaeology

political violence

cultural history

excavations

intelligence analysis

cultural artifacts

international security

antiquities trafficking

source nations

religious monuments

political targets



market trends

political science

archaeological discoveries



organized crime

archaeology

destruction of the Bamiyan Buddhas

political violence

religious significance

cultural history

excavations


mitigatecultural artifacts


influence

exploit

inform

capitalizes

influenced

exploited

informed

capitalized


source nations

religious monuments

political targets

rediscovery of Machu Picchu and pre-Columbian Inca artifacts by Hiram Bingham in 1911



market trends

political science




organized crime

archaeology


political violence


cultural history

excavations




influence

exploit

inform

capitalizes

influenced

exploited

informed

capitalized


source nations

religious monuments

political targets

destruction of the giant Buddhas of the Bamiyan Valley (2001)



market trends

political science




organized crime

archaeology


political violence


cultural history

excavations




influence

exploit

inform

capitalizes

influenced

exploited

informed

capitalized


source nations

religious monuments

political targets


time

valu

e to

sch

olar

ly r

esea

rch

The role DSRDBs will become less overt but will continue to add value through Web 2.0 and the Semantic Web.

Conclusion – Push vs. Pull

Will technology undermine or sustain the role of DSRDBs?

Does open access to full text obviate the need for discipline-specific research databases?

Pull: automated production of full text through large-scale scanning with OCR

Push: web-enabled production environment will allow for increased coverage while editorial oversight will continue to provide specialized metadata.

Push: create ontology that link disciplines across the humanities and the sciences.

Push: knowledge bases that connect the sciences and the humanities will enable interdisciplinarity.

Pull: automatic creation of metadata through machine-assisted summarization of abstracts and indexing

future_of_searching_for_scholarly_literature-semtech-2009

Documents

paul getty trust

semantic web semantic

s mid

specialized databases

s early

world wide web web

s chiaroscuro dutch

prescience of artists