building frameworks of organizational intelligence library assessment conference, 2008 seattle joe...

Building Frameworks of Organizational Intelligence


Library Assessment Conference, 2008 Seattle

Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries


Sample Data Structure I: Data Farm Funds Report - Biology


Sample Data Structure I: Data Farm Funds Report - Casalini Libri


Sample Data Structure II - Data Farm Table - Funds Process


Sample Data Structure III - Voyager Funds Schema

Invoice_line_item

invoice_status

purchase_order

line_item

invoice_line_item_funds

fund

invoice

vendor

bib_master

bib_text


Information Loop

Data Farm Environment

Clean | Anonymize Normalize

Data Streams

Integrate Inform

Report Builder

Dashboard

Data Bureau

Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

People and Network Data

Ref|Instruct

Leveraging data structures


E-Resource Use Reference ContactCirculation

Acquisitions Funds

Holdings

Copier | Printer Use

Gate Swipes

Resolve Resource

Resolve People

Resolve Places

Web Analytics

Image Collection Use

Data Farm Oracle Space-Overview

30+ gb, in 162 tables, for collecting and disseminating management info

Staff Census

LDAP

Tech Processing Workflow

Digital Library

Voyager-Supported Services

Building Use

Resolution Services

Administration

Reference & Instruction (dynamic)

Consortia ILL/DocDel

70-Member ILL Coop.


Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct

Data Farm Silos

funds


A different take on a management information framework


xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

Sample Data Structure: EZ-Proxy Log


xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

xxx.xx.xxx.xxx = .edu | on-campus | Van Pelt Library | staff office

July 26, 2007: 3:41 p.m.

Device= Mac | OSX Browser= Safari




Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer




zucca [Penn authentication key] = Provost cntr | LIBRARY | staff




SessionID 10335905=PsycInfo (resource identifier 7014)




sfx_session_id=Journal of Experimental Child Psychology,

“Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”




TRANSLATION:

• Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.

• Logged into PsychInfo (CSA)

• Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library

• A library staff (Provost’s center affiliate)

• July 26, 2007 at 3:41 pm

and in the same session,



EVENT

Org|ProgramStaff

ServiceGenre

LibraryProgram

CampusLocation

Date|Time

IP-Domain

Environment

URL

Budget

Restricted

Unrestricted

Expnd Amt

Fund Code

Events: a Structure for

Library Decision Metrics

Dept

SchoolClient

Rank

Major

Biblio-graphicContent

School

Reqmnt

Dept

Dept

LevelCourseDescriptor

ClientProgram


Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct

Data Farm Silos

funds


DATA STORE

query (sql)parse, resolve,

anonymize,secure!

Data Farm Tiered Framework

oracle

XML

Repository processes

Analysis

perl

XL

Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct


Event Elements Articulated in an XML Schema

EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>

</ENVIRONMENTAL>

<CLIENT><school><dept><rank>

</CLIENT>

<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>

</LIBRARY PRGRM>

<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>

</CONTENT>

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


CampusLocation

Date|Time

IP-Domain

Environment

URL

EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC


Dept

School

Client

Rank

Major


</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Org|Program

Staff

Service Genre

LibraryProgram

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Biblio-graphicContent

METRIDOC


ClientClient

RSSOracleXLSXML

Data Repository

Resolver

Schema Repository

SQL Generator

Soap Connection

Repository Tier II

MIS Tools & Services Tier III

Voyager | People Data | ERM

Admin Interface

Process Data

Logs & otherData sources

Issues data as

event-level metridoc xml

Raw data ingest and handoff for

resolving into Metridoc SQL Generator spawns tables

following user-defined schema

Like a prism, the SQL Generator parses metridoc info into

relational structures within the

Data Repository

Soap Connection

Data Farm Multi-Tiered Architecture Metridoc Setting

Admin users create metridoc schema, specifying structures forraw data sources

Data Ingest Tier I


AGRI SCI

ARTS & HUM

BUS ECON CHEM

EARTH SCI

ENGN- RNG

ENVIRO SCI

HEALTH SCI

INFO SCI

INFO TECH LAW

LIFE SCI

MATR'L SCI

MATH SCI PHYS

SOC SCI

TELE COM

AGRISCI 1

ARTS & HUM -0.115 1

BUSECON -0.142 0.148 1

CHEM 0.753 -0.044-0.079 1

EARTHSCI 0.591 -0.022 0.015 0.637 1

ENGNRNG 0.478 -0.084 0.001 0.791 0.477 1

ENVIRO Sci 0.773 0.043-0.0400.961 0.766 0.663 1

HEALTH Sci 0.484 0.041-0.036 0.760 0.092 0.521 0.681 1

INFOSCI -0.164 0.899 0.173-

0.135 -0.002-

0.176 -0.003 0.034 1

INFOTECH 0.189 0.199 0.388 0.443 0.452 0.810 0.382 0.142 0.156 1

LAW -0.090 0.607 0.425-

0.058 0.092-

0.090 0.098 0.042 0.732 0.231 1

LIFESCI 0.711 0.001-0.079 0.952 0.401 0.697 0.885 0.872 -0.105 0.300 -0.020 1

MATR'L SCI 0.338 -0.200-0.077 0.521 0.692 0.799 0.474 0.037 -0.213 0.773 -0.175 0.281 1

MATHSCI 0.717 0.025-0.015 0.980 0.670 0.858 0.932 0.676 -0.077 0.589 -0.030 0.906 0.617 1

PHYS 0.353 -0.172-0.050 0.518 0.710 0.797 0.473 0.000 -0.214 0.790 -0.174 0.272 0.988 0.624 1

SOCSCI -0.060 0.720 0.474 0.044 0.038-

0.024 0.170 0.231 0.804 0.265 0.954 0.111 -0.219 0.070 -0.215 1

TELECOM 0.060 -0.121 0.035 0.278 0.238 0.796 0.129 0.000 -0.182 0.848 -0.148 0.132 0.835 0.408 0.839 -0.159 1

Use of Electronic Journals, Subject Correlations


Penn’s Use of Electronic Journals by Subject: Multi-Dimensional Scaling Model

10-1-2

Dimension 1

1.5

1.0

0.5

0.0

-0.5

-1.0

-1.5

Dim

ensi

on

2

INFOSCI

TELECOM

SOCSCI

PHYSICS

MATHSCI

MATERIALS

LIFESCI

LAW

INFOTECH

HEALTH

ENVIRONM

ENGINEERINGEARTHSCI

CHEM

BUSECON

ARTSHUM

AGRISCI

Euclidean distance modelMultidimensional Scale of E-Resource Use by Subject – All Users

Dimension II

“Humanistic-Science”

Dimension II

“Qualitative-Quantitative”

Source data: Ezproxy logs, June-August 2007 and February-March 2008. 215,000 observations total


1.51.00.50.0-0.5-1.0-1.5-2.0

Dimension 1

1.0

0.5

0.0

-0.5

-1.0

-1.5

-2.0

Science

SocSciHumanities

Art

Comunicat

Vet

Dental

SocialWk

Education

Wharton

Engineer

Nursing

Medicine

Euclidean distance modelMultidimensional Scale of E-Resource Use by Faculty Grouped by School

Dimension II

“Humanistic-Science”

Dimension II

“Qualitative-Quantitative”

Source data: Ezproxy logs, June-August 2007 and February-March 2008. 215,000 observations total

Penn’s Use of Electronic Journals by Faculty: Multi-Dimensional Scaling Model


Penn’s Use of Electronic Journals Example of text mining on article keywords

building frameworks of organizational intelligence library assessment conference, 2008 seattle joe...

Documents

data streams

data structures

network data refinstruct

text slide

voyager funds schema

item invoice

ezproxy log slide

funds fund invoice vendor