social networked learning in complex information environments · analytics: sensemaking, prediction...

66
Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8 th Annual Innovations in e-Learning Symposium George Mason University

Upload: others

Post on 25-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Analytics: Sensemaking, Prediction &

Performance

George Siemens, PhD June 6, 2012 Presented to:

8th Annual Innovations in e-Learning Symposium George Mason University

Page 2: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 3: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 5: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

August 5, 1949: Mann Gulch

Page 6: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

December 2–3, 1984: Bhopal

Page 7: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

April 14, 1994: Black Hawk Incident

Page 8: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Add:

terrorist attacks, Space Shuttle Columbia, 2008 financial crisis, etc, etc.

Page 9: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Progressive reliance on sensemaking in systems rather than as individuals

Page 10: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Sensemaking

“Sensemaking is a motivated, continuous effort to understand connections . . . in order to anticipate their trajectories and act effectively”

(Klein et al. 2006)

Page 11: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

We can’t understand how people make sense without considering the system

Page 12: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 13: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Bhopal

SS Columbia

2008, financial

9/11

Mann Gulch

7/7

Mumbai

Page 14: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Bhopal

SS Columbia

2008, financial

9/11

Mann Gulch

7/7

Mumbai

Sensemaking, prediction, & performance through analytics here

Page 15: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

But it’s not only about sensemaking in crisis situations.

It can be far more mundane.

Page 16: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Domains of Sensemaking

Page 17: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 18: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Exceptional performance requires tight coupling of people, roles, systems, context, and actions

Page 19: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The problem is that our socio-technical systems are becoming more technical and less social

Page 20: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

To avoid getting lost in the “mass of inconsequential”

(Bush, 1945)

We still need control, but the points are different than where the education system has assigned them in the past.

Page 21: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

How can centralized aims be achieved through distributed means?

Page 22: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The current state of work & the internet is antagonistic to existing practices in organizations

Internet/mobiles/web fragments

Coherence is needed for action/performance

Page 23: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

In response, systems have become more rule or algorithmically based

Social systems don’t scale with information’s abundance/complexity

Page 24: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Hence, analytics

Page 25: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

http://www.solaresearch.org/

Page 26: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

“Imagination no longer comes as cheaply as it did in the past. The slightest move in the virtual landscape has to be paid for in lines of code.”

Latour (2007)

Page 27: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs

Page 28: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 29: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 30: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 32: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Aggregated networks of daily contacts http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0023176

What if the topics of interaction are layered onto social

networks?

Page 33: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Aggregated networks of daily contacts http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0023176

Or actions (outcomes, sales, performance) are layered onto

networks, discourse, etc.

Page 34: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Distributed, multi-level analytics Suthers & Rosen (2011)

Page 35: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Attention metadata Duval (2011)

Page 36: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Learning networks, crowds, communities Haythornthwaite (2011)

Page 37: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Discourse analysis (automated and manual) De Liddo & Buckingham Shum (2011)

Page 38: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Social learning analytics Buckingham Shum & Ferguson (2011)

Page 39: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Participatory learning and reputation Clow & Makriyannis (2011)

Page 40: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Early warning Macfayden & Dawson (2010)

Campbell et al (2006)

Page 41: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Learning Analytics in the workplace: Detecting and Analyzing Informal Workplace Learning

Schreurs & De Laat, 2012

Page 42: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 43: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

“Whether from government transparency initiatives, leaks or Freedom of Information requests, journalists are drowning in more documents than they can ever hope to read.

We’re building an interactive system where computers do the visualization, while a human guides the exploration.”

http://overview.ap.org/about/

Page 44: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 46: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Half-ideas colliding to form new (innovative) knowledge wholes:

Massive Open Online Courses

Page 47: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Creating: artifacts, stuff, remixing, new assemblies, novel connectedness

Page 48: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 49: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Stigmergic/self-organizing social systems

Page 51: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Capacity for innovation & change a function of which/how entities are networked

Page 52: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

The context

Why and what of analytics?

Examples

Colliding ideas

Organizations and the analytics model

Page 53: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

What might we want to predict?

Composition of teams

Skillsets needed for particular outcomes

Resilience and adaptive teams in unsettled contexts (rapidly changing)

Trends (for re/up skilling)

Page 54: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Kron, et al (2011)

Page 55: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 56: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 57: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 58: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 59: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 60: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 61: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 62: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations
Page 63: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Sensemaking, prediction, performance

Page 64: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

www.lakconference.org

Page 65: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

Learning Analytics: Practitioners Workshop

Purdue: Oct 1-3, 2012

http://www.solaresearch.org/flare/

Page 66: Social networked learning in complex information environments · Analytics: Sensemaking, Prediction & Performance George Siemens, PhD June 6, 2012 Presented to: 8th Annual Innovations

gsiemens @ gmail Twitter Skype FB Wherever

www.elearnspace.org www.connectivism.ca www.learninganalytics.net