asee2012 presentation: ikneer user study

49
How Does an Interactive Knowledge Platform Influence Decision-Making of Novice Researchers in Engineering Education Research? Xin Chen, Adithya Raghavan, Krishna Madhavan, Ji Soo Yi {chen654, araghava, cm, yij}@purdue.edu

Upload: xin-chen

Post on 27-Jun-2015

175 views

Category:

Technology


2 download

DESCRIPTION

iKNEER (Interactive Knowledge Network for Engineering Education Research) User Study: Conduct 6 interviewers with novice researchers to understand conceptual hurdles in their research, and how computer tools influence their research decision-making.

TRANSCRIPT

Page 1: ASEE2012 Presentation: iKNEER User Study

How Does an Interactive Knowledge Platform Influence Decision-Making of Novice Researchers

in Engineering Education Research?

Xin Chen, Adithya Raghavan, Krishna Madhavan, Ji Soo Yi{chen654, araghava, cm, yij}@purdue.edu

Page 2: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

iKNEER: Interactive Knowledge Networks for Engineering Education Research

Page 3: ASEE2012 Presentation: iKNEER User Study

iKNEER.org is a highly interactive data gateway for understanding a range of data including conference and journal publications and federal investments.

Introduction Methods Findings Q&A

Page 4: ASEE2012 Presentation: iKNEER User Study

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 5: ASEE2012 Presentation: iKNEER User Study

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 6: ASEE2012 Presentation: iKNEER User Study

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 7: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 8: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 9: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 10: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 11: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 12: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 13: ASEE2012 Presentation: iKNEER User Study

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Page 14: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

iKNEER is designed for engineering education researchers, investors, and educators.

Page 15: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Novice researchers in an interdisciplinary field may experience conceptual difficulties.

Page 16: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Conceptual Difficulties of Trained Engineers in EER

Page 17: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Conceptual Difficulties of Trained Engineers in EER

Difficulties in: ‣ framing research questions with broad appeal

‣ appreciating qualitative or mixed-methods approaches‣ pursuing interdisciplinary collaboration ... (Borrego,2007)

Page 18: ASEE2012 Presentation: iKNEER User Study

1How does iKNEER influence novice researchers in making decisions regarding their research directions?

Introduction Methods Findings Q&A

Research Questions

Page 19: ASEE2012 Presentation: iKNEER User Study

1How does iKNEER influence novice researchers in making decisions regarding their research directions?

2What issues can be identified that can inform future design of such tools?

Introduction Methods Findings Q&A

Research Questions

Page 20: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Qualitative Approach

Page 21: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Qualitative Approach

Page 22: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

6 participants from 1st year PhD research methods class

Qualitative Approach

Page 23: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

3 males, 3 females; 2 internationals

Qualitative Approach

Page 24: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

P1

Background: 4 years teaching

Research Interests: Mentoring

P2

Background: BS & MS in EE

Research Interests: Global engineering

P3

Background: 3 years industry, 6 years teaching

Research Interests: Broad, undecided

P4

P5

P6

Background: BS in ECE, 4 years industry

Research Interests: Open source community

Background: BS in CivilE, philosophy minor

Research Interests: Sustainability

Background: Young engr faculty member

Research Interests: Social awareness, etc.

Page 25: ASEE2012 Presentation: iKNEER User Study

Training Session on iKNEER (30min)

Introduction Methods Findings Q&A

Page 26: ASEE2012 Presentation: iKNEER User Study

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Introduction Methods Findings Q&A

Page 27: ASEE2012 Presentation: iKNEER User Study

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Semi-Structured Interview (30-50min)

Introduction Methods Findings Q&A

Page 28: ASEE2012 Presentation: iKNEER User Study

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Semi-Structured Interview (30-50min)

Qualitative Thematic Analysis

Introduction Methods Findings Q&A

Page 29: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Page 30: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Category1 Category2 Category3 Category4

Page 31: ASEE2012 Presentation: iKNEER User Study

Introduction Methods Findings Q&A

Page 32: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

Page 33: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

1 Unable to find relevant literature (interdisciplinary nature of EER)

“it was in a journal that I never would have looked at probably because I was so ENE focused”

“There is a bunch of econ stuff. There is law stuff. There is education stuff. There is philosophy stuff. There is cognitive stuff ... ”

Transcript

Introduction Methods Findings Q&A

Page 34: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

Page 35: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I’ve gotten pretty good at finding literature at that point and so the difficulty right now is like I’m analyzing interview sessions, so it’s

very qualitative.”

2 Different stages, different challenges (diverse background)

Page 36: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

Page 37: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I am trying to write in a language that is not mine, so my structural constructions, my

grammar constructions are not as good as they are for a native speaker or for a native writer.”

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

Page 38: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

4 No Difficulties, or care enough to overcome any difficulties

Page 39: ASEE2012 Presentation: iKNEER User Study

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I was born for this degree. ”“I care about people, so my talents and my skill set really lend itself toward being a social science or an

educational researcher.” “I grasp the concepts because I care about them.”

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

4 No Difficulties, or care enough to overcome any difficulties

Page 40: ASEE2012 Presentation: iKNEER User Study

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

Introduction Methods Findings Q&A

Page 41: ASEE2012 Presentation: iKNEER User Study

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

Introduction Methods Findings Q&A

Page 42: ASEE2012 Presentation: iKNEER User Study

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

3 iKNEER has a role beyond research

Introduction Methods Findings Q&A

Page 43: ASEE2012 Presentation: iKNEER User Study

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

3 iKNEER has a role beyond research

4 Broad context of research decision making

Introduction Methods Findings Q&A

Page 44: ASEE2012 Presentation: iKNEER User Study

Cat. 3 of 3: Implications for Design

1 Position of search bar

Introduction Methods Findings Q&A

Page 45: ASEE2012 Presentation: iKNEER User Study

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

Introduction Methods Findings Q&A

Page 46: ASEE2012 Presentation: iKNEER User Study

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

Introduction Methods Findings Q&A

Page 47: ASEE2012 Presentation: iKNEER User Study

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

4 Link grant proposals with papers

Introduction Methods Findings Q&A

Page 48: ASEE2012 Presentation: iKNEER User Study

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

4 Link grant proposals with papers

5 Open source

Introduction Methods Findings Q&A

Page 49: ASEE2012 Presentation: iKNEER User Study

Questions?

Xin Chen, Adithya Raghavan, Krishna Madhavan, Ji Soo Yi{chen654, araghava, cm, yij}@purdue.edu

Introduction Methods Findings Q&A