asee2012 presentation: ikneer user study

How Does an Interactive Knowledge Platform Influence Decision-Making of Novice Researchers

in Engineering Education Research?

Xin Chen, Adithya Raghavan, Krishna Madhavan, Ji Soo Yi{chen654, araghava, cm, yij}@purdue.edu

Introduction Methods Findings Q&A

iKNEER: Interactive Knowledge Networks for Engineering Education Research

iKNEER.org is a highly interactive data gateway for understanding a range of data including conference and journal publications and federal investments.

Introduction Methods Findings Q&A

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

Search

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

PI’s profile

Introduction Methods Findings Q&A

iKNEER Function Examples

Introduction Methods Findings Q&A

iKNEER is designed for engineering education researchers, investors, and educators.

Introduction Methods Findings Q&A

Novice researchers in an interdisciplinary field may experience conceptual difficulties.

Introduction Methods Findings Q&A

Conceptual Difficulties of Trained Engineers in EER

Introduction Methods Findings Q&A

Conceptual Difficulties of Trained Engineers in EER

Difficulties in: ‣ framing research questions with broad appeal

‣ appreciating qualitative or mixed-methods approaches‣ pursuing interdisciplinary collaboration ... (Borrego,2007)

1How does iKNEER influence novice researchers in making decisions regarding their research directions?

Introduction Methods Findings Q&A

Research Questions

1How does iKNEER influence novice researchers in making decisions regarding their research directions?

2What issues can be identified that can inform future design of such tools?

Introduction Methods Findings Q&A

Research Questions

Introduction Methods Findings Q&A

Qualitative Approach

Introduction Methods Findings Q&A

Qualitative Approach

Introduction Methods Findings Q&A

6 participants from 1st year PhD research methods class

Qualitative Approach

Introduction Methods Findings Q&A

3 males, 3 females; 2 internationals

Qualitative Approach

Introduction Methods Findings Q&A

P1

Background: 4 years teaching

Research Interests: Mentoring

P2

Background: BS & MS in EE

Research Interests: Global engineering

P3

Background: 3 years industry, 6 years teaching

Research Interests: Broad, undecided

P4

P5

P6

Background: BS in ECE, 4 years industry

Research Interests: Open source community

Background: BS in CivilE, philosophy minor

Research Interests: Sustainability

Background: Young engr faculty member

Research Interests: Social awareness, etc.

Training Session on iKNEER (30min)

Introduction Methods Findings Q&A

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Introduction Methods Findings Q&A

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Semi-Structured Interview (30-50min)

Introduction Methods Findings Q&A

Training Session on iKNEER (30min)

Use for Research (2-4 weeks)

Semi-Structured Interview (30-50min)

Qualitative Thematic Analysis

Introduction Methods Findings Q&A

Introduction Methods Findings Q&A

Introduction Methods Findings Q&A

Category1 Category2 Category3 Category4

Introduction Methods Findings Q&A

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

Cat. 1 of 3: Research Difficulties

1 Unable to find relevant literature (interdisciplinary nature of EER)

“it was in a journal that I never would have looked at probably because I was so ENE focused”

“There is a bunch of econ stuff. There is law stuff. There is education stuff. There is philosophy stuff. There is cognitive stuff ... ”

Transcript

Introduction Methods Findings Q&A

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I’ve gotten pretty good at finding literature at that point and so the difficulty right now is like I’m analyzing interview sessions, so it’s

very qualitative.”

2 Different stages, different challenges (diverse background)

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I am trying to write in a language that is not mine, so my structural constructions, my

grammar constructions are not as good as they are for a native speaker or for a native writer.”

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

4 No Difficulties, or care enough to overcome any difficulties

Cat. 1 of 3: Research Difficulties

Introduction Methods Findings Q&A

1 Unable to find relevant literature (interdisciplinary nature of EER)

Transcript

“I was born for this degree. ”“I care about people, so my talents and my skill set really lend itself toward being a social science or an

educational researcher.” “I grasp the concepts because I care about them.”

2 Different stages, different challenges (diverse background)

3 Language difficulties (includes the social science research language )

4 No Difficulties, or care enough to overcome any difficulties

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

Introduction Methods Findings Q&A

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

Introduction Methods Findings Q&A

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

3 iKNEER has a role beyond research

Introduction Methods Findings Q&A

Cat. 2 of 3: iKNEER and Research

1 Focused scope of iKNEER acknowledge the ENE community

2 Collaborative network graph is particularly useful

3 iKNEER has a role beyond research

4 Broad context of research decision making

Introduction Methods Findings Q&A

Cat. 3 of 3: Implications for Design

1 Position of search bar

Introduction Methods Findings Q&A

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

Introduction Methods Findings Q&A

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

Introduction Methods Findings Q&A

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

4 Link grant proposals with papers

Introduction Methods Findings Q&A

Cat. 3 of 3: Implications for Design

1 Position of search bar

2 Many possible ways of user participation

3 Connect with citation management tools (EndNote, Zotero, etc.)

4 Link grant proposals with papers

5 Open source

Introduction Methods Findings Q&A

Questions?

Xin Chen, Adithya Raghavan, Krishna Madhavan, Ji Soo Yi{chen654, araghava, cm, yij}@purdue.edu

Introduction Methods Findings Q&A