C. Atman, 2007 Jun 08 1 Rene Magritte, c. 1956

Engineering Education Research:Some History and Examples from the U.S.

Opening AddressDanish Centre for Engineering Education Research and DevelopmentJune 8, 2007

Cindy AtmanDirector, Center for Engineering Learning and TeachingDirector, Center for the Advancement of Engineering EducationMitchell T. Bowie and Lella Blanche Bowie Endowed ChairProfessor, Industrial EngineeringUniversity of Washington

This work has been supported by grants from the National Science Foundation RED-9358516, EEC-0639895, REC-012554, ESI-0227558, SBE-0354453, the Boeing Company, and the Ford Motor Company Fund.

Center for Engineering Learning and Teaching

C. Atman, 2007 Jun 08 3

Engineering:Part of the Global Human Endeavor

Doing Engineering (one definition)“The engineering method is the strategy for causing the best change in a poorly understood situation within the available resources.” (Koen, 2003)

...in ContextEngineering is a central element of the solutions for the global challenges we all face…environment, access to clean water, sustainability…

C. Atman, 2007 Jun 08 4

What does every engineer need to know?

ethics global context management skills

mathengineering analysis problem solving

leadershipdesign professionalism

contemporary issues analyze data teamwork

conduct experiments life-long learning

science communicationsocietal context

engineering toolscreativity

business knowledge

technical knowledge

C. Atman, 2007 Jun 08 5

Our Challenge as Educators

• How do we teach our students......everything on the previous slide, plus

• Understanding engineering as a rich, interconnected set of knowledge and skills that can be used to solve complex problems

• Understanding uncertainty and tolerating ambiguity• Knowing how to identify when they don’t know something• The ability to learn from failure• The ability to reflect• The sense of “peripheral vision” needed to ensure a good design• ...and much more

C. Atman, 2007 Jun 08 6

A Global Need and Response

• A global need• Research on how engineering students learn• Research on effective teaching for engineering learning• Research on effective change strategies for colleges of

engineering• ...and much more

• A global response• Danish Centre on Engineering Education Research and

Development• Recent research activity across the globe, including the U.S.

C. Atman, 2007 Jun 08 7

The Global Engineering Education Community:Piecing Together a Picture of Engineering Education

C. Atman, 2007 Jun 08 8

Today’s Agenda

• Engineering Education: A Global Challenge• History of Engineering Education Research in the U.S.• A Focus on Centers

• Campus-based-Example center and research:

• National-Example center and research:

• Engineering Education: A Global Challenge

C. Atman, 2007 Jun 08 9

Growth of Engineering EducationResearch in the U.S.

• A growing community...• Professional organizations, committees, centers,

departments, funding agencies• ...with a voice

• Publication venues• Influential publications• Government/industry reports, books, papers• Community articulating goals

C. Atman, 2007 Jun 08 10

1980s 1990s 2000s 201950s 1960s 1970s1940s1930s1920s1910s1900s890s

WickendenReport

MannReport

American Society for Engineering Education ASEE

Nat’l Science Foundation NSF

Nat’l Academy of Engr. NAE

NSF Engr.EducationCoalitions

VanTH-ERCCASEE

CAEECIRTL

NCETE

Engr. Ed. CtrsNCEER

Accreditation Board for Engineering & Technology ABET EC2000

Sample of activity relevant to engineering education research in the U.S.

publications

organizations

Leonhard CenterCELT

CEE

Educational Research & Methods ERM

Purdue U.VA TechUT St. U.

EEC division

Gordon PrizeEngr. Ed. Cmte

CO St. U.Clemson U

http://asee.org/http://asee.org/http://nsf.gov/http://nsf.gov/http://www.nae.edu/http://www.nae.edu/http://abet.org/http://abet.org/http://www.nae.edu/nae/awardscom.nsf/weblinks/DWHT-4UJPVA?OpenDocumenthttp://www.engr.colostate.edu/es/engineeringed/http://www.ces.clemson.edu/earnest/fall_wint_06-07/index.htmhttp://www.ces.clemson.edu/earnest/fall_wint_06-07/index.htmhttp://asee.org/http://nsf.gov/http://www.nae.edu/http://abet.org/http://abet.org/http://fie.engrng.pitt.edu/erm/http://www.nsf.gov/div/index.jsp?div=EEChttp://www.nae.edu/nae/awardscom.nsf/weblinks/DWHT-4UJPVA?OpenDocumenthttp://www.nae.edu/nae/engeducom.nsf?OpenDatabasehttp://www.engr.colostate.edu/es/engineeringed/http://www.ces.clemson.edu/earnest/fall_wint_06-07/index.htm

C. Atman, 2007 Jun 08 11

1980s 1990s 2000s 2010

National Academies

Rising Above...

Felder et al.

Longitudinal Study, Part I

ICREEInaugural

Proceedings

Sample of the community voice

sample of presentation, publication venues:ASEE, FIE, ICEE, MDW, iCEER; JEE, AREE, AEE, IEEE Transactions on Ed., IJEE, EJEE, JSTEM, JWMSE, Design Studies, and more...

sample of presentation, publication venues:ASEE, FIE, ICEE, MDW, iCEER; JEE, AREE, AEE, IEEE Transactions on Ed., IJEE, EJEE, JSTEM, JWMSE, Design Studies, and more...

NSF

RestructuringEngr. Ed.

Bordogna, Fromm & Ernst

Innovation Through

Integration

NRC

...Adaptive System

ASEE

Green Report

NRC

From Analysis to Action

Wankat & Oreovicz

Teaching Engineering

Johnson, Johnson & Smith

Cooperative Learning

Sheppard et al.

Teaching & Learning

Practices...

Engineer of 2020

NAE

Educating the Engineer

of 2020

Heywood

Engineering Education

EERC research agenda

JEESpecial Issue

NSF

Systemic Reform

C. Atman, 2007 Jun 08 12

1980s 1990s 2000s 2010

Sample of the funding picture

NationalScienceFoundation NSF

Engineering Education & Centers division EEC

Fund for the Improvement of Postsecondary Education, U.S. Dept. of Education FIPSE

graduate fellowships for women, minorities GEE/IGERT, GRFGK–12 graduate teaching fellowships

Model Institutions for Excellence MIE

Engineering Research Centers ERC

Department Level Reform

Ctrs for Teaching & Learning

Engr. Ed. Research

Engineering Education Scholars EESP

other funding sources:corporations, foundationsother funding sources:corporations, foundations

http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://nsf.gov/http://www.ed.gov/about/offices/list/ope/fipse/index.htmlhttp://nsf.gov/http://www.nsf.gov/div/index.jsp?div=EEChttp://www.ed.gov/about/offices/list/ope/fipse/index.htmlhttp://www.mieprogram.org/http://www.mieprogram.org/

C. Atman, 2007 Jun 08 13

1980s 1990s 2000s 2010

NCEER Northwestern U.

national centers

campus-based centers

NSF EngineeringEducationCoalitions

Sample of engineering education research organizations

Engineering Education Centers12 centers in 2001

Leonhard Center Penn State U.

CELT U. of Washington

CEE Colorado School of Mines

Purdue U.

Virginia Techdepartments/ programs in engineering

education

Utah State U.

Clemson U.

Colorado State U.

VanTH-ERC

CIRTL

NCETE

CASEE 39 affiliates in 2007

CAEE

http://www.mccormick.northwestern.edu/news/articles/250http://www.engr.psu.edu/LeonhardCenter/eec/lc/index.htmhttp://depts.washington.edu/celtweb/http://www.mines.edu/research/cee/https://engineering.purdue.edu/ENEhttp://www.enge.vt.edu/http://www.ete.usu.edu/index.htmhttp://www.ces.clemson.edu/earnest/fall_wint_06-07/index.htmhttp://www.engr.colostate.edu/es/engineeringed/http://www.vanth.org/http://cirtl.wceruw.org/http://www.ncete.org/http://www.nae.edu/NAE/caseecomnew.nsf?OpenDatabasehttp://www.engr.washington.edu/caee/http://www.mccormick.northwestern.edu/news/articles/250http://www.engr.psu.edu/LeonhardCenter/eec/lc/index.htmhttp://depts.washington.edu/celtweb/http://www.mines.edu/research/cee/https://engineering.purdue.edu/ENEhttp://www.enge.vt.edu/http://www.ete.usu.edu/index.htmhttp://www.ces.clemson.edu/earnest/fall_wint_06-07/index.htmhttp://www.engr.colostate.edu/es/engineeringed/http://www.vanth.org/http://cirtl.wceruw.org/http://www.ncete.org/http://www.nae.edu/NAE/caseecomnew.nsf?OpenDatabasehttp://www.engr.washington.edu/caee/

C. Atman, 2007 Jun 08 14

1980s 1990s 2000s 201950s 1960s 1970s1940s1930s1920s1910s1900s890s

WickendenReport

MannReport

American Society for Engineering Education ASEE

Nat’l Science Foundation NSF

Nat’l Academy of Engr. NAE

NSF Engr.EducationCoalitions

VanTH-ERCCASEE

CAEECIRTL

NCETE

Engr. Ed. CtrsNCEER

Accreditation Board for Engineering & Technology ABET EC2000

Sample of activity relevant to engineering education research in the U.S.

publications

organizations

Leonhard CenterCELT

CEE

Educational Research & Methods ERM

Purdue U.VA TechUT St. U.

EEC division

Gordon PrizeEngr. Ed. Cmte

CO St. U.Clemson U

C. Atman, 2007 Jun 08 15

Today’s Agenda

• Engineering Education: A Global Challenge• History of Engineering Education Research in the U.S.• A Focus on Centers

• Campus-based-Example center and research:

• National-Example center and research:

• Engineering Education: A Global Challenge

C. Atman, 2007 Jun 08 16

39centers

CASEE in 2007

12centers

EEC in 2001

• Engineering Education Centers (EEC) members, 2001

• CRESMET, Arizona State U.• CEE, Colorado School of Mines• CETL, Georgia Tech• EDC, IUPUI• CETL, Kettering U.• Leonhard Center, Penn State U.• AE3, UIUC• CELT, U. of Washington• ELC, U. of Wisconsin-Madison• U. of Oklahoma (proposed)• S. Dakota School of Mines & Technology (proposed)• U. of Texas-Austin (proposed)

• Center for the Advancement of Scholarship on Engineering Education (CASEE) affiliates, 2007

• CAEE• CDR, Stanford U.• CEE, Colorado School of Mines• CEEO, Tufts U.• CELT, U. of Washington• CETL, Georgia Tech• CSHE, U. of California-Berkeley• WST, Georgia Tech• Commission on Professionals in Science and Technology• Virginia Tech Dept. of Engineering Education• Dept. of Mechanical Engineering, U. of Maryland-Baltimore County• Dept. of Technology & Society, Stony Brook U. • EERC, Washington State U.• Learning in Formal and Informal Environments Center, U. of Washington• Boeing Learning, Training, and Development• Leonhard Center, Penn State U.• Materials Engineering Dept., Cal Poly State U.-San Luis Obispo• Model Institutions for Excellence, U. of Texas-El Paso• National Center for Engineering and Technology Education• NCEER, Northwestern U.• Schaefer School of Engineering, Stevens Institute of Technology • School of Engineering and Applied Science, U. of Virginia• Teaching and Learning Laboratory, MIT• Texas Engineering Experiment Station, Texas A&M U.• Committee on Academic Prerequisites for Professional Practice, American Society of

Civil Engineers• College of Engineering, Cal Poly State U.-San Luis Obispo• College of Engineering and Science, Louisiana Tech U.• College of Engineering, U. of Massachusetts-Amherst• College of Engineering, U. of Michigan• College of Engineering, Purdue U.• Technology Education Program, Dept. of Industrial Technology, Purdue U.• Dept. of Technology and Society, Stony Brook U.• Dwight Look College of Engineering, Texas A&M U.• East Lake High School Robotic Boosters, Inc.• Faculty Innovation Center, College of Engineering, U. of Texas-Austin• Laboratory for Innovative Technology and Engineering Education (LITEE), Auburn

U.• Lean Aerospace Initiative Educational Network (LAI EdNet)• Project Lead The Way• Rowan University

A Focus on Centers

C. Atman, 2007 Jun 08 17

A Focus on Centers: Relative Emphasis

centers

campus-based national

conducting research * **

supporting teaching ** *

C. Atman, 2007 Jun 08 18

A Focus on Centers:Campus-based Centers

centers

campus-based national

conducting research * **

supporting teaching ** *

• Research on Learning/Teaching• Center research program• Support other faculty research

• College/Department Support• Accreditation• Curriculum development

• Faculty Support• Individual consultations• Workshops• Seminars, brown-bags• Resource bank• Education technology support

• Evaluation/Assessment• Individual faculty

(formative/diagnostic)• Grants• Programs

• Graduate Student Support• TA Training• Graduate courses on

learning/teaching• Workshops

• Undergraduate Student Support• Student organizations• Student programs

C. Atman, 2007 Jun 08 19

A Focus on Centers:Three Example Campus-Based Centers

centers

campus-based national

conducting research * **

supporting teaching ** *

• NCEER, Northwestern Center for Engineering Education Research• Recent center in the U.S.• est. 2007, Northwestern U.

• Leonhard Center for the Enhancement of Engineering Education• First center in a College of Engineering in the U.S.• est. 1990, Penn State U.

• CELT, Center for Engineering Learning & Teaching• First center in the U.S. with combined research and effective teaching

missions• est. 1998, U. of Washington

C. Atman, 2007 Jun 08 20

Campus-Based CentersNorthwestern Center for Engineering Education Research (NCEER)

centers

campus-based national

conducting research * **

supporting teaching ** *

• Research on Learning/Teaching• Center research program• Support other faculty research

• College/Department Support• Accreditation• Curriculum development

• Faculty Support• Individual consultations• Workshops• Seminars, brown-bags• Resource bank• Education technology support

• Evaluation/Assessment• Individual faculty

(formative/diagnostic)• Grants• Programs

• Graduate Student Support• TA Training• Graduate courses on

learning/teaching• Workshops

• Undergraduate Student Support• Student organizations• Student programs

C. Atman, 2007 Jun 08 21

Campus-Based CentersLeonhard Center

centers

campus-based national

conducting research * **

supporting teaching ** *

• Research on Learning/Teaching• Center research program• Support other faculty research

• College/Department Support• Accreditation• Curriculum development

• Faculty Support• Individual consultations• Workshops• Seminars, brown-bags• Resource bank• Education technology support

• Evaluation/Assessment• Individual faculty

(formative/diagnostic)• Grants• Programs

• Graduate Student Support• TA Training• Graduate courses on

learning/teaching• Workshops

• Undergraduate Student Support• Student organizations• Student programs

C. Atman, 2007 Jun 08 22

centers

campus-based national

conducting research * **

supporting teaching ** *

• Research on Learning/Teaching• Center research program• Support other faculty research

• College/Department Support• Accreditation• Curriculum development

• Faculty Support• Individual consultations• Workshops• Seminars, brown-bags• Resource bank• Education technology support

• Evaluation/Assessment• Individual faculty

(formative/diagnostic)• Grants• Programs

• Graduate Student Support• TA Training• Graduate courses on

learning/teaching• Workshops

• Undergraduate Student Support• Student organizations• Student programs

Campus-Based CentersCenter for Engineering Learning & Teaching (CELT)

C. Atman, 2007 Jun 08 23

Center for Engineering Learning and Teaching

research on engineering student learning

research on engineering student learning

promoting effective teaching in engineering

promoting effective teaching in engineering

research findings

feedback about what works

C. Atman, 2007 Jun 08 24

CELT: First Center in U.S. to Combine Research and Effective Teaching Missions

• Research on engineering student learning• Promoting effective teaching

• Based on current scholarship on learning• Individualized services at the faculty, dept., college

levels- Implementing new teaching methods- Documenting student learning- Obtaining resources about effective learning, teaching- Curriculum development

C. Atman, 2007 Jun 08 25

De

sig

nP

roce

sse

sG

ath

eri

ng

Info

rmat

ion

0% 20% 40% 60% 80%

supervision concernsavailability of materials

neighborhood demographicslegal liability

technical referencesneighborhood opinionsmaintenance concerns

utilitiesbody dimensions

labor availability and costsother

information about the areamaterial specification

budgethandicapped accessibility

safetymaterial costs

0% 20% 40% 60% 80%

supervision concernsavailability of materials

neighborhood demographicslegal liability

technical referencesneighborhood opinionsmaintenance concerns

utilitiesbody dimensions

labor availability and costsother

information about the areamaterial specification

budgethandicapped accessibility

safetymaterial costs

0% 20% 40% 60% 80%

supervision concernsavailability of materials

neighborhood demographicslegal liability

technical referencesneighborhood opinionsmaintenance concerns

utilitiesbody dimensions

labor availability and costsother

information about the areamaterial specification

budgethandicapped accessibility

safetymaterial costs

0123456789

10

0% 20% 40% 60% 80% 100%

PD

GATH

GEN

MOD

FEAS

EVAL

DEC

COM

0

10

20

30

40

50

60

0% 20% 40% 60% 80% 100%

PD

GATH

GEN

MOD

FEAS

EVAL

DEC

COM

Co

nsi

de

rin

gC

on

text

2

1

1

1

62

17

5

16

9

35

11

11

2

1

4

11

7

no code wall water bank surroundings

no code

technical

logistical

natural

social

4

2

3

2

122

35

11

21

1

25

1

75

12

16

1

1

8

14

2

no code wall water bank surroundings

no code

technical

logistical

natural

social

Freshmen Seniors Experts

DE

SIG

N P

RO

CE

SS S

KIL

LS

Doing Engineering Design

...... ... ...

0102030405060708090

100

0% 20% 40% 60% 80% 100%

PD

GATH

GEN

MOD

FEAS

EVAL

DEC

COM

00:00:00:00 00:12:00:00 00:24:00:00 00:36:00:00

C. Atman, 2007 Jun 08 26

Research FocusProblem Scoping in Design

• Engineering design happens in context• Local, regional, national, global• Environmental• Social, economic, political• Technical

• Assessing student problem-scoping approaches

C. Atman, 2007 Jun 08 27

Verbal Protocol Study

• Solved “Midwest Floods problem” thinking aloud

Over the summer, the Midwest experienced massive flooding of the Mississippi River. What factors would you take into account in designing a retaining wall system for the Mississippi?

• Took from 20–30 minutes to solve the problem• Third in a series of three short design tasks• Responses transcribed, segmented, and coded• 29 freshmen, 44 senior engineering students; mid-1990s•

Atman, C.J. et al. (2007). Breadth in problem scoping: A comparison of freshman and senior engineering students. Mudd Design Workshop VI.

C. Atman, 2007 Jun 08 28

4

7

2

1

2

2

1

1

w all w ater bank surroundings

technical

logistical

natural

social

no code

no code

Coding for Breadth:A Problem-Scoping Space

• Physical location• Wall• Water• Bank• Surroundings

• Frame of reference• Technical• Logistical• Natural• Social

C. Atman, 2007 Jun 08 29

Seniors: Broader, more extensiveproblem-scoping

• Seniors’ responses (vs. freshmen’s)• More factors (p < 0.001)• More coverage of problem def. space (p < 0.01)

4.3

2.7

1.8

no code water bank surroundings

technical

logistical

natural

social

no code

wall

9.6

3.4

1.7

1.6

5.6

1.1

wall water bank surroundings

technical

logistical

natural

social

no code

no code

freshmen (N = 29) seniors (N = 44)

C. Atman, 2007 Jun 08 30

wall water bank surroundings

technical

logistical

natural

social

no code

no code

Context vs. Detail Nodes

contextdetail

C. Atman, 2007 Jun 08 31

wall water bank surroundings

technical

logistical

natural

social

no code

no code

Examples of Detail and Context Factors

contextdetail

“cost of materials”“budget”

“aesthetic appeal”“surrounding habitat”

C. Atman, 2007 Jun 08 32

Growth in Problem-Scoping

detail

detail

context

context

0

5

10

15

20

25

30

35

40

freshmen seniors

aver

age

num

ber

of s

egm

ents

detaildetail

context

context

0

1

2

3

4

5

6

7

8

9

freshmen seniors

aver

age

num

ber

of n

odes

cov

ered

node coveragesegments

C. Atman, 2007 Jun 08 33

Campus-Based CentersConnecting Research and Practice

• Insights from research on problem-scoping• On average...

- Freshmen and seniors consider contextual issues in approaching engineering design.

- Seniors show growth in problem-scoping.• ...but wide variation within each group.

• Connecting to the classroom• Assessment tools• Curriculum design• Classroom exercises

C. Atman, 2007 Jun 08 34

Today’s Agenda

• Engineering Education: A Global Challenge• History of Engineering Education Research in the U.S.• A Focus on Centers

• Campus-based-Example center and research:

• National-Example center and research:

• Engineering Education: A Global Challenge

C. Atman, 2007 Jun 08 35

A Focus on Centers

centers

campus-based national

conducting research * **

supporting teaching ** *

C. Atman, 2007 Jun 08 36

A Focus on Centers:National Centers

centers

campus-based national

conducting research * **

supporting teaching ** *

• Advantages of larger scale• More opportunity to

• approach larger challenges• gain broader/deeper insights• collaborate across community• build community

• Example emphases• Conducting research on learning/teaching• Building community• Developing resources• Developing educational technology• Implementing change

C. Atman, 2007 Jun 08 37

centers

campus-based national

conducting research * **

supporting teaching ** *

• Current NSF-funded Research Centers• VanTH-ERC, Vanderbilt Northwestern Texas Harvard/MIT

Engineering Research Center• CAEE, Center for the Advancement of Engineering Education• CIRTL, Center for the Integration of Research, Teaching, and

Learning• NCETE, National Center for Engineering and Technology

Education• Research/Implementation/Networking

• NAE CASEE, Center for the Advancement of Scholarship on Engineering Education

A Focus on Centers:National Centers

C. Atman, 2007 Jun 08 38

Center for the Advancement of Engineering Education (CAEE)

• Leadership Team: Adams, Atman, Fleming, Leifer, Miller, Sheppard, Smith, Streveler, Stevens, Turns

• Institutions: Colorado School of Mines, Howard University, Stanford University, University of Minnesota, University of Washington

• Scholarship on Learning Engineering (Sheppard)• Research on the engineering student experience • Academic Pathways Study (APS)

• Scholarship on Teaching Engineering (Turns)• Research on engineering teaching decision making and knowledge acquisition

• Institute for Scholarship on Engineering Education (Adams) • Building the engineering education research community • Year-long Institutes at UW, Stanford, Howard

National Science Foundation, Grant No. ESI-0227558

C. Atman, 2007 Jun 08 39

Academic Pathways Study (APS)Sheppard (lead), Atman, Fleming, Miller, Smith, Streveler, Stevens

• Large scope, multi-year, longitudinal study of undergraduate engineering students

• Three cohorts of students and one cohort of early career engineers from four very different undergraduate engineering programs

• Descriptive, multi-method study

• From a student’s perspective…

C. Atman, 2007 Jun 08 40

APS Research Questions

• Skills• How do students’ skills and knowledge develop and

change over time?• Identity

• How do students come to identify themselves as engineers?

• Education• What elements of a student’s education contribute to

changes observed in skills and knowledge development?

C. Atman, 2007 Jun 08 41

APS Research Methods

• Surveys• Structured interviews• Unstructured interviews, ethnographic observations• Engineering “thinking and doing” tasks• Academic transcript evaluation• Exit interviews

C. Atman, 2007 Jun 08 42

APS Research Questions by Methodology

SurveysStructured Interviews

Unstructured Interviews

Engineering Doing

Skills

Identity

Education

C. Atman, 2007 Jun 08 43

Sample APS Research Results from “Engineering Doing” and Survey Methods

SurveysStructured Interviews

Unstructured Interviews

Engineering Doing

Skills

Identity

Education

C. Atman, 2007 Jun 08 44

Engineering Thinking and Doing Focus

Student conceptions of engineering and design (Engineering ‘Thinking’)

Student performance on engineering design tasks (Engineering ‘Doing’)

Part of CELT’s long-term research program on engineering design processes

C. Atman, 2007 Jun 08 45

Engineering Doing: Freshmen10-minute, Paper-and-Pencil Engineering Task:

Over the summer the Midwest experienced massive flooding of the Mississippi River. What factors would you take into account in designing a retaining wall system for the Mississippi?

• Streamlined method, compared to past study• Written (not verbal) response• 10-minute limit

• 142 students at four partner institutions, 2003Kilgore, D. et al. (to appear). Considering context: A study of first-year engineering students. Journal of Engineering Education.

C. Atman, 2007 Jun 08 46

Average Profile of Freshman Responses

1.9

2.9

0.8

0.6

0.1

1.8

0.4

0.1

1.2

0.2

0.1

0.5

0.7

0.2

wall water bank surroundings

technical

logistical

natural

social

APS freshmen (N = 124)

C. Atman, 2007 Jun 08 47

Detail vs. Context Factors by Gender

FM

detail

detail

context

context

0 2 4 6 8 10 12 14

men

women

number of segments

Factors by category andby gender(all APS, N = 51 F + 92 M)significant difference, p < 0.02

C. Atman, 2007 Jun 08 48

Engineering Doing:An emerging picture from the first year

• Comparing datasets• APS data consistent with past data• With new sample and streamlined method

• Considering context – gender differences• men: emphasis on details of solution such as material,

financial...• women: emphasis on contextual factors such as social,

natural...

C. Atman, 2007 Jun 08 49

Sample APS Research Results from “Engineering Doing” and Survey Methods

SurveysStructured Interviews

Unstructured Interviews

Engineering Doing

Skills

Identity

Education

C. Atman, 2007 Jun 08 50

Persistence in Engineering (PIE)Survey Focus

• To identify correlates of persistence in engineering• ACADEMIC PERSISTENCE is operationalized as majoring

in engineering• PROFESSIONAL PERSISTENCE is operationalized as

expressing an intention to practice engineering for at least 3 years after graduating with a bachelor’s degree.

•Eris, Ö., et al. (2007). A preliminary analysis of correlates of engineering persistence: Results from a longitudinal study. Proceedings of the 2007 American Society for Engineering Education Annual Conference & Exposition.

C. Atman, 2007 Jun 08 51

PIE Survey Findings from the First Three Years

• A focus on persisters/non-persisters• motivation• confidence• perceived importance of skills• disengagement/engagement

C. Atman, 2007 Jun 08 52

No overall difference between persisters and non-persisters in…

• Financial motivation to pursue engineering• Social relevance as a motivation to pursue

engineering• Perception of the importance of math and science• Confidence in interpersonal and professional skills• Reported familiarity with the field of engineering in

first and sophomore years

C. Atman, 2007 Jun 08 53

Non-persisters, compared to persisters report…

• On motivation to pursue engineering- At the start of their academic career, a greater degree of family

influence - Lower degree of a mentor’s influence

• Lower confidence in math and science skills • Lower rating of the importance of interpersonal and

professional skills• More academically disengaged in both engineering and

liberal arts courses

C. Atman, 2007 Jun 08 54

Motivation: Family InfluencePersisters/Non-persisters

0.00

0.10

0.20

0.30

0.40

0.50

FR1 FR2 SO1 SO2 JR1 JR2

Administration (academic years)

Con

stru

ct 2

b: M

otiv

atio

n (F

amily

Influ

ence

)

Nonpersisters

Persisters

*

*

C. Atman, 2007 Jun 08 55

Confidence in Math and Science SkillsPersisters/Non-persisters

0.00

0.20

0.40

0.60

0.80

1.00

FR1 FR2 SO1 SO2 JR1 JR2

Administration (academic years)

Con

stru

ct 3

a: C

onfid

ence

in M

ath

and

Scie

nce

Skill

s

Nonpersisters

Persisters

* ** *

C. Atman, 2007 Jun 08 56

Persistence in Engineering: An emerging picture from the first three years

• Non-persisters report:• More family influence to be an engineer at the start of

their career• Lower confidence in math and science skills• More academically disengaged in both engineering and

liberal arts courses

C. Atman, 2007 Jun 08 57

Emerging Findings Across the Study:From the student perspective

• Large variation across sample at four institutions, e.g.• Reasons for choice of major

• Financial security• Contribution to society• Influence of family or mentors

• Curriculum and skill development issues• Heavy workloads, competition, stress• First two years give little “vision” of engineering (design and

teamwork come late)• Understanding context vs. detail (a “systems” view)

C. Atman, 2007 Jun 08 58

Emerging Findings Across the Study:From the student perspective (cont.)

• Commitment to field of engineering• Varies greatly, affected by personal situation, learning

experiences, institutional procedures• Decision to be an engineer reexamined often

• Reasons for leaving• Lack of confidence in math/science skills• Fear of losing scholarships• Perception that engineering is too narrow (no insight into the

contributions of engineering to social good)• Factors affect men and women differently

C. Atman, 2007 Jun 08 59

A Focus on Centers:National Centers

centers

campus-based national

conducting research * **

supporting teaching ** *

• Advantages of larger scale• More opportunity to:

• approach larger challenges• gain broader/deeper insights• collaborate across community• build community

C. Atman, 2007 Jun 08 60

CAEE’s National Presence, January 2003

Legend

team memberor advisor

institution

C. Atman, 2007 Jun 08 61

CAEE’s Growing Presence, May 2006

Legend

project connectiontravelrelocation (people)or replication(projects)

project or program

C. Atman, 2007 Jun 08 62

Today’s Agenda

• Engineering Education: A Global Challenge• History of Engineering Education Research in the U.S.• A Focus on Centers

• Campus-based-Example center and research:

• National-Example center and research:

• Engineering Education: A Global Challenge

C. Atman, 2007 Jun 08 63

A Global Conversation

C. Atman, 2007 Jun 08 64

To Meet a Global Challenge:Piecing Together a Picture of Engineering Education

C. Atman, 2007 Jun 08 65

Continuing the Conversation

• Today…• Research questions?• Research communities?• Change strategies?• Other topics?• Coffee or tea?

• After today…• atman@engr.washington.edu• CELT: http://depts.washington.edu/celtweb/• CAEE: http://www.engr.washington.edu/caee/

mailto:atman@engr.washington.eduhttp://depts.washington.edu/celtweb/http://www.engr.washington.edu/caee/

C. Atman, 2007 Jun 08 66

References (1 of 3)Adams, R.S. & Cummings-Bond, T. (2004). Career trajectories in engineering education: Where are they now? Proceedings of the 2004

American Society for Engineering Education Annual Conference & Exposition.Adams, R.S., Turns, J., Atman, C.J. (2003). Educating Effective Engineering Designers: The Role of Reflective Practice, Design Studies,

24(3). ASEE Engineering Deans Council and Corporate Roundtable. (1994). The Green Report: Engineering Education for a Changing World.

Retrieved May 29, 2007, from http://www.asee.org/resources/beyond/green.cfm.Atman, C.J. (2006). The growth of research in engineering education in the U.S.: Some personal observations. CELT Internal Report

CELT-06-1. Center for Engineering Learning and Teaching.Atman, C.J., Adams, R.S., Cardella, M.E., Turns, J., Mosborg, S., Saleem, J. (in press, October 2007). Engineering design processes: A

comparison of student and expert practitioners. Journal of Engineering Education.Atman, C.J., Chimka, J.R., Bursic, K.M., Nachtmann, H.L. (1999). A Comparison of Freshman and Senior Engineering Design Processes.

Design Studies, 20(2). Atman, C.J., Yasuhara, K., Adams, R.S., Barker, T.J., Turns, J., Rhone, E. (2007). Breadth in problem scoping: A comparison of freshman

and senior engineering students. Mudd Design Workshop VI.Bordogna, J. et al. (1993). Engineering Education: Innovation Through Integration. Journal of Engineering Education, 82(1).Eris, Ö., et al. (2007). A preliminary analysis of correlates of engineering persistence: Results from a longitudinal study. Proceedings of

the 2007 American Society for Engineering Education Annual Conference & Exposition.Felder, R.M. et al. (1993). A Longitudinal Study of Engineering Student Performance and Retention. I. Success and Failure in the

Introductory Course. Journal of Engineering Education, 82(1).Felder, R.M., Felder, G.N., & Dietz, E.J. (1998). A Longitudinal Study of Engineering Student Performance and Retention. V.

Comparisons with Traditionally-Taught Students. Journal of Engineering Education, 87(4). Felder, R.M., Rugarcia, A. & Stice, J.E. (2000). The future of engineering education: Part 5. Learning how to teach. Chemical

Engineering Education (Summer).Felder, R.M. & Silverman, L.K. (1988). Learning and Teaching Styles in Engineering Education. Engineering Education, 78(7).Felder, R.M., Stice, J.E. & Rugarcia, A. (2000). The future of engineering education: Part 6. Making reform happen. Chemical

Engineering Education (Summer).Felder, R.M., Woods, D.R., Stice, J.E. & Rugarcia, A. (2000). The future of engineering education: Part 2. Teaching Methods that Work.

Chemical Engineering Education (Winter).Felder, R.M., Woods, D.R., Rugarcia, A. & Stice, J.E. (2000). The future of engineering education: Part 4. Learning how to teach.

Chemical Engineering Education (Spring).

http://www.asee.org/resources/beyond/green.cfmhttp://www.asee.org/publications/jee/PAPERS/display.cfm?pdf=99.pdfhttp://www4.ncsu.edu/unity/lockers/users/f/felder/public/Papers/long1.pdfhttp://www4.ncsu.edu/unity/lockers/users/f/felder/public/Papers/long1.pdfhttp://www4.ncsu.edu/unity/lockers/users/f/felder/public/Papers/long1.pdf

C. Atman, 2007 Jun 08 67

References (2 of 3)Froyd, J. (2005). The Engineering Education Coalitions Program. In National Academy of Engineering, Educating the engineer of 2020.de Graaf, E., Sheppard, S.D., Atman, C.J., Kolmos, A., Saunders-Smits, G., Streveler, R.A., (2007). CELT Technical Report 07-01. Center

for Engineering Learning and Teaching.Heywood, J. (2005). Engineering Education: Research and Development in Curriculum and Instruction. Wiley-IEEE Press.Johnson, D.W., Johnson, R.T. & Smith, K. (1991). Active Learning: Cooperation in the College Classroom. Edina, MN: Interaction Book

Company.Kemnitzer, S. (2006). Engineering Education Background Briefing for the National Science Board. Presented August 9, 2006.Kilgore, D., Atman, C.J., Yasuhara, K., Barker, T.J., Morozov, A. (in press, October 2007). Considering context: A study of first-year

engineering students. Journal of Engineering Education.Kilgore, D., Chachra, D., Jones, M., Loshbaugh, H., McCain, J., Yasuhara, K. (2007). Creative, contextual, and engaged: Are women the

engineers of 2020? Proceedings of the 2007 American Society for Engineering Education Annual Conference & Exposition.Koen, B.V. (2003). Discussion of the Method: Conducting the Engineer's Approach to Problem Solving. Oxford University Press.Mann, C.R. (1918). A Study of Engineering Education. Engineering Education Bulletin, 11. New York: The Carnegie Foundation for the

Advancement of TeachingNational Academies’ Committee on Science, Engineering, and Public Policy (COSEPUP) & Committee on Policy and Global Affairs

(PGA). (2007). Rising Above The Gathering Storm: Energizing and Employing America for a Brighter Economic Future. National Academies Press.

National Academy of Engineering. (2005). Educating the engineer of 2020: Adapting engineering education to the new century. Washington, DC: National Academies Press.

National Academy of Engineering. (2004). The engineer of 2020: Visions of engineering in the new century. Washington, DC: National Academies Press.

National Research Council. (1995). Engineering Education: Designing an Adaptive System. National Academies Press.National Research Council. (1996). From Analysis to Action: Undergraduate Education in Science, Mathematics, Engineering, and

Technology. National Academies Press.National Science Foundation. (1995). Restructuring Engineering Education: A Focus on Change. Division of Undergraduate Education,

Directorate for Education and Human Resources.Rugarcia, A., Felder, R.M., Woods, D.R. & Stice, J.E. (2000). The future of engineering education: Part 1. A Vision for a New Century.

Chemical Engineering Education (Winter).

http://www.carnegiefoundation.org/publications/pub.asp?key=43&subkey=984http://www.nap.edu/catalog/11463.htmlhttp://books.nap.edu/openbook.php?isbn=0309052785http://books.nap.edu/openbook.php?record_id=9128http://books.nap.edu/openbook.php?record_id=9128http://books.nap.edu/openbook.php?record_id=9128

C. Atman, 2007 Jun 08 68

References (3 of 3)Sheppard, S.D. (2007). Research on engineering education: Theory informing practice, informing theory. Presented March 24, 2007 at the

2007 International Mechanical Engineering Education Conference.Sheppard, S.D., Macatangay, K., Colby, A. & Sullivan, W. (in press). Educating Engineers: Theory, Practice and Imagination. Jossey

Bass.Shuman, L.J., et al. (2002). The future of engineering education. Proceedings of the 32nd ASEE/IEEE Frontiers in Education Conference.Simon, H.A. (1998). What we know about learning. Journal of Engineering Education, 87(4).Steering committee of the National Engineering Education Research Colloquies. (2006). The Research Agenda for the New Discipline of

Engineering Education. Journal of Engineering Education, 95(4).Turns, J., Adams, R.S., Linse, A. & Atman, C.J. (2004). Bridging from Research to Practice in Undergraduate Engineering Design

Education, International Journal of Engineering Education, 20(3).Turns, J., Atman, C.J., Adams, R.S. & Barker, T. (2005). Research on Engineering Student Knowing: Trends and Opportunities (invited

paper). Journal of Engineering Education, 94(1).Wankat, P.C. (1999). An analysis of the articles in the Journal of Engineering Education. Journal of Engineering Education, 88(1).Wankat, P.C., Felder, R.M., Smith, K.A., Oreovicz, F.S. (2002). The scholarship on teaching and learning in engineering. In M.T. Huber

& S.P. Morreale (Eds.), Disciplinary styles in the scholarship of teaching and learning: Exploring common ground. American Association for Higher Education.

Wankat, P.C. & Oreovicz, F.S. (1992). Teaching Engineering. Mcgraw-Hill College.Whitin, K. & Sheppard, S. (2004). Taking Stock: An Analysis of the Publishing Record as Represented by the Journal of Engineering

Education. Journal of Engineering Education, 93(1).Wickenden, W.E. (1930). Report of the Investigation of Engineering Education, 1923–1929, 1. Pittsburgh: Society for the Promotion of

Engineering Education.Wickenden, W.E. (1934). Report of the Investigation of Engineering Education, 1923–1929, 2. Pittsburgh: Society for the Promotion of

Engineering Education.Woods, D.R., Felder, R.M., Rugarcia, A. & Stice, J.E. (2000). The future of engineering education: Part 3. Developing Critical Skills.

Chemical Engineering Education (Spring).

https://engineering.purdue.edu/ChE/News_and_Events/Publications/teaching_engineering/index.html

C. Atman, 2007 Jun 08 69

Relevant Websites• Accreditation Board for Engineering and

Technology, Inc. (ABET)http://www.abet.org/

• American Society for Engineering Education (ASEE)http://www.asee.org/

• American Society for Engineering Education, Educational Research and Methods Division (ASEE ERM)http://fie.engrng.pitt.edu/erm/

• Center for the Advancement of Scholarship on Engineering Education (CASEE)http://www.nae.edu/NAE/caseecomnew.nsf?OpenDatabase

• Center for the Advancement of Engineering Education (CAEE) http://www.engr.washington.edu/caee/

• Center for Engineering Learning & Teaching (CELT)http://depts.washington.edu/celtweb/

• Center for Intergration of Research, Teaching, and Learning (CIRTL)http://cirtl.wceruw.org/

• Colorado State University, Engineering Education Programhttp://www.engr.colostate.edu/es/engineeringed

• Leonhard Center for Enhancement of Engineering Education http://www.engr.psu.edu/LeonhardCenter/eec/lc/

• National Academy of Engineering (NAE)http://www.nae.edu/

• National Center for Engineering and Technology Education (NCETE)http://www.ncete.org/

• National Science Foundation (NSF)http://www.nsf.gov/

• Purdue University, Department of Engineering Educationhttps://engineering.purdue.edu/ENE/

• Utah State University, Department of Engineering and Technology Education http://www.engineering.usu.edu/ete/

• Vanderbilt-Northwestern-Texas- Harvard/MIT Engineering Research Center (VanTH-ERC)http://www.vanth.org/

• Virginia Tech, Department of Engineering Educationhttp://www.enge.vt.edu/

http://www.abet.org/http://www.asee.org/http://fie.engrng.pitt.edu/erm/http://www.nae.edu/NAE/caseecomnew.nsf?OpenDatabasehttp://www.nae.edu/NAE/caseecomnew.nsf?OpenDatabasehttp://www.engr.washington.edu/caee/http://depts.washington.edu/celtweb/http://cirtl.wceruw.org/http://www.engr.colostate.edu/es/engineeringedhttp://www.engr.psu.edu/LeonhardCenter/eec/lc/http://www.nae.edu/http://www.ncete.org/http://www.nsf.gov/https://engineering.purdue.edu/ENE/http://www.engineering.usu.edu/ete/index.htmhttp://www.vanth.org/http://www.enge.vt.edu/

C. Atman, 2007 Jun 08 70

Acknowledgements

• I would like to thank many people for their input and review of these slides, including Jim Borgford-Parnell, Debbie Chachra, Özgür Eris, Rich Felder, Norman Fortenberry, Patricia Gomez, Sue Kemnitzer, Deborah Kilgore, Tom Litzinger, Tina Loucks-Jaret, Dennis Lund, Ann McKenna, Bayta Maring, Liz Moore, Barbara Olds, Sheri Sheppard, Karl Smith, Jennifer Turns. I would particularly like to thank Ken Yasuhara for his insights on the content, and production and artwork on these slides.

• This work has been supported by grants from the National Science Foundation RED-9358516, EEC-0639895, REC-012554, ESI-0227558, SBE-0354453, the Boeing Company, and the Ford Motor Company Fund.

Engineering Education Research:�Some History and Examples from the U.S.Engineering:�Part of the Global Human EndeavorWhat does every engineer need to know?Our Challenge as EducatorsA Global Need and ResponseThe Global Engineering Education Community:�Piecing Together a Picture of Engineering EducationToday’s AgendaGrowth of Engineering Education�Research in the U.S.Sample of the funding pictureToday’s AgendaA Focus on CentersA Focus on Centers: Relative EmphasisA Focus on Centers:�Campus-based CentersA Focus on Centers:�Three Example Campus-Based CentersCampus-Based Centers�Northwestern Center for Engineering Education Research (NCEER)Campus-Based Centers�Leonhard CenterCampus-Based Centers�Center for Engineering Learning �& Teaching (CELT)Center for Engineering Learning and TeachingCELT: First Center in U.S. to Combine Research and Effective Teaching MissionsDoing Engineering DesignResearch Focus�Problem Scoping in DesignVerbal Protocol StudyCoding for Breadth:�A Problem-Scoping SpaceSeniors: Broader, more extensive�problem-scopingContext vs. Detail NodesExamples of Detail and Context FactorsGrowth in Problem-ScopingCampus-Based Centers�Connecting Research and PracticeToday’s AgendaA Focus on CentersA Focus on Centers:�National CentersA Focus on Centers:�National CentersCenter for the Advancement of Engineering Education (CAEE)Academic Pathways Study (APS)�Sheppard (lead), Atman, Fleming, Miller, Smith, Streveler, StevensAPS Research QuestionsAPS Research MethodsAPS Research Questions by MethodologySample APS Research Results from “Engineering Doing” and Survey MethodsEngineering Thinking and Doing FocusEngineering Doing: FreshmenAverage Profile of Freshman ResponsesDetail vs. Context Factors by Gender Engineering Doing:�An emerging picture from the first yearSample APS Research Results from “Engineering Doing” and Survey MethodsPersistence in Engineering (PIE)�Survey FocusPIE Survey Findings �from the First Three YearsNo overall difference between persisters and non-persisters in…Non-persisters, compared to persisters report…Motivation: Family Influence�Persisters/Non-persistersConfidence in Math and Science Skills� Persisters/Non-persistersPersistence in Engineering: �An emerging picture from the first three yearsEmerging Findings Across the Study:�From the student perspectiveEmerging Findings Across the Study:�From the student perspective (cont.)A Focus on Centers:�National CentersCAEE’s National Presence, January 2003CAEE’s Growing Presence, May 2006Today’s AgendaA Global ConversationTo Meet a Global Challenge:�Piecing Together a Picture of Engineering EducationContinuing the ConversationReferences (1 of 3)References (2 of 3)References (3 of 3)Relevant WebsitesAcknowledgements