comparing naep and the next generation science standards

Comparing NAEP and the Next Generation Science Standards (NGSS)

Teresa Neidorf, Yan Wang, Alka Arora, and Kim GattisAmerican Institutes for Research June 24, 2015 – CCSSO/NCSA – San Diego, CA

The NGSS and NAEP Frameworks

K-12 Framework(NRC 2012)

NGSS(Lead States 2013)

NAEPScience Framework

NAEP TELFramework

NAEP MathematicsFramework

I. IntroductionGoals of the studyOverview of NGSS and NAEP frameworks

II. Methods

I. ResultsScience comparisonsTEL comparisonsMathematics comparisons

II. Summary and Implications

Overview of the Session

3

Determine the extent of alignment between the NGSS and the NAEP STEM frameworks

• NAEP Science

• NAEP Technology and Engineering Literacy (TEL)

• NAEP Mathematics (supplements the science and TEL comparisons)

Provide evidence of where NAEP includes measures of the student understandings described in the NGSS

Identify areas where NGSS and NAEP differ in content coverage

• Inform ongoing discussions of NAEP’s role in emerging national and state systems of STEM assessments

Goals of the Framework Comparison Study

Dimensions of the NGSS and NAEP Frameworks

5

NGSS NAEP Science NAEP TEL

Disciplinary Core Ideas (DCIs)(Content Domains)

Scientific & Engineering Practices

Crosscutting Concepts

Content Areas

Science Practices

Assessment Areas

TEL Practices

NGSS Peformance Expectationsintegrate all 3 dimensions

NGSS: - Describe what ALL students should know and be able to do across grades K-12

NAEP Frameworks:- Guide development of assessments at grades 4, 8 and 12- Provide a measure of student proficiency (across achievement levels)

6

Example NGSS Performance Expectation Table

Source: NGSS lead states (2013)

Comparing the Content DimensionNGSS

Content DomainsNAEP ScienceContent Areas

NAEP TELAssessment Areas

Physical Sciences

Life Sciences

Earth & Space Sciences

Engineering, Technology, and Applications of Science (ETS)

- Engineering Design- Links Among Engineering,

Technology, Science, & Society

Physical Science

Life Science

Earth & Space Sciences

Design & Systems

Technology & Society

Information & Communication Technology (ICT)

NGSS NAEP Science NAEP TELContent Domain

Core Idea

Component Idea

Performance Expectation(PE)

Content Area

Topic

Subtopic

Content Statement

Assessment Area

Subarea

Assessment Target

Organization of Content

8

Grades 4 & 8

Lower Elementary (grades K‐2)Upper Elementary (grades 3‐5)Middle School (grade 8)High School (grade 12)

Lower Elementary (grades K-2)Upper Elementary (grades 3-5)Middle School (grade 8)High School (grade 12)

Grades 4, 8 and 12

NGSS NAEP

Content Domain Earth & Space Sciences

Content Area Earth & Space Sciences

Core Idea

Component Idea

Earth’s place in the universe

Earth and the solar system

Topic

Subtopic

Earth in space and time

Objects in the universe

Performance Expectation

MS‐ESS1‐2: Develop and use a model to describe the role of gravity in the motions within galaxies and the solar system.

Content Statement

E08.02: Gravity is the force that keeps most objects in the solar system in regular and predictable motion. Those motions explain such phenomena as the day, the year, phases of the moon, and eclipses.

Organization of Science Content

9

Comparing the Practices Dimension

NGSSScientific & Engineering Practices

NAEP Science & TELPractices

1. Asking questions (science) and defining problems (engineering)

2. Developing and using models3. Planning and carrying out investigations4. Analyzing and interpreting data5. Using mathematics and computational

thinking6. Constructing explanations (science) and

designing solutions (engineering)7. Engaging in argument from evidence8. Obtaining, evaluating, and communicating

information

NAEP Science1. Identifying science principles2. Using science principles3. Using scientific inquiry4. Using technological design

NAEP TEL1. Understanding technological principles2. Developing solutions and achieving

goals3. Communicating and collaborating

10

1. Science: How similar (or different) are the NGSS performance expectations in physical sciences, life sciences, and Earth and space sciences to the content and practices in the NAEP science framework at the corresponding grade levels?

2. TEL: How similar (or different) are the NGSS performance expectations in engineering, technology, and applications of scienceto the content and practices in the NAEP technology and engineering literacy framework at the corresponding grade levels?

3. Mathematics: To what extent are the mathematics-related NGSS performance expectations and practices aligned with the content and skills specified in the NAEP mathematics framework, and at which grade (s)?

Research Questions

11

1. Content mapping (AIR research team)• Grouped relevant portions of the NGSS performance expectations (PEs) with

NAEP science and TEL framework objectives that covered related content at the corresponding grade level

• Identified non-grouped NGSS PEs and NAEP objectives

2. Expert panel review and ratings (7 members)• Content similarity

• Grade level alignment (science only)

• Practices alignment

3. Aggregation & Analysis (quantitative and qualitative)

Methods – Science & TEL

Content Mapping Example (Physical Sciences)

13

NGSS NAEPHS-PS2-4Use mathematical representations of Newton’s Law of Gravitation and Coulomb’s Law to describe and predict the gravitational and electrostatic forces between objects.

P12.22Gravitation is a universal attractive force that each mass exerts on any other mass. The strength of the gravitational force between two masses is proportional to the masses and inversely proportional to the square of the distance between them. ---P12.23Electric force is a universal force that exists between any two charged objects. Opposite charges attract while like charges repel. The strength of the electric force is proportional to the magnitudes of the charges and inversely proportional to the square of the distance between them. Between any two charged particles, the electric force is vastly greater than the gravitational force.

Example Non-Grouped Science Objectives

14

NGSS NAEP4-LS1-2Use a model to describe that animals receive different types of information through their senses, process the information in their brain, and respond to the information in different ways

None

None E08.07The atmosphere is a mixture of nitrogen, oxygen, and trace gases that include water vapor. The atmosphere has a different physical and chemical composition at different elevations.

• Content Similarity - Each NGSS/NAEP grouping of objectives at the corresponding grade was reviewed and compared for similarity of content using a 4-point scale.

4 = Exactly or almost the same3 = Quite similar, but with some differences2 = Quite dissimilar, but with some overlap1 = Substantially or wholly different

• Grade Level Alignment (science only) - Panelists identified alternative objectives at other grade levels that covered similar content.

• Practices Alignment – Each NGSS performance expectation was rated for alignment with a NAEP practice (primary/secondary)

Expert Panel Ratings

Example NGSS/NAEP Science RatingsDCI NGSS

PerformanceExpectation

NAEPContent

Statement

Content Rating

(1, 2, 3, 4)

NAEP Science

PracticesEnergy MS-PS3-1

Construct and interpret graphical displays of data to describe the relationships of kinetic energy to the mass of an object and to the speed of an object.

P8.8Objects and substances in motion have kinetic energy

2 ISP

USP

USI

UTD

ISP Identifying Science PrinciplesUSP Using Science PrinciplesUSI Using Scientific InquiryUTD Using Technological Design

• Content Overlap – NGSS and NAEP objectives judged as covering related content at the corresponding grade level (final groupings determined by expert panel)

• Content Alignment – NGSS and NAEP objectives rated as “similar” (two-thirds or more of panelists assigned a rating of 3 or 4)

• Practices Alignment – NGSS performance expectations whose associated practices were aligned to a NAEP practice (most frequently identified by panelists as the “primary” practice)

Results

Science Comparison Results

18

Content Overlap of NGSS Performance Expectations and NAEP Science Content Statements

19

64%

84% 84%

29%

74%

88%

0%

20%

40%

60%

80%

100%

Grade 4 Middle School High School

NGSS NAEP

(14) (43) (67) (49)(33) (55)

Alignment by Content AreaNGSS Performance Expectations Aligned to NAEP Science

20

36%

47% 46%

29%

42% 42%50% 48%

54%

40%

53%

42%

0%

20%

40%

60%

80%

100%


OverallPhysical SciencesLife SciencesEarth & Space Sciences

Examples of Similar Content in Science

21


Forms of energy

Structures & functions in organisms

Effects of weathering & erosion

Human use of natural resources

Evidence of chemical reactions

Particulate nature of matter

Organs & organ systems

Interactions in ecosystems

Natural selection

Model of the solar system

Lithospheric plate movement

Patterns in the periodic table

Nuclear fission & fusion

Gravitational & electric forces

Role of DNA

Energy flow through trophic levels

Natural selection & evolution

Big Bang theory

Plate tectonics

Content & Grade Level AlignmentNGSS Performance Expectations Aligned to NAEP Science

22

6%

36%47%

46%

21% 9%

0

0.2

0.4

0.6

0.8

1

Grade 4 Middle School High SchoolLower Grade Corresponding Grade Higher Grade

Content & Grade Level AlignmentNAEP Science Content Statements Aligned to the NGSS

23

47%3%

23%

56%71%

12%16%

0%

20%

40%

60%

80%

100%

Grade 4 Grade 8 Grade 12Lower Grade Corresponding Grade Higher Grade

Content Emphasized at Different Grades

24

NAEP NGSS

Basic properties of light & soundDaily patterns in movement of Sun and moonMagnetic propertiesLife cycles of organismsProperties & changes in states of matterForce of Earth’s gravity

Relationship between energy and speedPeriodic tableCell differentiationEarth’s layers and magnetic field

Kinetic energy relationship to mass and speedFormula for electric forceGenetic variation and effects of mutationExothermic and endothermic reactions

Grade 4

Grade 8

Grade 12

Grade 1Grade 1Grade 3Grade 3Grade 5Grade 5

Grade 4High SchoolHigh SchoolHigh School

Middle SchoolMiddle SchoolMiddle SchoolMiddle School

Examples of Unique Content in Science

25

NAEP NGSS

Grade 4: Descriptions of relative motion

Grade 8: Properties of acids & bases

Grade 12: Different types of particle motion (translation, rotation & vibration)

Grade 4: Knowledge of the senses

Middle School: Role of brain processing

High School: Chemical reaction rates and equilibrium

Across Grades: Waves and their application in technologies for information transfer

26

NGSS PE Rating Summary Statement

MS-LS4-6: Use mathematical representations to support explanations of how natural selection may lead to increases and decreases of specific traits in populations over time.

Similar Both NGSS and NAEP include natural selection at grade 8. Both frameworks address the effects of natural selection on traits within a population.

L08.11Using Science Principles

MS-LS3-1: Develop and use a model to describe why structural changes to genes (mutations) located on chromosomes may affect proteins and may result in harmful, beneficial, or neutral effects to the structure and function of the organism.

NGSSOnly

Only NGSS includes the possible effects of genetic mutation in middle school. The concept of genetic mutation is included at grade 12 in NAEP (L12.09).

Using Science Principles

Example Science Comparisons

NGSS Performance Expectations Aligned with NAEP Science Practices

27

4%

7%

3%

60%

57%

55%

64%

22%

21%

27%

18%

13%

21%

11%

13%

0% 20% 40% 60% 80% 100%

Overall

Grade 4

Middle School

High School

Identifying Science Principles Using Science PrinciplesUsing Scientific Inquiry Using Technological Design

NAEP Framework Targets:20 – 30% Identifying Science Principles30 – 40% Using Science Principles30% Using Scientific Inquiry10% Using Technological Design

TEL Comparisons

28

TEL aims to measure whether students are able to apply their technology and engineering knowledge and skills to real-life situations. TEL is computer-based and uses interactive scenario-

based tasks to gauge what students know and can do National administration (8th grade) in 2014 Introduction to TEL:

https://nces.ed.gov/nationsreportcard/tel/

TEL – Technology and Engineering Literacy Assessment

29

Content Areas:Design & SystemsTechnology & SocietyInformation & Communication Technology (ICT)

Practices:Understanding technological principlesDeveloping solutions and achieving goalsCommunicating and collaborating

TEL – Content Areas and Practices

30

Students know that: D.8.2: Technology advances through the processes of innovation and invention. Sometimes a technology developed for one purpose is adapted to serve other purposes.

Students are able to:D.8.4: Simulate tests of various materials to determine which would be best to use for a given application.

TEL – Assessment Targets

31

ETS1: Engineering Design

ETS2: Links Among Engineering, Technology, Science, and Society

Performance expectations in: Engineering Design Sciences with connections to ETS

NGSS – Performance ExpectationsEngineering, Technology, and Applications of Science (ETS)

32

TEL Content Mapping Example (Engineering Design)

33

NGSS NAEP TEL FrameworkMS-ETS1-1Develop a model to generate data for iterative testing and modification of a proposed object, tool, or process such that an optimal design can be achieved.

ETS1.B: Developing possible solutionsETS1.C: Optimizing the design solution

D.8.5Redesign an existing tool to make it easier to accomplish a task.---D.8.9Construct and test a model and gather data to see if it meets the requirements of a problem.---D.8.18Modify a moderately complicated system so that it is less likely to fail. Predict the extent to which these modifications will affect the productivity of the system.

Design & Systems: Nature of Technology / Engineering Design / Maintenance and Troubleshooting

Example NGSS/NAEP TEL Ratings – Similar (ETS)NGSS


NAEPAssessment

Target(s)

Content Rating

(similar, not similar, NGSS only)MS-ETS1-2: Evaluate competing design solutions using a systematic process to determine how well they meet the criteria and constraints of the problem.

ETS1.B: Developing possible solutions

D.08.07D.08.08D.08.09

Similar -Both include designing, constructing, testing, and defining models in the design process.

NAEP TEL Practice: Developing solutions and achieving goals

Example NGSS/NAEP TEL Ratings – Not Similar (ETS)NGSS


NAEPAssessment

Target(s)

Content Rating

(similar, not similar, NGSS only)MS-ETS1-3: Analyze data from tests to determine similarities and differences among several design solutions to identify the best characteristics of each that can be combined into a new solution to better meet the criteria for success.

ETS1.B: Developing possible solutionsETS1.C: Optimizing the design solution

D.08.04D.08.06D.08.09

Not similar -Although both include generating multiple solutions and evaluating solutions, NAEP does not include identifying the best characteristics and combining them into a new solution.

NAEP TEL Practice: Developing solutions and achieving goals

Example NGSS/NAEP TEL Ratings – Similar (Science 1)NGSS

Performance ExpectationNAEP

Objective(s)Content Rating

(similar, not similar, NGSS only)

MS-PS3-3: Apply scientific principles to design, construct, and test a device that either minimizes or maximizes thermal energy transfer.

ETS1.A: Defining and delimiting an engineering problemETS1.B: Developing possible solutions

PS3.A: Definitions of energyPS3.B: Conservation of energy and energy transfer

TEL:D.08.06 D.08.08 D.08.09

Science:P08.10

Similar -Both include designing, constructing, testing, and defining models in the design process. Items/tasks in NAEP TEL would provide the necessary physical science concepts.NAEP TEL Practice: Developing solutions and achieving goals

Similar – NAEP science includes thermal energy transfer at grade 8.

NAEP Science Practice: Using technological design

Example NGSS/NAEP TEL Ratings – Similar (Science 2)NGSS




MS-LS2-5: Evaluate competing design solutions for maintaining biodiversity and ecosystem services.

ETS1.B: Developing possible solutionsETS2.B: Influence of science, engineering, and technology on society and the natural world

LS2.C: Ecosystem dynamics, functioning, and resilience

TEL:D.08.06D.08.08T.08.07

Science:L08.08

Similar -Both include generating and evaluating multiple solutions and considering the impact of humans and technology on the environment. Items/tasks in NAEP TEL would provide the necessary life science concepts.NAEP TEL Practice: Developing solutions and achieving goals

Not similar – NAEP science does not have a focus on maintaining biodiversity at grade 8.

Example NGSS/NAEP TEL Ratings – Not Similar (Science)NGSS




MS-PS1-3: Gather and make sense of information to describe that synthetic materials come from natural resources and impact society.

ETS2.A: Interdependence of science, engineering, and technologyETS2.B: Influence ofengineering, technology and science on society and the natural world

PS1.A: Structure and properties of materialsPS1.B: Chemical reactions

TEL:T.08.03

Science:None

Not similar -NGSS focuses on the impact of synthetic materials produced from natural resources. TEL more broadly includes positive and negative impacts on society from the introduction of new or improved technology.

NAEP TEL Practice: Understanding technological principles

The production and impact of synthetic materials is not explicitly included in NAEP science.

Example NGSS/NAEP TEL Ratings – NGSS onlyNGSS




MS-LS1-1: Conduct an investigation to provide evidence that living things are made of cells; either one cell or many different numbers and types of cells

ETS2.A: Interdependence of science, engineering, and technology

LS1.A: Structure and function

TEL:None

Science:L08.01

NGSS only -Requires the use of specific technology to provide scientific evidence and is not included in the NAEP TEL framework.

Similar – NAEP science includes the cellular makeup of organisms at grade 8.

NAEP science practice: Using scientific inquiry

NGSS Performance Expectations in ETS Aligned with NAEP TEL Assessment Targets

Number and Percent Aligned with TEL

Grades 3-5 Middle School High School

TotalNumber Aligned

TotalNumber Aligned

TotalNumber Aligned

Engineering Design 3 3 4 3 4 3

Science(with connections to ETS) 4 3 11 5 16 6

Total 7 6

(86%)

15 8

(53%)

20 9

(45%)

NGSS Performance Expectations in ETS Aligned with NAEP TEL Assessment Targets

86%

53%45%

100%

75% 75%75%

45%38%

0%

20%

40%

60%

80%

100%

Grade 4 (3-5) Middle School High SchoolTotal Engineering Design Science (ETS)

(3) (4)(7) (4) (11)(15) (4) (16)(20)

NAEP TEL Assessment Targets Aligned with NGSS Performance Expectations

Number and Percent Aligned with NGSS

Grade 4 Grade 8 Grade 12

Total Number Aligned

TotalNumber Aligned

TotalNumber Aligned

Design and Systems 19 6 19 6 19 5

Technology and Society 15 0 15 2 15 5

Information and Communication Technology 13 0 13 0 13 3

Total 47 6

(13%)

47 8

(17%)

47 13

(28%)

NAEP TEL Assessment Targets Aligned with NGSS Performance Expectations

13% 17%28%32% 32%

26%

0%

13%

33%

0% 0%

28%

0%

20%

40%

60%

80%

100%

Grade 4 Grade 8 Grade 12Total Design & Systems Technology & Society ICT

NGSS Performance Expectations Aligned with NAEP TEL Practices

44

14%

20%

5%

12%

86%

60%

55%

62%

15%

7%

0% 20% 40% 60% 80% 100%

Grade 4(3-5)

Middle School

High School

Overall

Understanding Technological PrinciplesDeveloping Solutions & Achieving GoalsCommunicating & Collaborating

30%

30%40% NAEP TEL Targets

There was strong alignment between NGSS and NAEP TEL in the area of engineering design • Defining design criteria and constraints

• Generating and comparing multiple design solutions

• Developing and testing models to optimize design solutions

There was also some alignment on “effects of technology on society and the natural world”

Results - Similarities

45

• NAEP TEL is not aligned with NGSS performance expectations in ETS that require the application of specific science concepts

• NAEP TEL covers a much broader range of content than what is included in the ETS performance expectations in NGSS.

• Design & Systems:Nature of technology; systems thinking; maintenance & troubleshooting

• Technology & SocietyInteraction of technology & humans; effects of technology on the world of information & knowledge; ethics, equity, and responsibility

• Information & Communications Technology (ICT)

Results - Differences

46

Mathematics Comparisons

47

To what extent are the mathematics-relatedNGSS performance expectations and practices aligned with the content and skills specified in the NAEP mathematics framework, and at which grade(s)?

Research Question

48

Dimensions of the NGSS and NAEP Mathematics Framework

49

NGSS NAEP MathematicsDisciplinary Core Ideas (DCIs)

(Content Domains)

Scientific & Engineering Practices

Crosscutting Concepts

Content Areas

Mathematical Complexity

NGSSScientific & Engineering Practices

NAEP MathematicsContent Strands

1. Asking questions and defining problems

2. Developing and using models3. Planning and carrying out

investigations4. Analyzing and interpreting data5. Using mathematics and

computational thinking6. Constructing explanations and

designing solutions 7. Engaging in argument from

evidence8. Obtaining, evaluating, and

communicating information

Number Properties and Operations

Measurement

Geometry

Data Analysis, Statistics, and Probability

Algebra

Comparison of NGSS and NAEP Frameworks - Practices Dimension -

NGSS Crosscutting Concept:Scale, proportion and quantity

Mathematics Methodology

51

Method

52

Used the same three stages as Science and TEL however, the approach and procedures were different

• Standard Mapping

• Expert panel review and ratings

• Aggregation & Analysis (quantitative and qualitative)

AIR’s NAEP mathematics experts presented initial mappings between the NGSS mathematics-related performance expectations and the NAEP mathematics framework objectives and levels of mathematical complexity to the Science and TEL Expert Panel.

Step I

53

ExampleNGSS NAEP Mathematics Cognitive

DimensionPerformance Expectation (PE)

Content Area – Data, Statistics and Probability

Levels of Complexity

ESS2-1Represent data in tables and graphical displays to describe typical weather conditions expected during a particular season.

Subtopics:

Data Representation including specific types of graphical displays by grade level

Characteristics of Data Sets

Mathematical Reasoning with Data

Low

Moderate

High

54

Step IIThe Science and TEL Expert Panel proposed using the NGSS “Common Core State Standards Connections” for Mathematics as a starting point.

AIR ‘s NAEP Validity Studies Panel had conducted a framework comparison between the CCSS Mathematics and the NAEP Mathematics Framework so AIR’s mathematics experts investigated using the results as a potential link between NGSS and NAEP.

“A Study of the Alignment Between the NAEP Mathematics Framework and the Common Core State Standards for Mathematics (CCSS-M).” available at air.org.

55

Mathematics Comparison Procedure

• AIR prepared an initial mapping document (NGSS – CCSSM – NAEP) for NGSS performance expectations that have a mathematics related practice

• Expert Panel (3 NAEP experts; 1 NGSS expert)

• NGSS Performance Expectations

(NGSS)

• Common Core State Standards in Mathematics

(NVS report)• NAEP

Mathematics Framework

Content Mapping Example

57

NGSS CCSSM NAEP8-PS3-1

Construct and interpret graphical displays of data to describe the relationships of kinetic energy to the mass of an object and to the speed of an object.

[PE notes include examples of riding bicycle at different speeds or rolling different sized rocks downhill]

8-EE.A.2

Standard Description: Use square roots and cube root symbols to represent solutions to equations of the form x2 = p and x3 = p, when p is a positive rational number.

Evaluate square roots of perfect squares and cube roots of small perfect cubes. Know that square root of 2 is irrational.

Mathematical Practice: Reason abstractly and quantitatively

8-NOP-2a

Establish or apply benchmarks for rational numbers and common irrational numbers in contexts.

8 –Alg-3cPerform basic operations, using appropriate tools, on linear algebraic expressions including grouping and order of multiple operations involving basic operations, exponents, roots, simplifying and expanding.

• Reviewed each NGSS performance expectation to determine the mathematics content and skill that might be involved in items that could be developed to assess it

• Determined by consensus if the mathematics identified was included in NAEP- this involved removing or adding NAEP objectives to the initial groupings

• Considered adjacent grade levels in NAEP

• Identified some additional performance expectations that did not have CCSSM connections specified

Expert Panel Procedure

58

Mathematics Results

59

Results

60

Most NGSS performance expectations involving mathematics-related practices were aligned to the NAEP framework.

At grades 4 and 8, some portion of the mathematics involved was aligned with NAEP objectives at the next higher grade.

• Grade 4: Percentages & rates; geometrical models; large time scales; physical attributes (area, volume, weight/mass)

• Grade 8: Non-linear relationships; rate of change; working with multiple variables; mathematical reasoning with data.

NGSS Performance Expectations Aligned with NAEP Mathematics Objectives Across Grades

NGSS Grade Level

NAEP Grade LevelGrade 4 Only

Grades 4 & 8

Grade 8 Only

Grades 8 & 12

Grade 12 Only

Grade 4 8% 92%Middle School 60% 27%High School 14% 83%

8%

92%

60%

27%14%

83%

0%20%40%60%80%

100%


Practice: Analyze and interpret data to make sense of phenomena, using logical reasoning, mathematics, and/or computation. Performance Expectation: Analyze and interpret data from

maps to describe patterns of Earth’s features (4-ESS2-2) Aligned with: Grade 4 Number and Algebra objectives

• Related to graphing/ interpreting points on a grid and solving real world problems involving numbers.

Example of ES PE-Aligned with the NAEP Fourth Grade Objectives

62

Practice: Develop and/or use models to describe and/or predict phenomena. Performance Expectation: Develop a model to describe

that light reflecting from objects and entering the eye allows objects to be seen (4-PS4-2) Aligned with: Grade 4 and 8 Geometry objectives

• Grade 4: Properties of paths between points, drawing angles, and identifying images resulting from reflections, translations, and rotations.

• Grade 8: Describing the effect of reflection

Example of ES PE-Aligned with the NAEP Fourth and Eighth Grade Objectives

63

Practice: Analyze and interpret data to provide evidence for phenomena Performance Expectation: Analyze and interpret data to

provide evidence for the effects of resource availability on organisms and populations of organisms in an ecosystem.(MS-LS2-1) Grade 8: Number, Measurement, Algebra, and Data Grade 12: Algebra and Data objectives

• quadratic or exponential relationships, bivariate data

Example of MS PE-Aligned with the NAEP Eighth and Twelfth Grade Objectives

64

Practice: Apply concepts of statistics and probability (including determining function fits to data, slope, intercept, and correlation coefficient for linear fits) to scientific and engineering questions and problems, using digital tools when feasible. Performance Expectation: Apply concepts of statistics and

probability to explain the variation and distribution of expressed traits in a population.(HS-LS3-3) Aligned with Grade 12: Number, Geometry, Algebra, and Data

objectives• geometric models, probability, reasoning with data, functions

Example of HS PE-Aligned with the NAEP Twelfth Grade Objectives

65

66

NGSS Practice NAEP Objectives

Summary Statement

Apply scientific reasoning, theory, and/or models to link evidence to assess the extent to which reasoning and data support the explanation or conclusion

Grade 12: Number, Measurement, Algebra, Data

NGSS includes applying scientific reasoning and evidence from ancient Earth materials, meteorites, and other planetary surfaces to construct an account of Earth’s formation and early history. (HS-ESS1-6)

This is aligned with NAEP grade 12 objectives related to operating with many different kinds of numbers; measuring physical quantities involved in developing various models and assigning meaningful units to the measured values; using scale models; representing data in tables, charts, graphs, and spreadsheets appropriately and effectively; using statistical parameters to understand data sets; fitting a trend line on the data; reasoning with data; recognizing pattern in the data including progressions (arithmetic and geometric); modeling relationship observed in the data as functions (linear, quadratic, exponential, trigonometric); and solving equations or inequalities.

Example Mathematics Summary Table

Summary and Implications

67

How much of the NGSS are covered by NAEP science and TEL?

68

Content Overlap with NAEP Science and TEL Frameworks(Percentage of NGSS PEs in each grade band)

69

56%

92% 90%

0%

20%

40%

60%

80%

100%

Grades 3-5 Middle School High School

(59)(45) (71)

All Content Domains

36% 41% 44%2% 3%

11%10% 13%

0%

20%

40%

60%

80%

100%

Grades 3-5 Middle School High SchoolAligned to science Only Aligned to both science & TELAligned to TEL Only

56%

Content Alignment with NAEP Science and TEL Frameworks(Percentage of NGSS PEs in each grade band)

70

49% 54%

All Content Domains

About half of the NGSS performance expectations in the sciences and engineering design were aligned with the NAEP science or TEL framework at the corresponding grade (upper elementary, middle school, and high school). Assessments based on the NGSS and NAEP assessments

would be aligned to some degree, but each would also have unique content and different emphases in terms of science and TEL practices. Alignment of NGSS-based assessments with NAEP science

assessments would likely be moderate at the middle and high school levels and lower at grade 4.

Summary and Implications

71

The NGSS emphasize some content at different grades than the NAEP science framework. While NAEP may include similar content, assessment items may differ in terms of reading load, depth/breadth, and cognitive load at the different grade levels. The content and practices embodied in NGSS performance

expectations involving engineering design are not fully covered by either the NAEP science or NAEP TEL framework. Both NAEP science and TEL assessments include interactive

computer tasks (as well as hands-on tasks in science) that provide for a deeper measure of students’ understanding of science and engineering principles and their ability to fully engage in the practices.

Summary and Implications (cont.)

72

Tasks developed to assess the NGSS may require some mathematics that is beyond the corresponding grade in the NAEP mathematics framework. This suggests that NGSS-based assessments may differ from NAEP science and TEL assessments in terms of the mathematics and quantitative skills required.

Summary and Implications (cont.)

73

This is a framework comparison. Assessment item comparisons that build on the results of this study can provide more complete information on the alignment between the NGSS and NAEP science, TEL, and mathematics.

Final Note

74

Teresa [email protected]

1000 Thomas Jefferson Street NWWashington, DC 20007General Information: 202-403-5000TTY: 887-334-3499www.air.org

75

comparing naep and the next generation science standards

Documents