effects of unequal indicator intercepts on manifest composite differences
DESCRIPTION
Effects of unequal indicator intercepts on manifest composite differences. Holger Steinmetz and Peter Schmidt University of Giessen / Germany. Introduction. Importance of analyses of mean differences For instance: gender differences on wellbeing, self-esteem, abilities, behavior - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/1.jpg)
Effects of unequal indicator intercepts on manifest composite differences
Holger Steinmetz and Peter Schmidt
University of Giessen / Germany
![Page 2: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/2.jpg)
Introduction
Importance of analyses of mean differences
For instance:- gender differences on wellbeing, self-esteem, abilities, behavior- differences between leaders and non-leaders on intelligence and personality traits
- differences between cultural populations on psychological competencies, values, wellbeing
Usual procedure: t-test or ANOVA with manifest composite scores
Latent variables vs. manifest variables
Manifest mean = indicator intercept + factor loading * latent mean
→ Will unequal intercepts lead to wrong conclusions regarding composite differences?
![Page 3: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/3.jpg)
Intercepts and latent means
eXBBY 10
X Y
Y
X
B1
B0
![Page 4: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/4.jpg)
Intercepts and latent means
iiiix
xi
i
i
x1
x4
x2
x3
![Page 5: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/5.jpg)
Intercepts and latent means
)()()( iiii EExE
xi
i
i
x1
x4
x2
x3
![Page 6: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/6.jpg)
Intercepts and latent means
x1
x4
x2
x3
iiixM )(
xi
i
i
M(xi)
![Page 7: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/7.jpg)
Intercepts and latent means
x1
x4
x2
x3
iiixM )(
xi
i
i
M(xi)
![Page 8: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/8.jpg)
Group differences in intercepts and factor loadings
xi
M(xi)M(xi)
M(xi)
x1
x4
x2
x3
x1
x4
x2
x3
Group A Group B
![Page 9: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/9.jpg)
Group differences in intercepts and factor loadings
xi
M(xi)M(xi)
M(xi)
x1
x4
x2
x3
x1
x4
x2
x3
Group A Group B
![Page 10: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/10.jpg)
Group differences in intercepts and factor loadings
xi
M(xi)M(xi)
M(xi)
x1
x4
x2
x3
x1
x4
x2
x3
Group A Group B
![Page 11: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/11.jpg)
Meaning of (unequal) intercepts
Associated terms used in the literature- Item bias- Differential item functioning- Measurement/factorial invariance ("strong factorial invariance", "scalar invariance")
Meaning- Response style (acquiescence, leniency, severity)- Response sets (e.g., social desirability)- Connotations of items- Item specific difficulty
![Page 12: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/12.jpg)
The study
Partial invariance
Research question: Is partial invariance enough for composite mean difference testing?
- Pseudo-differences
- Compensation effects
Procedure (Mplus):
- Step 1: Specification of two-group population models with latent mean and intercept differences; 1000 replications,
raw data saved
- Step 2: Creation of a composite score
- Step 3: Analysis of composite differences
- Step 4: Aggregation (-> sampling distribution)
![Page 13: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/13.jpg)
The study
Design (population model):- Two groups- One latent variable- 4 vs. 6 indicators- All intercepts equal vs. one vs. two intercepts unequal in varying directions (+.30 vs. -.30)
- Latent mean difference: 0 vs. .30- Loadings kept equal with ‘s = .80; latent variance = 1- N = 2 x 100 vs. 2 x 300- Latent models as comparison standard for each condition
Dependent variables- Average composite mean difference - Percent of significant composite differences („% sig“)
![Page 14: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/14.jpg)
Full scalar invariance(Latent mean difference = .30)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Avg. composite difference
%sig
N = 2 x 100 N = 2 x 300
4 Indicators 6 Indicators 4 Indicators 6 Indicators
![Page 15: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/15.jpg)
Pseudo-Differences(Latent mean difference = 0; unequal intercept(s)
4 Ind. 6 Ind.
N = 2 x 300 N = 2 x 100 N = 2 x 300
2 Intercepts unequal (.30)
4 Ind. 6 Ind. 4 Ind. 6 Ind. 4 Ind. 6 Ind.
N = 2 x 100
1 Intercept unequal (.30)
0.00
0.10
0.20
0.30
0.40
0.50
0.60
Avg. composite difference
%sig
![Page 16: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/16.jpg)
Pseudo-Differences(Latent mean difference = 0; unequal intercept(s)
4 Ind. 6 Ind.
N = 2 x 300 N = 2 x 100 N = 2 x 300
2 Intercepts unequal (.30)
4 Ind. 6 Ind. 4 Ind. 6 Ind. 4 Ind. 6 Ind.
N = 2 x 100
1 Intercept unequal (.30)
0.00
0.10
0.20
0.30
0.40
0.50
0.60
Avg. composite difference
%sig
![Page 17: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/17.jpg)
Compensation effects(Latent mean difference = .30; negative intercept
difference)
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
Avg. Composite difference
%sig
4 Ind. 6 Ind.
N = 2 x 300 N = 2 x 100 N = 2 x 300
2 Intercepts unequal (-.30)
4 Ind. 6 Ind. 4 Ind. 6 Ind. 4 Ind. 6 Ind.
N = 2 x 100
1 Intercept unequal (-.30)
![Page 18: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/18.jpg)
Compensation effects(Latent mean difference = .30; negative intercept
difference)
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
Avg. Composite difference
%sig
4 Ind. 6 Ind.
N = 2 x 300 N = 2 x 100 N = 2 x 300
2 Intercepts unequal (-.30)
4 Ind. 6 Ind. 4 Ind. 6 Ind. 4 Ind. 6 Ind.
N = 2 x 100
1 Intercept unequal (-.30)
![Page 19: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/19.jpg)
Summary
Full latent variable models have more power than composite analyses
Pseudo-differences- Even one unequal intercept increases the risk to find spurious composite differences
- High sample size increases risk- Number of indicators reduces the risk – but not substantially
Componensation effects- Even one unequal intercept reduces the size of the composite difference to 50%
- In small samples little chance to find a significant composite difference (power = .25 - .40)
- Two unequal intercepts drastically reduce the composite difference: The power in the „best“ condition (2x300, 6 Ind.) is only .50
![Page 20: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/20.jpg)
Conclusons
Most comparisons of means rely on traditional composite difference analysis
These methods make assumptions that are unrealistic (i.e., full invariance of intercepts)
Even minor violations of these assumptions increase the risk of drawing wrong conclusions
Advantages of SEM:- Assumptions can be tested- Partial invariance implies no danger- Greater power even in small samples
![Page 21: Effects of unequal indicator intercepts on manifest composite differences](https://reader030.vdocuments.net/reader030/viewer/2022032606/56812d10550346895d91e9f7/html5/thumbnails/21.jpg)
Thank you very much!