Tests of measurement invariance failed to support the application of the "then-test"

Nolte, Sandra, Elsworth, Gerald, Sinclair, Andrew and Osborne, Richard 2009, Tests of measurement invariance failed to support the application of the "then-test", Journal of clinical epidemiology, vol. 62, no. 11, pp. 1173-1180, doi: 10.1016/j.jclinepi.2009.01.021.

Attached Files
Name Description MIMEType Size Downloads

Title Tests of measurement invariance failed to support the application of the "then-test"
Author(s) Nolte, SandraORCID iD for Nolte, Sandra orcid.org/0000-0001-6185-9423
Elsworth, GeraldORCID iD for Elsworth, Gerald orcid.org/0000-0001-6306-7593
Sinclair, Andrew
Osborne, Richard
Journal name Journal of clinical epidemiology
Volume number 62
Issue number 11
Start page 1173
End page 1180
Total pages 8
Publisher Elsevier
Place of publication Amsterdam, The Netherlands
Publication date 2009-11
ISSN 0895-4356
Keyword(s) chronic disease
patient education
program evaluation
response shift
retrospective pre-test
statistical bias
Summary Objective
The use of then-test (retrospective pre-test) scores has frequently been proposed as a solution to potential confounding of change scores because of response shift, as it is assumed that then-test and post-test responses are provided from the same perspective. However, this assumption has not been formally tested using robust quantitative methods. The aim of this study was to compare the psychometric performance of then-test/post-test with traditional pre-test/post-test data and assessing whether the resulting data structures support the application of the then-test for evaluations of chronic disease self-management interventions.

Study Design and Setting
Pre-test, post-test, and then-test data were collected from 314 participants of self-management courses using the Health Education Impact Questionnaire (heiQ). The derived change scores (pre-test/post-test; then-test/post-test) were examined for their psychometric performance using tests of measurement invariance.

Few questionnaire items were noninvariant across pre-test/post-test, with four items identified and requiring removal to enable an unbiased comparison of factor means. In contrast, 12 items were identified and required removal in then-test/post-test data to avoid biased change score estimates.

Traditional pre-test/post-test data appear to be robust with little indication of response shift. In contrast, the weaker psychometric performance of then-test/post-test data suggests psychometric flaws that may be the result of implicit theory of change, social desirability, and recall bias.
Language eng
DOI 10.1016/j.jclinepi.2009.01.021
Field of Research 111707 Family Care
Socio Economic Objective 970111 Expanding Knowledge in the Medical and Health Sciences
HERDC Research category C1 Refereed article in a scholarly journal
Grant ID NHMRC 400391
HERDC collection year 2009
Copyright notice ©2009, Elsevier Inc.
Persistent URL http://hdl.handle.net/10536/DRO/DU:30019539

Document type: Journal Article
Collections: Faculty of Health
School of Exercise and Nutrition Sciences
Connect to link resolver
Unless expressly stated otherwise, the copyright for items in DRO is owned by the author, with all rights reserved.

Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 41 times in TR Web of Science
Scopus Citation Count Cited 39 times in Scopus
Google Scholar Search Google Scholar
Access Statistics: 1078 Abstract Views, 1 File Downloads  -  Detailed Statistics
Created: Wed, 16 Sep 2009, 15:07:54 EST by Sally Morrigan

Every reasonable effort has been made to ensure that permission has been obtained for items included in DRO. If you believe that your rights have been infringed by this repository, please contact drosupport@deakin.edu.au.