Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect

Jelte M. Wicherts; Conor V. Dolan; David J. Hessen; Paul Oosterveld; G. Caroline M. van Baal; Dorret I. Boomsma; Mark M. Span

doi:10.1016/j.intell.2004.07.002

Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect

Jelte M. Wicherts^*, Conor V. Dolan, David J. Hessen, Paul Oosterveld, G. Caroline M. van Baal, Dorret I. Boomsma, Mark M. Span

^*Corresponding author for this work

Chair Heijden

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

The gains of scores on standardized intelligence tests (i.e., Flynn effect) have been the subject of extensive debate concerning their nature, causes, and implications. The aim of the present study is to investigate whether five intelligence tests are measurement invariant with respect to cohort. Measurement invariance implies that gains over the years can be attributed to increases in the latent variables that the tests purport to measure. The studies reported contain original data of Dutch Wechsler Adult Intelligence Scale (WAIS) gains from 1967 to 1999, Dutch Differential Aptitude Test (DAT) gains from 1984 to 1995, gains on a Dutch children intelligence test (RAKIT) from 1982 to 1993, and reanalyses of results from Must, Must, and Raudik [ Intelligence 167 (2003) 1-11] and Teasdale and Owen [ Intelligence 28 (2000) 115-120]. The results of multigroup confirmatory factor analyses clearly indicate that measurement invariance with respect to cohorts is untenable. Uniform measurement bias is observed in some, but not all subtests. The implications of these findings are discussed.

Original language	English
Pages (from-to)	509-537
Number of pages	29
Journal	Intelligence
Volume	32
Issue number	5
DOIs	https://doi.org/10.1016/j.intell.2004.07.002
Publication status	Published - Sept 2004

Bibliographical note

Funding Information:
The preparation of this article was supported by a grant from the Netherlands Organization for Scientific Research (NWO). We thank Arne Evers and Jules Stinissen for providing valuable information on outdated standardization samples, and we express our appreciation for the valuable comments on previous drafts by Drs. Flynn, Widaman, and Jensen.

Funding

The preparation of this article was supported by a grant from the Netherlands Organization for Scientific Research (NWO). We thank Arne Evers and Jules Stinissen for providing valuable information on outdated standardization samples, and we express our appreciation for the valuable comments on previous drafts by Drs. Flynn, Widaman, and Jensen.

Keywords

Factorial invariance
Flynn effect
Intelligence tests

Access to Document

10.1016/j.intell.2004.07.002

Cite this

@article{cf7a42644e894fa0890c6657fe241f2e,

title = "Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect",

abstract = "The gains of scores on standardized intelligence tests (i.e., Flynn effect) have been the subject of extensive debate concerning their nature, causes, and implications. The aim of the present study is to investigate whether five intelligence tests are measurement invariant with respect to cohort. Measurement invariance implies that gains over the years can be attributed to increases in the latent variables that the tests purport to measure. The studies reported contain original data of Dutch Wechsler Adult Intelligence Scale (WAIS) gains from 1967 to 1999, Dutch Differential Aptitude Test (DAT) gains from 1984 to 1995, gains on a Dutch children intelligence test (RAKIT) from 1982 to 1993, and reanalyses of results from Must, Must, and Raudik [ Intelligence 167 (2003) 1-11] and Teasdale and Owen [ Intelligence 28 (2000) 115-120]. The results of multigroup confirmatory factor analyses clearly indicate that measurement invariance with respect to cohorts is untenable. Uniform measurement bias is observed in some, but not all subtests. The implications of these findings are discussed.",

keywords = "Factorial invariance, Flynn effect, Intelligence tests",

author = "Wicherts, {Jelte M.} and Dolan, {Conor V.} and Hessen, {David J.} and Paul Oosterveld and {van Baal}, {G. Caroline M.} and Boomsma, {Dorret I.} and Span, {Mark M.}",

note = "Funding Information: The preparation of this article was supported by a grant from the Netherlands Organization for Scientific Research (NWO). We thank Arne Evers and Jules Stinissen for providing valuable information on outdated standardization samples, and we express our appreciation for the valuable comments on previous drafts by Drs. Flynn, Widaman, and Jensen. ",

year = "2004",

month = sep,

doi = "10.1016/j.intell.2004.07.002",

language = "English",

volume = "32",

pages = "509--537",

journal = "Intelligence",

issn = "0160-2896",

publisher = "Elsevier Ltd",

number = "5",

}

TY - JOUR

T1 - Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect

AU - Wicherts, Jelte M.

AU - Dolan, Conor V.

AU - Hessen, David J.

AU - Oosterveld, Paul

AU - van Baal, G. Caroline M.

AU - Boomsma, Dorret I.

AU - Span, Mark M.

N1 - Funding Information: The preparation of this article was supported by a grant from the Netherlands Organization for Scientific Research (NWO). We thank Arne Evers and Jules Stinissen for providing valuable information on outdated standardization samples, and we express our appreciation for the valuable comments on previous drafts by Drs. Flynn, Widaman, and Jensen.

PY - 2004/9

Y1 - 2004/9

N2 - The gains of scores on standardized intelligence tests (i.e., Flynn effect) have been the subject of extensive debate concerning their nature, causes, and implications. The aim of the present study is to investigate whether five intelligence tests are measurement invariant with respect to cohort. Measurement invariance implies that gains over the years can be attributed to increases in the latent variables that the tests purport to measure. The studies reported contain original data of Dutch Wechsler Adult Intelligence Scale (WAIS) gains from 1967 to 1999, Dutch Differential Aptitude Test (DAT) gains from 1984 to 1995, gains on a Dutch children intelligence test (RAKIT) from 1982 to 1993, and reanalyses of results from Must, Must, and Raudik [ Intelligence 167 (2003) 1-11] and Teasdale and Owen [ Intelligence 28 (2000) 115-120]. The results of multigroup confirmatory factor analyses clearly indicate that measurement invariance with respect to cohorts is untenable. Uniform measurement bias is observed in some, but not all subtests. The implications of these findings are discussed.

AB - The gains of scores on standardized intelligence tests (i.e., Flynn effect) have been the subject of extensive debate concerning their nature, causes, and implications. The aim of the present study is to investigate whether five intelligence tests are measurement invariant with respect to cohort. Measurement invariance implies that gains over the years can be attributed to increases in the latent variables that the tests purport to measure. The studies reported contain original data of Dutch Wechsler Adult Intelligence Scale (WAIS) gains from 1967 to 1999, Dutch Differential Aptitude Test (DAT) gains from 1984 to 1995, gains on a Dutch children intelligence test (RAKIT) from 1982 to 1993, and reanalyses of results from Must, Must, and Raudik [ Intelligence 167 (2003) 1-11] and Teasdale and Owen [ Intelligence 28 (2000) 115-120]. The results of multigroup confirmatory factor analyses clearly indicate that measurement invariance with respect to cohorts is untenable. Uniform measurement bias is observed in some, but not all subtests. The implications of these findings are discussed.

KW - Factorial invariance

KW - Flynn effect

KW - Intelligence tests

UR - http://www.scopus.com/inward/record.url?scp=4444271803&partnerID=8YFLogxK

U2 - 10.1016/j.intell.2004.07.002

DO - 10.1016/j.intell.2004.07.002

M3 - Article

AN - SCOPUS:4444271803

SN - 0160-2896

VL - 32

SP - 509

EP - 537

JO - Intelligence

JF - Intelligence

IS - 5

ER -

Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this