Do we know what we test and do we test what we want to know?

I.G. Klugkist, F. Van Wesel, J. Bullens

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Null hypothesis testing (NHT) is the most commonly used tool in empirical psychological research even though it has several known
limitations. It is argued that since the hypotheses evaluated with NHT do not reflect the research-question or theory of the researchers,
conclusions from NHT must be formulated with great modesty, that is, they cannot be stated in a confirmative way. Since confirmation or
theory evaluation is, however, what researchers often aim for, we present an alternative approach that is based on the specification of
explicit, informative statistical hypotheses. The statistical approach for the evaluation of these hypotheses is a Bayesian model-selection
procedure. A non-technical explanation of the Bayesian approach is provided and it will be shown that results obtained with this method
give more direct answers to the questions asked and are easier to interpret. An additional advantage of the offered possibility to formulate
and evaluate informative hypotheses is that it stimulates researchers to more carefully think through and specify their expectations.
Original languageEnglish
Pages (from-to)550-560
Number of pages11
JournalInternational Journal of Behavioral Development
Volume35
DOIs
Publication statusPublished - 2011

Fingerprint

Dive into the research topics of 'Do we know what we test and do we test what we want to know?'. Together they form a unique fingerprint.

Cite this