Doorgaan naar hoofdcontent

examn, true or enabled

 

Perturbations on the uniform distribution of p-values can lead to misleading inferences from null-hypothesis testing

Pierrede Villemereuilb

Abstract

Null-hypothesis testing (NHT) based on statistical significance is the most conventional statistical framework, on which neuroscientists rely for the analysis of their data. However, this approach can provide misleading results if p-values are wrongly interpreted, as often done in practice. Misconceptions can arise, in particular, when i) wrong null-hypothesis is chosen for reference; ii) the assumptions of the statistical model are not met; iii) p-values are interpreted as the probability of the null- or alternative hypotheses or as the measure of the importance of findings; iv) statistical thresholds guide scientific conclusions and decision making; v) one applies multiple testing or p-hacking. In this commentary, we address these issues by bringing into the focus the uniform distribution of p-values with the hope of enhancing the appreciation and proper use of the NHT approach among neuroscientists. We propose guidelines for the correct interpretations of p-values that brain and behavioural scientists may adopt to improve both the transparency of statistical reports and the value of scientific conclusions drawn from them.

Keywords

p-values
Null-hypothesis testing
p-hacking
Statistics
View full text

  • Number line estimation under working memory load: Dissociations between working memory subsystems

    Trends in Neuroscience and Education, Volumes 8–9, 2017, pp. 1-9

  • The interplay between affective and cognitive factors in shaping early proficiency in mathematics

    Trends in Neuroscience and Education, Volumes 8–9, 2017, pp. 28-36
  • Populaire posts