S8E01 The True Crimes of Null Hypothesis Significance Testing

S8E01_graphic

In this first episode of Season 8, Greg and Patrick decide it is deeply unfair that the podcast has not grown popular enough for them to buy their own Quantitude jet. They thus decide to make it a true crime podcast and dedicate the episode to revisiting the crimes and punishment of Null Hypothesis Significance Testing. They plagiarize other true crime podcasts to delve into the case and determine if justice was served.

Related Episodes

  • S4E16: Discovering the False Discovery Rate
  • S4E13: Model-Based Power Analysis: The Power of *What*
  • S3E07: In Defense of Researcher Degrees of Freedom
  • S2E11: The Replication…Dilemma with Samantha Anderson
  • S2E10: Type I Terror
  • S1E02: (Statistical) Power Struggles

Recommended Readings

Anderson, S. F. (2020). Misinterpreting p: The discrepancy between p values and the probability the null hypothesis is true, the influence of multiple testing, and implications for the replication crisis. Psychological Methods25, 596-609.

Anderson, S. F., & Maxwell, S. E. (2017). Addressing the “replication crisis”: Using original studies to design replication studies with appropriate statistical power. Multivariate Behavioral Research52, 305-324.

Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997–1003.

Hagen, R. L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15–24.

Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151–159.

Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834.

Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241–301.

Rozeboom, W. W. (1960). The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57, 416–428.

Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115–129.

 

Scroll to Top