EPN 2019

Ronald L Thomas

Ronald L Thomas, Speaker at Ronald L Thomas: Speaker for Pediatrics Conference
Wayne State University School of Medicine, United States
Title : The danger of relying on the interpretation of p-values in single studies: Irreproducibility of results from clinical studies

Abstract:

P-values are a common component and outcome measure in most every published observational or randomized clinical trial. However, many physicians, researchers, journalists, and policy makers have little or no training in statistics and are forced to rely on the interpretation of results based solely on the authors or secondary sources. Statistical analysis of data often involves the calculation and reporting of the p-value as statistically significant or not, without much further thought. But p-values are highly un-replicable and their definition is not directly associated with reproducibility. Findings from clinical studies are not valid if they cannot be reproduced. Although other methodological issues relate to reproducibility the p-value is arguably at the root of the problem. Many common misinterpretations and misuses of the p-value are practiced. The American Statistical Association (ASA) recently published its first ever policy statement concerning their proper use and interpretation of p-values for scientists and researchers. This policy statement addresses the misguided practice of interpreting study results based solely on the p-value, given that it is often irreproducible in subsequent, similar studies. We investigated the irreproducibility of the p-value by using simulation software and results reported from a published randomized control trial. We show that the probability of attaining another statistically significant p-value varied quite widely on replication. We also show that power alone determines the distribution of p, and will vary with sample size and effect size. In conclusion, p-values interpreted solely by themselves, can be misleading potentially leading to biased inferences from clinical studies.

Biography:

Dr. Ronald Thomas, Ph.D. holds a Doctorate in Theoretical Evaluation and Research. He has been the lead statistician since 1997 with the Children’s Research Center of Michigan (CRCM), within the Department of Pediatrics at Wayne State School of Medicine. He is charged with assisting and training others in becoming more proficient in scientific inquiry, research strategies, evaluation and appraisal of studies, models and designs, and statistical analyses. He has had continual funding on governmental, state, and foundation grants since 1997. He has published over 170 peer-reviewed publications in the areas of pediatrics, including perinatal and pediatric pharmacology and infant health.

Watsapp