The Value of Statistical Analysis Plans in Observational Research

Jama.jamanetwork: August 22/29, 2012

The increasing availability of electronic health data combined with federal investment has stimulated an expansion in observational clinical research.Observational studies can complement clinical trials and provide important information about comparative safety and effectiveness in populations not well studied in clinical trials. However, there are numerous examples in which the findings from observational studies have failed to be replicated.These failures may be due to several factors, including the exploratory nature of observational questions, failure to fully account for treatment selection bias, known publication biases, and the tendency to pursue post hoc hypotheses. This later problem, termed data dredging, is facilitated by the lack of fidelity to a prespecified hypothesis and inadequate reporting of the actual analytic process. Read more