Clinical Trials

7. Statistics

Statistics play a very important role in any clinical trial from design, conduct, analysis, and reporting in terms of controlling for and minimizing biases, confounding factors, and measuring random errors. The statistician generates the randomization code, calculates the sample size, estimates the treatment effect, and makes statistical inferences, so an appreciation of statistical methods is fundamental to understanding randomized trial methods and results. Statistical analyses deal with random error by providing an estimate of how likely the measured treatment effect reflects the true effect (Wang et al., 2006). Two statistical approaches are often used for clinical data analysis: hypothesis testing and statistical estimate.

Hypothesis Testing
Statistical Estimate

Alpha (Type I) and Beta (Type II) Errors

When testing a hypothesis, two types of errors can occur. To explain these two types of errors, we will use the example of a randomized, double-blind, placebo-controlled clinical trial on a cholesterol-lowering drug ‘A’ in middle-aged men and women considered to be at high risk for a heart attack. The primary endpoint is the reduction in the total cholesterol level at 6 months from randomization.

Table 1. Alpha (Type I) and Beta (Type II) Errors

Statistical Decision True State of the Null Hypothesis
H0 True H0 False
Reject H0 Type I error Correct
Do not Reject H0 Correct Type II error

The null hypothesis is that there is no difference in mean cholesterol reduction level at 6 months postdose between patients receiving drug A (μ1) and patients receiving placebo (μ2) (H0: μ1 = μ2); the alternative hypothesis is that there is a difference (Ha: μ1 ≠ μ2). If the null hypothesis is rejected when it is in fact true, then a Type I error (or false-positive result) occurs. For example, a Type I error is made if the trial result suggests that drug A reduced cholesterol levels when in fact there is no difference between drug A and placebo. The chosen probability of committing a Type I error is known as the significance level. As discussed above, the level of significance is denoted by α. In practice, α represents the consumer’s risk, which is often chosen to be 5% (1 in 20).

On the other hand, if the null hypothesis is not rejected when it is actually false, then a Type II error (or false-negative result) occurs. For example, a Type II error is made if the trial result suggests that there is no difference between drug A and placebo in lowering the cholesterol level when in fact drug A does reduce the total cholesterol. The probability of committing a Type II error, denoted by β, is sometimes referred to as the manufacturer’s risk (Chow & Liu, 1998). The power of the test is given by 1 – β, representing the probability of correctly rejecting the null hypothesis when it is in fact false. It relates to detecting a pre-specified difference.

Relationship Between Significant Testing and Confidence Interval

When comparing, for example, two treatments, the purpose of significance testing is to assess the evidence for a difference in some outcome between the two groups, while the CI provides a range of values around the estimated treatment effect within which the unknown population parameter is expected to be with a given level of confidence.

There is a close relationship between the results of significance testing and CIs. This can be illustrated using the previously described cholesterol reduction trial. If H0: μ1 = μ2 is rejected at the α% significance level, the corresponding (1 – α)% CI for the estimated difference (μ1 - μ2) will not include 0. On the other hand, if H0: : μ1 = μ2 is not rejected at the α% significance level, then (1 – α)% CI will include 0.

Kirkwood B, Sterne J. (2003). Essential medical statistics, 2nd edition. Oxford: Blackwell Publishing.
Altman DG. (1999) Practical Statistics for medical research. London: Chapman and Hall.
Wang D & Bakhai A, editors. (2006) Clinical Trials: A Practical Guide to Design, Analysis and Reporting. London : Remedica.
Chow SC , Liu JP. (1998). Design and analysis of clinical trials: Concept and methodologies. Chichester : John Wiley & Sons.