Type I and Type II Errors

Every test can be wrong in two directions, and they are not symmetric in cost.

H0H_0 true H0H_0 false
Reject H0H_0 Type I error (α\alpha) Correct (1β1-\beta)
Fail to reject Correct Type II error (β\beta)
The two errors
α=P(reject H0H0 true)β=P(fail to reject H0H0 false)\alpha = P(\text{reject } H_0 \mid H_0 \text{ true}) \qquad \beta = P(\text{fail to reject } H_0 \mid H_0 \text{ false})

Alpha convicts the innocent, beta acquits the guilty, and at fixed n lowering one raises the other.

A Type I error is a false positive: concluding an edge exists when it does not. A Type II error is a false negative: missing a real edge.

Power is 1β1 - \beta, the probability of detecting an effect that is genuinely there.

The tradeoff

The rest of this lesson is for subscribers

Unlock every lesson in Fundamentals of Probability and Statistics, and every other premium course.

Subscribe to continue

Test your knowledge

Questions are only available to subscribers.

Keep reading Fundamentals of Probability and Statistics

41 lessons in this course, and every other premium course, on one subscription.

  • Every lesson in every course, with the worked examples and interactive simulators
  • Graded questions on every lesson, with explanations for the wrong answers as well as the right one
  • The trainers, timed assessments and brainteaser library that go with them