Hierarchical Bayesian Models

You want to evaluate 20 traders with varying track record lengths. Two obvious approaches, both wrong:

Complete pooling: treat everyone as identical. Ignores real differences.

No pooling: estimate each independently. The trader with 15 trades gets an estimate driven entirely by noise.

Hierarchical models take the middle path, and it is not a compromise so much as the correct answer.

Partial pooling

Assume individual parameters are drawn from a common distribution:

A hierarchical model
θiBeta(α,β),yiBinomial(ni,θi)\theta_i \sim \text{Beta}(\alpha, \beta), \qquad y_i \sim \text{Binomial}(n_i, \theta_i)

Each unit gets its own parameter and those parameters share a distribution. That sharing is the borrowing of strength.

Traders differ (each has their own θi\theta_i) and are related (all drawn from a shared population). The hyperparameters α,β\alpha, \beta describe the population and are themselves estimated from the data.

The rest of this lesson is for subscribers

Unlock every lesson in Advanced Topics in Probability and Statistics, and every other premium course.

Subscribe to continue

Test your knowledge

Questions are only available to subscribers.

Keep reading Advanced Topics in Probability and Statistics

35 lessons in this course, and every other premium course, on one subscription.

  • Every lesson in every course, with the worked examples and interactive simulators
  • Graded questions on every lesson, with explanations for the wrong answers as well as the right one
  • The trainers, timed assessments and brainteaser library that go with them