PCA and Dimensionality Reduction

"You run PCA on two years of daily returns for 100 stocks. What is the first component, and how many of the components are real?" A complete answer turns the components into portfolios, explains why the later ones are unstable, and compares each eigenvalue with the noise level that is left once the market is removed.

What the basics lesson covers

The principal component analysis lesson covers the method step by step, the choice between covariance and correlation, the market component of an equity panel and the Marchenko-Pastur noise range. In short, PCA is the eigen-decomposition Σ=VΛV⊤\Sigma = V \Lambda V^\top of the covariance or correlation matrix. For NN independent assets over TT periods, with q=N/Tq = N / T, the sample correlation eigenvalues fill the range from (1−q)2(1 - \sqrt{q})^2 to (1+q)2(1 + \sqrt{q})^2.

The rest of this lesson is for subscribers

Unlock every lesson in Machine Learning for Quantitative Research, and every other premium course.

Subscribe to continue

Test your knowledge

Questions are only available to subscribers.

Keep reading Machine Learning for Quantitative Research

27 lessons in this course, and every other premium course, on one subscription.

  • Every lesson in every course, with the worked examples and interactive simulators
  • Graded questions on every lesson, with explanations for the wrong answers as well as the right one
  • The trainers, timed assessments and brainteaser library that go with them