Principal Component Analysis

• Reading for class 2
• Linear algebra topics you should be familiar with before class 2 (16 September):
  • matrix multiplication
  • that matrix multiplication of a vector by a matrix is a transformation from one coordinate system to another (we will review this in class)
  • linear combinations (we will review this in class)
  • the dot product of 2 vectors, and that they are related by the cosine of the angle between them
• Optimization theory you should be familiar with before class 2 (16 September):
  • how an optimization problem is written
  • the Lagrange multiplier principle for solving simple, equality constrained optimization problems