• Formalization of learning
  • VC dimension
  • PAC theory
  • Bias – Variance tradeoff