• Formalization of learning
  • VC dimension
  • Bias – Variance tradeoff