Quiz 4

3. For the 256-dimensional digits, why were two features chosen?

To reduce model complexity and shrink the generalization error bar with the available training data:

Input dimension decreases from 256 to 2. VC dimension decreases from 257 to 3.

This helps ensure E in is approximately E out.