ML I, Week 6: Homework Questions

  1. Explain the difference between true risk and empirical risk.
    Fill in the following table with "high", "medium", and "low":

    emp. risk true risk
    underfit    
    good fit    
    overfit    

  2. What is the tradeoff in chosing the split of the data into training and test set?
    How does cross-validation improve in this regard over the test set method?

due Monday, 2 Dec 2002