In this lecture we will cover prediction and optimal estimation/prediction and what quantities can be estimated or predicted.
Readings: Christensen Chapter 2, Appendex C
In this lecture we derive predictive distributions and will talk about optimal prediction and estimation using squared error loss or quadratic loss. We will extend estimation to the case where $X$ is not full rank and talk about what quantities can still be estimated uniquely from the data, a concept related to identifiability.