Evaluate

How to evaluate deep learning model?
Evaluate - Troubleshooting

Summary

  • You want to apply the bias-variance decomposition concept here: Test error = irreducible error + bias + variance + validation overfitting.

  • If the training, validation, and test sets come from different data distributions, then you should use 2 validation sets: one set sampled from the training distribution, and the other set sampled from the test distribution.