X @Avi Chawla

RT Avi Chawla (@_avichawla)You're in an ML Engineer interview at Netflix.The interviewer asks:"You’ve trained a new recommendation model.How do you make sure it’s ready to replace the old one?"You reply: "I’ll compare metrics on validation and test sets."Interview over.Here’s what you missed:The issue is that, despite rigorously testing an ML model locally (on validation and test sets), it could be a terrible idea to instantly replace the previous model with the new model.This is because it is difficult to ...