Workflow
Boosting models
icon
Search documents
X @Avi Chawla
Avi Chawla· 2025-11-02 06:31
You're in an ML Engineer interview at Microsoft.The interviewer asks:"Why Boosting models primarily use Trees as the base learner?What's wrong with Linear regression or SVMs?"You: "Because linear models can’t fit non-linear data."Interview over.Here's what you missed:Texts describing boosting start with “weak learners” but then immediately pivot to trees.But this DOES NOT mean they can only work with trees.Consider a simple boosting algorithm:1) Train a tree model.2) Calculate the left-over residual.3) Trai ...