X @Avi Chawla
Avi Chawla·2026-02-18 06:30
DeepSeek fixed one of AI's oldest problems.(using a 60-year-old algorithm)Here's the story:When deep learning took off around 2012-2013, researchers hit a wall. They couldn't just stack layers endlessly because gradients either exploded or vanished.So training deep networks was nearly impossible.ResNets solved this in 2016 with residual connections:output = input + what the layer learnedThat "+" creates a direct highway for information. This is why we can now train networks with hundreds of layers.Recently, ...