Autoregressive

Search documents
X @Avi Chawla
Avi Chawla· 2025-09-12 06:31
9️⃣ Inference/GenerationDuring inference, we generate step-by-step (autoregressive)!Encoder runs once, decoder runs multiple times:Step 1: <start> → "Hola"Step 2: <start>, Hola → "mi"And so on...Each step uses previous predictions! https://t.co/DGEFNvtzGH ...