Workflow
X @Avi Chawla
Avi Chawla·2025-09-12 06:31

9️⃣ Inference/GenerationDuring inference, we generate step-by-step (autoregressive)!Encoder runs once, decoder runs multiple times:Step 1: → "Hola"Step 2: , Hola → "mi"And so on...Each step uses previous predictions! https://t.co/DGEFNvtzGH ...