X @Avi Chawla
Avi Chawla·2025-09-12 06:31
9️⃣ Inference/GenerationDuring inference, we generate step-by-step (autoregressive)!Encoder runs once, decoder runs multiple times:Step 1:
9️⃣ Inference/GenerationDuring inference, we generate step-by-step (autoregressive)!Encoder runs once, decoder runs multiple times:Step 1: