Llama 3
Search documents
Meta's Biggest AI Mistake Which Killed Their Pipeline
Alex Kantrowitz· 2026-07-09 21:40
When we were playing Llama 3 together, we had really pulled in all the research and unwittingly kind of killed the pipeline. So researchers, you know, the way that it works is you build a a base and you've got people pioneering an incremental version of the base and you got people out there pathf finding entirely new strategies. When it came time for Llama 4, we didn't have any of the pathf finding the other labs still had going.So that makes you now now you're behind on reasoning. Uh now you're behind on m ...