This might be the next deepseek moment. A Chinese company just released another open-source model called Kimmy K2 and it is taking the industry by storm. The reason this graph right here, this is the training loss curve, and people are so surprised by how smooth it is.Typically, you get all of these spikes in here which cause issues that you need to correct. But for Kimmy, it was almost flawless. And the especially cool thing, it is based on a trillion tokens.That is a massive model. So they came up with th ...