To recap, instead of producing independent chunk embeddings, contextualized chunk embedding models like voyage-context-3 process the entire doc in a single pass to embed each chunk.This leads to document-aware chunk embeddings that generate semantically aware retrieval in RAG.Check the visual below 👇Thanks to the #MongoDB team for working with me on this thread! ...

Despite tuning and balancing tradeoffs, the final chunk embeddings are generated independently with no interaction with each other.This isn't true with real-world docs, which have long-range dependencies.Check this 👇 https://t.co/3pydkHDNCN ...