X @Avi Chawla
Avi Chawla·2026-04-05 06:44

A Python decorator is all you need to trace LLM apps (open-source).Most LLM evals treat the app like an end-to-end black box.But LLM apps need component-level evals and tracing since the issue can be anywhere inside the box, like the retriever, tool call, or the LLM itself.In DeepEval, you can do that with just 3 lines of code:- Trace individual LLM components (tools, retrievers, generators) with the "@ observe" decorator.- Attach different metrics to each part.- Get a visual breakdown of what’s working and ...

X @Avi Chawla - Reportify