X @Nick Szabo

RT Andrej Karpathy (@karpathy)LLM Knowledge BasesSomething I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating knowledge (stored as markdown and images). The latest LLMs are quite good at it. So:Data ingest:I index source documents (articles, papers, repos, datasets, images, etc.) into a raw/ directory, then I use an ...