How do we scale up the context of LLMs?
Agentic search scales to arbitrarily large amounts of info, but can easily miss relevant info.
Idea💡: Optimize organization of info for downstream utility. Leads to 30+% gains even on OOD domains
Paper + code: https://t.co/Xk3XYn3QAc
LLMs deployed in specialized domains, from enterprise codebases to law firms, dig through a mountain of unstructured context!
Our new paper, Librarian Agents, asks: can an agent adapt by curating its own long-context workspace, anticipating queries before they arrive? 🧵⬇️