Separate Offline Memory Extraction from Online Action Execution

Series: Building Auditable LLM Systems · Part 2 of 11 An LLM system that learns from historical experience and acts online has two different jobs: produce reusable experience from past evidence; use authorized experience to make a current decision. These jobs may reuse the same engineering layers, but they require different information permissions and prompt responsibilities. The clean boundary is simple: offline processing produces memory; online control consumes it read-only. Why Mixing Offline and Online Stages Is Dangerous When extraction and execution are mixed, experimental boundaries become difficult to defend. ...

July 17, 2026 · 4 min · Yuchen Du