Separate Schemas, Prompts, Tools, Workflows, and Memory in an LLM System

Series: Building Auditable LLM Systems · Part 1 of 11 A small LLM prototype can often be built with one prompt. Put the current state, a few examples, the output format, and an instruction into a single block of text, then see whether the model returns a plausible answer. That is enough for a smoke test. It is not enough for a system that must be reproduced, audited, or trusted to affect an external process. ...

July 17, 2026 · 5 min · Yuchen Du

Treat LLM Evidence Tools as Read-Only Interfaces

Series: Building Auditable LLM Systems · Part 6 of 11 In an LLM–algorithm system, evidence tools form a read-only interface to environment state, algorithm outputs, and mechanism evidence. These tools retrieve information and perform deterministic computation. They do not generate natural-language conclusions, recommend actions, or execute state changes. The model combines structured evidence into an interpretation and a bounded proposal; a verifier and deterministic backend retain authority over legality and execution. ...

July 17, 2026 · 5 min · Yuchen Du