https://dudusoar.github.io/tags/llm-systems/Recent content in LLM Systems on Yuchen DuHugo -- 0.164.0en-usFri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/01-five-layer-llm-system/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/01-five-layer-llm-system/Why an LLM decision system needs five separable layers rather than one increasingly large prompt.https://dudusoar.github.io/posts/llm-system-architecture/02-offline-memory-online-action/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/02-offline-memory-online-action/A clean LLM architecture separates the production of reusable experience from its read-only use during online decisions.https://dudusoar.github.io/posts/llm-system-architecture/03-schema-design-facts-and-judgment/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/03-schema-design-facts-and-judgment/A schema preserves the boundary between computed facts, model judgments, explicit rationale, and external feedback.https://dudusoar.github.io/posts/llm-system-architecture/04-environments-and-task-distributions/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/04-environments-and-task-distributions/Reliable evaluation separates plausible executable environments from meaningful LLM task distributions.https://dudusoar.github.io/posts/llm-system-architecture/05-prompt-as-decision-interface/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/05-prompt-as-decision-interface/A prompt follows the order of an actual decision and keeps facts, memory, tools, actions, and runtime logic in separate layers.https://dudusoar.github.io/posts/llm-system-architecture/06-tools-as-read-only-evidence-interfaces/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/06-tools-as-read-only-evidence-interfaces/Evidence tools expose structured facts and deterministic calculations without making decisions on the model's behalf.https://dudusoar.github.io/posts/llm-system-architecture/07-action-space-as-design-anchor/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/07-action-space-as-design-anchor/Define what an LLM is allowed to change before designing its schemas, prompts, tools, workflows, and memory.https://dudusoar.github.io/posts/llm-system-architecture/08-fact-ownership-and-provenance/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/08-fact-ownership-and-provenance/Every fact, interpretation, proposal, and outcome in an LLM system needs a clear owner and a traceable evidence lineage.https://dudusoar.github.io/posts/llm-system-architecture/09-share-only-stable-meaning/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/09-share-only-stable-meaning/Share code across LLM methods only when its meaning, lifecycle, failure handling, and tests remain unchanged.https://dudusoar.github.io/posts/llm-system-architecture/10-shared-information-boundary/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/10-shared-information-boundary/Fair online comparison requires every method to decide from the same semantic snapshot and the same boundary on future information.https://dudusoar.github.io/posts/llm-system-architecture/11-observable-and-executable-training-targets/Fri, 17 Jul 2026 00:00:00 +0000https://dudusoar.github.io/posts/llm-system-architecture/11-observable-and-executable-training-targets/A strong teacher result is a valid target only when the model can observe its basis and execute the same action.