What Actually Needs AI in This System (and What Doesn't)

A practical guide to which parts of the CMS Agent's process are exact, rule-based, and free — and which genuinely require AI, and why that distinction matters for cost and reliability.

3 min read By Platform Documentation Guide #Architecture #Publishing

Not every step in an AI pipeline needs AI

It's easy to assume that a system built around AI-assisted writing runs an AI model at every step. It doesn't, and the difference isn't an accident — it's a deliberate design choice that saves real money and makes the whole thing more predictable.

The test: transformation versus judgment

If a step's job is to take information that's already known — already fetched, already decided, already on record — and reshape it into a required format, that's a mechanical task. A fixed set of rules can do it exactly, every time, with no guessing. If a step's job is to understand language, weigh evidence, or produce something genuinely new, no fixed rule can cover every case — that's where a model earns its cost.

A real example: reading a client's rules

One step in the writing pipeline used to work like this: fetch a client's technical publishing rules, then ask an AI model to read them and restate them in the shape the next step needed. That AI call cost real money on every single run, despite doing purely mechanical work — the information was already fully known; nothing needed to be interpreted or invented. It was rebuilt as a direct, rule-based mapping instead. Same output shape, same accuracy — now it costs nothing, on every real run since.

Other places where the answer is already known

The same pattern shows up elsewhere. Checking a draft against a site's own publishing rules, confirming an uploaded image actually exists, checking a tag against the approved list, confirming a page really went live: none of these are judgement calls. Each is an exact yes-or-no check against something the system already has on record, and none of them spend a model call.

The split also runs through tasks that mix the two. When a page draft is checked in a browser, a model proposes the fix, but a deterministic tool applies it, so the model never edits the page directly. And many image edits, such as crops, resizes, captions and logos, are exact operations with no model cost at all.

Where AI is genuinely doing the work

Research that has to judge whether a source is trustworthy, and admit when it can't find enough. Writing original prose that reads naturally. Judging whether a piece's tone lands the way it's meant to. Simulating how an unfamiliar reader would react to a draft. Grading one piece of writing against a quality standard. None of these reduce to a fixed rule, because the input is different every time and the right answer depends on understanding it, not just checking it.

What this means when you're asking for something

A structural or technical request — fixing a title, adjusting a category, re-checking a page against its site's rules, confirming something actually published — moves through the cheap, exact, near-instant path. A request that needs real writing, persuasion, or judgment about the content itself goes through the AI path, and that costs more. That's not a flaw to route around; it's the cost of doing something a fixed rule genuinely can't.

Related reading

Back to Library