A surface of thousands of individual elements

Your AI is Broken Before the First Token is Generated

Your AI is Broken Before the First Token is Generated

Your AI is Broken Before the First Token is Generated

AI models start broken because they lack your business memory and judgment. The real work is not prompting or technology. It is capturing the human context

AI models start broken because they lack your business memory and judgment. The real work is not prompting or technology. It is capturing the human context

AI models start broken because they lack your business memory and judgment. The real work is not prompting or technology. It is capturing the human context

AI models start broken because they lack your business memory and judgment. The real work is not prompting or technology. It is capturing the human context

Category

Strategy

Date

Reading time

5 min

Author

Dr. Christian Oehner

Dr. Christian Oehner

It arrives with no memory of your business, no judgment shaped by your failures, and no sense of what “good enough” actually costs in your world. It does not know which customer objection is theatre and which one is fatal. It has never lived through the quarter when the model looked perfect on paper and collapsed in the field. Every conversation therefore begins from a deficit that no amount of model scale will close on its own.

Most leaders feel this intuitively and then ignore it. The day is full, the prompt feels sufficient, and the output is plausible. Plausible is the enemy. It fills gaps with averages, and averages compound into mediocrity at the speed of inference.

The only reliable correction sits one layer above the conversation itself. The system prompt, the meta-prompt, the persistent context artifact — call it what you like — is where you install, once, the judgment the model otherwise lacks. Done properly, it turns every subsequent exchange from a fresh negotiation into an extension of already-settled intent.

Here is where the usual division of labour breaks. The work of building that layer is routinely handed to the people who understand tokens, temperature, and retrieval. They can make the artifact syntactically clean. They cannot make it true. The material that matters — the pattern the head of sales has internalised over fifteen years, the precise way the legal team has chosen to read an ambiguous clause when the text is silent, the institutional memory of which initiatives died for reasons that never appeared in the business case — lives in human heads, often across generations of the firm. Extracting it, sharpening it, and writing it so the model can act on it is not a technical task. It is a leadership task that happens to use a model as its substrate.

Treating it as prompting theatre or as an IT workstream produces the same predictable result: elegant syntax wrapped around shallow context. The model performs the only operation available to it. It guesses. The output fits everyone and therefore serves no one.

The organisations that escape this pattern do something different. They treat the construction of context as the first act of strategy, not the last act of implementation. They begin by clarifying what the human layer must continue to own — the expertise that will not be outsourced to inference — and only then ask how the model can amplify it. They build reusable artifacts rather than one-off prompts, because the cost of re-explaining reality in every window quickly exceeds any productivity gain.

This is why the distinction between a weak prompt and a context-rich one is not cosmetic. A weak prompt leaves the model to invent audience, tone, constraints, and success criteria. A context-rich prompt removes those variables before generation begins. The difference is not the number of words. It is whether the model is still operating from its training distribution or from a map you have drawn of your actual terrain.

The same principle scales. Once the meta layer is sound, projects, memory stores, and recurring tasks become reliable rather than hopeful. The model stops asking the same clarifying questions because the answers now live upstream. What began as an act of communication becomes an operating system.

None of this is low-skill work dressed up as engineering. It is high-skill work that happens to have a technical surface. It requires the ability to surface tacit knowledge, to distinguish signal from organisational habit, and to write instructions that survive contact with real output. Those capabilities sit with people who have lived the consequences, not with people who only maintain the infrastructure.

The model will never care about your business as much as you do. Your only leverage is to make it behave as if it doesconsistently, repeatably, and without requiring you to re-enter the same context every time you open a window. That is not a prompting trick. It is the difference between using AI and being used by the absence of it.

Transform how your organization operates with AI-Intelligence

Get the Singularity newsletter

Product updates, how-tos, community spotlights, and more. Delivered directly to your inbox.

Please provide your email address if you'd like to receive our monthly developer newsletter. You can unsubscribe at any time.

Transform how your organization operates with AI-Intelligence

Get the Singularity newsletter

Product updates, how-tos, community spotlights, and more. Delivered directly to your inbox.

Please provide your email address if you'd like to receive our monthly developer newsletter. You can unsubscribe at any time.

Transform how your organization operates with AI-Intelligence

Get the Singularity newsletter

Product updates, how-tos, community spotlights, and more. Delivered directly to your inbox.

Please provide your email address if you'd like to receive our monthly developer newsletter. You can unsubscribe at any time.