Product Work Needs an Operating System, Not a Prompt Library

· 5 min read

The thing I keep coming back to with AI product work is that prompts are probably the easiest part.

That was not obvious to me at first. A good prompt can feel like the whole system. You give an agent a clear job, add some context, and get something useful back. Maybe it writes the spec. Maybe it builds the feature. Maybe it catches the thing everyone else missed.

That feels pretty great.

Then you try to do it again.

Now there are three features moving at once. One agent is working from an old decision. Another finished something that no one actually approved. The useful context is split between a chat, a spec, and whatever somebody remembers from the last conversation.

It gets messy fast.

I think this is where a product operating system starts to matter. The prompt tells an agent what to do right now. The operating system tells the work where to go.

Where does an idea enter? What has to be true before development starts? Which document is current? When does a human need to make the call? What does done mean?

Those questions sound basic. They are also where a lot of AI-assisted work goes sideways.

For the systems I have been building, I keep landing on a few pieces:

  1. A defined path from idea to shipped work.
  2. A small set of documents that everyone agrees are current.
  3. Clear points where an agent can keep moving and where a person has to approve the direction.
  4. A record of decisions so the next session does not have to figure them out again.

None of that is especially flashy. Honestly, it can look like a pile of Markdown files and some rules about where things belong.

But that context matters.

Without it, the human becomes the operating system. We carry the state, remember the decisions, notice when two outputs conflict, and explain the same architecture again tomorrow. That works for a while. It probably does not work when the number of agents, products, or decisions starts growing.

The system should carry more of that weight.

I also think it has to stay portable. Models are changing too quickly to build the process around one of them. The same is true for IDEs and agent tools. Plain-text artifacts are boring, but they survive. A spec can move. A decision log can be searched. A workflow written in normal language can be adapted when the next tool shows up.

So I am less interested in building a giant prompt library than I used to be. Prompts still matter. I just do not think they solve the harder problem.

The harder problem is getting useful work to continue across people, agents, tools, and time without everyone becoming confused about what is happening.

That needs a system.

← All Thinking