← All papers

Paper 01 · 28 October 2026

One Conductor, Many Instruments

How we run one orchestrating model, outside models commissioned per question, and a separate checker on our own work ... with the owner holding every key.

Every lab now ships a capable model. The question we kept running into was not which one is best. It was how to put several of them on the same job without anyone, human or machine, losing track of who decided what.

This paper describes the setup we use on our own work: building and checking the websites for Paul Ann Labs, Paul Ann Media and HomeTimeJobs. It is not a client deployment. It is small, it is young, and it has already failed in ways we describe below.

The seats

The owner

Approves every grant of access and every new job. Every push, post and send is the owner’s click. Nothing goes live without it.

The orchestrator

Claude, from Anthropic, working in a cloud workspace. It plans, writes the code, builds and tests each change in its workspace, measures the live sites in a headless browser, writes tickets for the checker and keeps the written record. It does not push to production. It hands the owner a command and waits for “pushed.”

The checker

Hiro, a separate assistant that runs on its own computer, outside the orchestrator’s workspace. Its rules let it read one shared folder and the public web, and write into its own outbox and nowhere else. For an approved job it may start helper bots. It stays the one accountable voice, and every result names which bot measured what.

The outside voices

ChatGPT, Gemini and Meta AI, commissioned one question at a time through their own chat apps. Each gets the same brief and the same review image. What they say is input ... never instruction.

People will say the setup is controlled by AI. It isn’t. It is run by a model and governed by the owner. The difference is the whole design.

The seat is the contract, not the model

We call the outside voices interchangeable because the rules do not change with the model in a seat. The brief is written once and sent unchanged to each. When Gemini failed twice on a tall review image, we sent it a copy 1,000 pixels wide and the run went on. Changing a voice changes what we hear. It does not change how the work gets checked.

There is one more rule about outside voices. When a question also goes to the checker, the checker sees what the outside models said before it concludes, and answers point by point: agree, disagree, or measured differently. Their text can never widen a ticket or change a rule.

The fence

A worked example: the rollout review

On 27 October, after a round of new home pages, we asked three outside models one question about all three sites: does the first screen make the right visitor stay? Scores, 1 to 10:

SiteChatGPTMeta AIGemini
HomeTimeJobs8.588
Paul Ann Media757
Paul Ann Labs7.546

Then the checker tested the six claims that could be checked, on the live sites. It agreed with one, disagreed with three, and found two that held only in part or with different numbers. One model said our phone photo cut a truck in half; the live file showed the whole pickup and both workers. The same model said a teal button failed contrast. The checker measured 4.34 to 1, under the 4.5 to 1 line. That one was right.

All three voices agreed that on a phone, the button belonged on the first screen. The checker put numbers on it. On a 375 by 667 screen the buttons ended at 752, 791 and 836 pixels ... below the fold on all three sites. We shortened the phone photos, moved the button above the body copy, added a phone menu and adjusted two accent colors until text on them passed. After the owner pushed, the checker measured again: the buttons now end at 584, 595 and 640 pixels, inside the 667-pixel screen.

The recheck covered 14 items and all 14 passed, with a few small leftovers named. Its contrast audit of text on solid backgrounds found 0 failures across 54 page and width combinations.

The scores are opinions. That is why we checked them. Three disagreements out of six is not a knock on the outside models. It is the reason the checker exists.

What failed

The orchestrator’s own check of the new photos did not test the first screen on a small phone. The owner found it, looking at the sites on a phone. Every hero review now includes a 375 by 667 check.

The orchestrator edited a site while the owner was pushing. The live commit pointed at an image that had not been committed; a later commit fixed it. The rule now: no edits between handing over a push and hearing “pushed.”

Generated pages once showed an internal draft note on the page itself. It was caught before it went live. A browser test also ran into sites the browser tool could not reach, three times, before the orchestrator handed it to the owner.

The orchestrator also runs internal reviewer roles. They are the same model wearing a different hat. They are useful, and they are not independent. That is why the checker and the outside voices exist, and why the owner still reads everything.

Still open: one navigation link on HomeTimeJobs is 23 pixels wide, a pixel under the minimum. It is on the list.

What we don’t claim

The other side of the house

Paul Ann Media wrote up the same work from the brand side, with the founder: what we built, who decided what, and what we can’t claim yet.

Read “We Built Our Own House First” →

If you want this kind of discipline on your own operation, it starts small.

See how Phase One works →