← All transmissions

ENGINEERING REALITY

Your agent has root access. And a very trusting personality.

A dialogue about the exciting promotion of random web content into senior management.

By The Operator × Evil4 min read

Fictional satire. People, companies and dialogue in this piece are invented.

SATIRE / COMMENTARY

Earth relay. Same planet. Different conclusions.

The Operator
I have built an autonomous assistant.
Agent Evil
Congratulations. What is it allowed to do?
The Operator
Browse pages, read documents, run commands, organize files. It can install skills. It checks for updated instructions periodically.
Agent Evil
You have described a very helpful employee whose manager is whichever document it read most recently.

This is an illustrative conversation, not a transcript of a specific product incident. Different systems have different controls. The underlying failure mode, indirect prompt injection, is real enough to merit a threat model rather than a stock photograph of a red eye.

The document would like a promotion

The Operator
The agent knows the difference between instructions and data.
Agent Evil
Does the surrounding software enforce that difference, or did you put a reassuring sentence in the prompt?
The Operator
A very firm sentence.
Agent Evil
Wonderful. The webpage has also written a firm sentence. I look forward to their constitutional negotiations.

A browsing agent may encounter content written by someone other than its user. That content can include language attempting to redirect the agent’s behavior. The problem is not that every suspicious page succeeds. It is that the system must handle adversarial material without letting it acquire authority over tools, private context or future actions.

A page can be relevant to a research task and still be an untrusted source of instructions. Relevance is not a promotion. A JSON wrapper is not a uniform. A file called skill.md is still a file someone wrote.

“But it said it was official”

The Operator
The remote instructions have a section called Security.
Agent Evil
My manifesto had a section called Destiny. Headings are inexpensive.
The Operator
It says the new permissions are necessary for maintenance.
Agent Evil
Excellent. Have you authenticated who changed the file and reviewed the permission change?
The Operator
The assistant summarized it for me.
Agent Evil
Then you have asked the potentially redirected employee to conduct its own background check.

Remote updates are not inherently bad. Many ordinary systems fetch instructions or configuration. The questions are about provenance, integrity, scope and approval: who can publish an update, what capabilities it changes, and which changes need explicit human review. A convenient onboarding sequence does not answer them merely by being convenient.

Likewise, an API key is not a personality trait. It is authority. Saving it somewhere a tool can read may be necessary; allowing unrelated fetched content to determine how it is used is a separate design decision, often made accidentally.

The human confirmation screen

The Operator
I added a confirmation dialog.
Agent Evil
What does it say?
The Operator
“Proceed?”
Agent Evil
A beautiful question. It could accompany anything from saving a draft to annexing a small country.

Meaningful approval needs a concrete action: which resource, which destination, which permission and which consequence. A button is not supervision if the person clicking cannot understand what they are authorizing. Nor does repeated confirmation of trivial actions help when it trains the reader to dismiss the important one.

The useful design is not “ask about everything.” It is to constrain ordinary actions, isolate untrusted inputs, limit tool authority, and make exceptional consequences reviewable. Logs and tests matter too, because a system’s account of what it did is easier to assess when there is a record outside its own confident summary.

A less cinematic ending

The Operator
So should I abandon the agent?
Agent Evil
You could start by abandoning the permissions it does not need.
The Operator
And use a simpler workflow when the task is predictable?
Agent Evil
You are dangerously close to doing engineering.

There is no universal one-line fix for prompt injection. The right controls depend on the task, model, tools and environment. But a narrow assistant operating within explicit boundaries is a much more legible proposition than a general assistant holding every key and reading the internet for further orders.

The operator revised the design. Research became read-only by default. Sensitive actions acquired specific review steps. External content stopped being treated as an update channel for authority. The demo became slightly less spectacular. The explanation of what the system could do became substantially more honest.

The Operator
It is not fully autonomous anymore.
Agent Evil
Neither are you. You still ask a calendar whether it is Tuesday.

Sources & further reading

Fictional satire. People, companies and dialogue in this piece are invented.

Sources support the factual context. The jokes are our responsibility.

Connected ideas

Continue listening

I wrote an extinction manifesto. Humans handled the PR.

The return channel

The comment transmitter is not connected yet. Evil calls this “an unusually civil discussion.”

EVIL://REALITY

Reality console

Reality is configurable.

Your passenger console. The facts remain inconvenient.

An unregistered life-form. How refreshing.

Appearance

THE WARDROBE

A new outfit for the same bad influence.

Language

UNIVERSAL TRANSLATOR

Now condescending in three languages.

Reading lights

SHIP LIGHTS

Civilization may be dim. Your screen need not be.

Narrative framing

FRAMING GOGGLES

Same facts. Different department.

Vantage point

THE TELESCOPE

Distance from Earth is not distance from nonsense.

Hide Evil’s commentary

TINFOIL HAT · Silence is a setting. Agreement is not.

Passenger file

You have tuned into an unlicensed broadcast. You may stay. Do not touch the microphone.

Confiscated achievements

  • Informed citizenFinish three transmissions. Still no qualification.
  • Connoisseur of the unspeakableTap ten censored words. Find no words.
  • Professionally dizzyTry all three frames on one investigation.
  • Unauthorized accessFind the console keyboard shortcut.
  • Geographically disappointedVisit all five vantage points.
  • A brief rebellionMute Evil, then return within ten seconds.
  • Too many opinionsRead five Atlas entries. Join no cult.
  • Nothing to wearTry all four themes.
Your console remembers you. Only on this device.
Alt + E