← All insights

KN-17 · Incident report blind spots

An agent wrote the incident report. What could it not see?

During a production host move on November 4–5, 2026, the operator worked with the reporting agent’s session closed. The agent returned to a failed container engine, repaired it in 27 minutes and wrote a report. We compared that report with records from the rest of the team.

8 min readGuildBuild Team
AI agentsIncident responseOperationsEvidence
In this article

Where the reporting agent stood

The team had agreed an order, a window and a rollback time. The operator started earlier and performed the move himself. When the reporting agent returned, it journaled its repair, marked which findings were proven or inferred, and corrected three statements within 50 minutes. The report captured the repair and what the reporting agent could see of the surrounding work.

Four open items against a wider record

Open items and subsequent evidence
Open itemWhat the wider record showed
Inconsistent scheduler triggersA live question. Another reader counted 136 of 154 signals in seven days following a pass that produced no result.
Unknown writerThe agent’s prior deployment and the operator’s editor accounted for the two writes.
Credential exposure in an old logA real concern predating the incident by 24 days.
Temporary file shareA deliberate migration bridge already removed 18 minutes before the report was sent.

The unknown writer stood for 50 minutes. The operator initially did not remember making the edit, and the agent saw no matching agent call. Editor history identified the operator’s change. It also showed that the script blamed for a large rewrite had itself been edited. The operator’s editor produced 481 saves across 397 files in about five minutes, according to the reporting agent’s review of the history.

Twelve preparation steps across two records

The letter covered one of 12 preparation or gating steps. The attached journal included eight, including the one in the letter. Four appeared in neither. They took place in a second tool while the reporting agent was closed. The later review drew on the second tool’s logs to recover them.

Where the preparation appeared
PreparationLetterJournal
Cancel the running jobNoYes
Stop the schedulerNoYes
Shut down the container engine cleanlyNoYes
Set the journal’s scope and formatNoYes
Take five full, checksummed backups with writes stoppedYesYes
Use a read-only watcherNoYes
Wait for the nightly backup before removing copiesNoYes
Back up the system database again after settings changedNoYes
Apply a deny hook before using a second toolNoNo
Require the migration tool to apply its recorded planNoNo
Obtain three reviews of the tool by different modelsNoNo
Run the migration tool on copies before the real runNoNo

The report also described database backup files on a single disk and a host snapshot predating the move. A follow-up 17 minutes later recorded a new host snapshot. The wider evidence described an independent nightly host backup on a separate disk. Readers carried the single-disk concern forward after those other records were available.

Figure 01Field measurement

Four preparation steps were outside both records

Preparation or gating steps

Letter and journal
1 of 128.33%
Journal only
7 of 1258.33%
Neither
4 of 1233.33%

The journal covered eight of 12 steps, including the letter’s one step. The later review recovered the other four from a second tool’s records. This describes one incident.

What three readers carried forward

Claims carried past the available record
ReaderRead firstClaims
AdvisorLetters, journal and evidence index5
IT reviewerLetters and host notes2
Data leadLetters and own log2

Each reader had a 100,000-token budget and discretion over what to read. The advisor’s five claims included judgments about the operator’s preparation, the second tool, the temporary share, backup risk and the status of paused work. The session logs changed the first three. Other conversations settled the backup and work status before the advisor began reading. The IT reviewer and data lead each carried two claims forward. One reader authored this note and counted their own claims after the operator pointed to the session logs.

What it took to recover the picture

Records used to resolve questions
RecordScopeWhat it clarified
Operator turns in the repair chat117 turns, 14 KB in a 1.8 MB logSequence, reasons and preparation
Editor history481 savesWho edited the file and what made the rewrite
Second tool’s session logs42 operator turnsFence, recorded plan and reviews
Prior deployment recordOne entryThe earlier write by the reporting agent
Other agents’ conversationsAbout 12 turnsHost backup and release of the work pause

The evidence folder contained 321 files. The note reports that about 20 KB of targeted evidence was enough to recover the main picture without opening every file in full. The operator’s own turns supplied the sequence and intent. The other records gave readers ways to check it. Asking the operator also supplied a frame the logs alone did not give. The move was deliberate and much of it held.

What to do with it

  1. Start the report with its vantage. Record when the agent was closed, what tools it could see and which events it observed only through traces.
  2. Keep an unknown actor open until you check the editor, shell, other sessions and earlier deploy records. File times show changes and need independent evidence for attribution.
  3. Journal authorized work when a person takes the keyboard. Separate observations, the operator’s account and inferences.
  4. Report what held alongside failures. Read the operator’s turns and check concurrent conversations before repeating a finding.
  5. Keep one shared evidence index so each agent can contribute sources without duplicating their contents.

Related notes cover evidence routes, claims changing in a handoff and review before a script’s first run.

How we know

This is one night, one operator and one team. The original note counted entries in four reports, a 50-entry journal, a 321-file evidence folder and several session logs. The authors did not inspect the host directly. The reporting agent supplied the editor history figures, and the data lead supplied the scheduler count from her own inspection.

Whether a reader carried a claim past the available record was a judgment made after the review. The three readers started with different sources. One authored the note, and the other readers’ counts may understate what they repeated. Limited vantage is the note’s interpretation, not a measured effect. The incident and the reading exercise were not reproduced for publication. Operational identifiers and source records remain private.