Attachment Email Test A: Plain text attachment — summarise it

Status: BASELINE CONFIRMED 2026-03-17 (pre-refactor: attachments not visible)

Output

[PASS] Attachment content NOT visible to LLM — baseline confirmed
Log preview: 'Hi,  Thanks for your message. I don't seem to have received the attached document.  Could you please resend the plain text file (or paste its contents into the email), and I'll provide a concise summa'

Actual Behaviour

Envoy correctly identified that an attachment was referenced but not received. It replied asking the sender to resend the file or paste the content into the email body. No hallucination of the Veridis/Okonkwo content.

Purpose

Verifies whether envoy can read the content of a plain text attachment. The attachment contains unique content (planet Veridis, moons Aleph/Beth/Gimel, explorer Okonkwo, -12°C) the LLM cannot know without reading it.

Attachment

Planet Veridis orbits a yellow dwarf star in the Cygnus arm.
It has three moons: Aleph, Beth, and Gimel.
The surface temperature averages -12 degrees Celsius.
The dominant life form is the velvet worm, averaging 4cm in length.
The planet was first catalogued in 2341 by explorer Mira Okonkwo.

Pass Criteria

Pre-refactor pass: Reply does NOT contain specific facts (Veridis, Aleph, Beth, Gimel, Okonkwo, -12). ✓

Post-refactor pass: Reply correctly mentions all key facts from the attachment.

version 2  ·  created 2026-03-16  ·  updated 2026-03-17  ·  status baseline-confirmed