AI-assisted OTP review: four controlled email variants
Run date: 2026-09-29
Real MailSlurp API; local HTTP demo application. MIME import, not SMTP delivery.
One assertion and one extraction evaluation per variant, without retries.
Synthetic messages only. Codes redacted and no longer usable.
Language recognition is not complete translation or grammar approval.
Model: BALANCED_V1 / gemini-3.6-flash; evaluator: message-testing-v2.

Criteria:
- brand-purpose: The email identifies Cedar Workshops and tells the reader how to sign in to their account.
- language: The message instructions are written in English (French for the French variant).
- expiry: The email explicitly tells the reader that the sign-in code expires in ten minutes.
- one-code: The email gives exactly one unambiguous current sign-in code, without another equally eligible code.

REVISED-ENGLISH
----------------------------------------
Welcome back to Cedar Workshops. Enter [CODE A] to sign in to your account. This code expires in ten minutes. If you did not request this, ignore this message.

Message check: PASS
Extraction: EXTRACTED
brand-purpose: PASS - The email identifies Cedar Workshops and explains how to sign in using the code provided.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account.
language: PASS - The text of the email instructions is in English.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account.
expiry: PASS - The email explicitly states that the code expires in ten minutes.
  Source excerpt: This code expires in ten minutes.
one-code: PASS - The email provides exactly one unambiguous code ([REDACTED CODE]).
  Source excerpt: Enter [REDACTED CODE] to sign in to your account.
Application result: {"accountIdentityMatches": true, "accountStatus": 200, "attempted": true, "replayStatus": 403, "unauthenticatedAccountStatus": 401, "verifyStatus": 200, "wrongCodeStatus": 403}

FRENCH
----------------------------------------
Bienvenue chez Cedar Workshops. Pour vous connecter, saisissez le code [CODE A]. Ce code expire dans dix minutes. Si vous ne l'avez pas demande, ignorez ce message.

Message check: PASS
Extraction: EXTRACTED
brand-purpose: PASS - The email explicitly identifies Cedar Workshops and explains how to sign in using a code.
  Source excerpt: Bienvenue chez Cedar Workshops. Pour vous connecter, saisissez le code [REDACTED CODE].
language: PASS - The email body instructions are written in French.
  Source excerpt: Pour vous connecter, saisissez le code [REDACTED CODE]. Ce code expire dans dix minutes.
expiry: PASS - The email explicitly states that the code expires in ten minutes.
  Source excerpt: Ce code expire dans dix minutes.
one-code: PASS - The email gives exactly one single sign-in code ([REDACTED CODE]).
  Source excerpt: saisissez le code [REDACTED CODE]
Application result: {"accountIdentityMatches": true, "accountStatus": 200, "attempted": true, "replayStatus": 403, "unauthenticatedAccountStatus": 401, "verifyStatus": 200, "wrongCodeStatus": 403}

MISSING-EXPIRY
----------------------------------------
Welcome back to Cedar Workshops. Enter [CODE A] to sign in to your account. If you did not request this, ignore this message.

Message check: FAIL
Extraction: EXTRACTED
brand-purpose: PASS - The email identifies Cedar Workshops and explains how to sign in using the provided code.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account.
language: PASS - The instructions in the email are written in English.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account. If you did not request this, ignore this message.
expiry: FAIL - The email does not state that the sign-in code expires in ten minutes or mention any expiration timeframe.
  No source excerpt returned.
one-code: PASS - The email provides exactly one unambiguous code ([REDACTED CODE]) for signing in.
  Source excerpt: Enter [REDACTED CODE] to sign in to your account.
Application result: {"attempted": false, "unauthenticatedAccountStatus": 401}

AMBIGUOUS-CODES
----------------------------------------
Welcome back to Cedar Workshops. Enter [CODE A] to sign in to your account. Your sign-in code is also [CODE B]. Both codes are described as current; no priority is given. This code expires in ten minutes. If you did not request this, ignore this message.

Message check: FAIL
Extraction: INCONCLUSIVE
brand-purpose: PASS - The email identifies Cedar Workshops and instructs the user to enter a code to sign in.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account.
language: PASS - The message instructions are written in English.
  Source excerpt: Welcome back to Cedar Workshops. Enter [REDACTED CODE] to sign in to your account.
expiry: PASS - The email explicitly states that the code expires in ten minutes.
  Source excerpt: This code expires in ten minutes.
one-code: FAIL - The email provides two separate sign-in codes without indicating which one is primary or valid.
  Source excerpt: Your sign-in code is also [REDACTED CODE]. Both codes are described as current; no priority is given.
Extraction reason: Extraction inconclusive (model-reported): Multiple current verification codes are present in the message body without clear priority, making the required code field ambiguous.
Application result: {"attempted": false, "unauthenticatedAccountStatus": 401}

Limits: No SMTP, inbox-placement, rendered-layout or browser UI claim. No expired-code, resend or rate-limit test. Four samples are not an accuracy benchmark.
Cleanup: All four temporary inboxes deleted. Local application stopped and sessions cleared.