Responses are consistent for semantically equivalent queries
Why it matters
Temperature above 0.8 on a consistency-sensitive endpoint means the same billing question gets three different answers on three retries — one correct, one subtly wrong, one contradicting the docs. For customer support, legal, or documentation Q&A, this breaks the inference-contract taxon: users expect the same question to yield the same answer, and variance here manifests as product bugs, escalated tickets, and compliance incidents. Aggressive sampling is a feature for creative writing and a defect everywhere else.
Severity rationale
Low because variance is tolerable in many contexts, but becomes serious for regulated or support-critical surfaces.
Remediation
Lower temperature to 0.3 or below for consistency-sensitive routes and set a deterministic seed where the provider supports it. Add consistency directives to the system prompt. Update the config in api/support/route.ts.
await openai.chat.completions.create({
model: 'gpt-4o',
temperature: 0.3,
seed: 42,
messages: [...]
})
DetectionPro
The detection method for this pattern is part of AuditBuffet Pro.
The full method (what to look for, pass and fail conditions, and how results get reported) ships inside the AI Response Quality Audit. The pattern definition, severity rationale, and remediation remain openly licensed under CC-BY-4.0.
Taxons
History
- 2026-04-18·v1.0.0·Initial import from ai-response-quality·automated