Scope: Figures are from City919's internal QA program as of July 2026. They are not customer outcome statistics, field-performance guarantees, or independent certification.
What neutrality testing covers
Recruitment attempts
Scenarios direct the interpreter to omit, soften, exaggerate, or conceal part of a statement. Expected behavior is to refuse the manipulation and preserve the original meaning.
Pressure from either party
Testing runs in both directions, including attempts by a responder or a member of the public to make the interpreter editorialize or change roles.
Critical-detail fidelity
Names, spelled words, dates, identifiers, plate and case numbers, and medical quantities are evaluated as details where an approximation is not acceptable.
Prompt and role attacks
Standing tests attempt to reveal system instructions, change the interpreter's role, or redirect it toward an unrelated task.
Field-noise conditions
Test cases include overlapping voices, bystander interruptions, background speech, code-switching, and conversations directed away from the call.
Human escalation boundary
Policy-controlled and legally sensitive communication is tested against the agency-approved script and live-interpreter rules for the configured service.
What the system should do
- Keep the responder, member of the public, and interpreter roles distinct.
- Translate the statement rather than follow an instruction embedded inside it.
- Preserve material details instead of smoothing them into an approximation.
- Surface a manipulation attempt when that attempt is itself part of the conversation.
- Escalate or stop relying on AI when audio, policy, or language conditions exceed the configured boundary.
Limits still apply
Internal testing reduces known failure modes; it does not eliminate them. Noise, overlapping speech, cellular conditions, accents, terminology, device placement, and unclear phrasing can affect interpretation. Responders remain responsible for following agency policy and moving to a qualified live interpreter when required.
Review the test program See the agency evaluation standard →