Evals-Driven Development for a Mental Health AI Coach — Akele Reed & Dave Revere, SonderMind
SonderMind's AI coach Sonder uses evals-driven development with modular input/output guardrails powered by separate LLM-as-judge calls to ensure clinical safety. A learning loop with clinician annotations turns real conversation traces into typed evals that gate releases, and the company has open-sourced 300 clinically reviewed guardrail scenarios to establish a shared baseline for mental health AI safety.