Confido builds AI voice agents that handle real patient calls for specialty clinics, in production, under HIPAA. As Evals Lead you'll own agent and patient-experience evaluation end to end: every production call auto-scored (LLM-as-judge + audio analysis), calibrated against human review, and tied to automation rate and revenue. The craft is turning \"did the patient feel heard?\" into a measurable, reproducible signal, then proving the next release moved it.
Company: Confido Health
Location: New York City (Hybrid)
Role: Evals Lead
Compensation: Confidential
Why it's awesome
Evals is the highest-leverage discipline in applied AI right now, and here it isn't a side function — it's the intelligence layer the whole company steers by. Senior IC role with light leadership.
What makes a good fit
~5 years total experience, with 1-2+ years hands-on in evals, ML, or applied research. Confido hires on methodology — voice/speech depth is ramp-able on the job.
How to apply
Email saket@confido.health.
See every open role on the Uristocrat Job Board.
Comments