A complete application in a minute
Tailored resume and cover letter, ready to send.
Coval, based in San Francisco, is seeking a senior backend engineer to own the platform that evaluates conversational AI. You will build and operate the backend that coordinates distributed workers, queues, orchestration, and the data layer moving conversations, audio, and results between stages.
A strong candidate has years of building and operating real systems in Python and AWS, works with managed services and Terraform, and has run workloads at scale with cost awareness and initiative on a
Engineering · San Francisco, CA, US · Full-time · Senior level
This role owns the backend machinery that runs large scale evaluations of conversational AI, including distributed workers, queues, orchestration, and the data layer that moves conversations, audio, and results between stages. A strong candidate has several years building and operating real systems in Python and AWS, works comfortably with managed services and Terraform, and has run something under load. The job also calls for cost judgment, since every model call and storage byte carries a price, and for the initiative to decide what to finish, fix, or defer on a small team.
The platform exists to test AI agents before and after launch, so the work sits close to AI without being model research. Much of the engineering is ordinary distributed systems and data plumbing, but the volume of simulated conversations and model calls makes cost control and throughput central. Judgment about what to build versus buy, and how to keep unit economics sane as load grows, stays human.
A person here would gain hands on exposure to how evaluation pipelines for voice and chat agents are built and run at scale, including the infrastructure behind LoRA training jobs. That builds practical knowledge of serving and scoring AI systems under real load. Someone preparing could strengthen this by working with queue based pipelines, cloud cost tracking, and the operational side of ML workloads.
This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.
Enterprise simulation and evaluation platform that stress-tests voice and chat AI agents before deployment, per the company.