Platform Engineer - AI Evaluation at Scale

Coval; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Coval in San Francisco (SoMa) is hiring a senior systems engineer to own the machinery behind our voice AI evaluation platform. You’ll build distributed execution, manage data pipelines, and optimize cost at scale as we run tens of thousands of conversations daily.

As a founding member of the engineering team, you’ll shape the architecture, own Terraform-based infrastructure, and mentor others while delivering robust, production-grade systems.

Qualifications

• 4+ years building real systems, with Python and AWS as home turf.
• Experience with managed services and Terraform, and judgment to know when a managed service is right.
• Familiar with operating under load and handling queue backlogs.
• Ability to determine what to finish, fix, start next and where to buy time.
• High agency on a small Series A team, shaping architecture and standards.

Responsibilities

• Build out the distributed execution engine: workers, queues and orchestration for tens of thousands of simulations daily and score returns.
• Own the data side: databases, conversations, audio and judge results; pipelines moving data between stages.
• Make real cost trade-offs; optimize model calls and storage to keep unit economics sane.
• Stand up and maintain environments where LoRA training jobs run, a core ML plumbing responsibility.

Skills

Python

AWS

Terraform

Distributed systems

Data pipelines

Tools

Terraform

PostgreSQL

SQS/SNS

Job description

Coval in San Francisco (SoMa) is hiring a senior systems engineer to own the machinery behind our voice AI evaluation platform. You’ll build distributed execution, manage data pipelines, and optimize cost at scale as we run tens of thousands of conversations daily.

As a founding member of the engineering team, you’ll shape the architecture, own Terraform-based infrastructure, and mentor others while delivering robust, production-grade systems.