Senior Platform Engineer: AI Evaluation Pipelines

present of AI; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Coval, based in San Francisco, is seeking a senior backend engineer to own the platform that evaluates conversational AI. You will build and operate the backend that coordinates distributed workers, queues, orchestration, and the data layer moving conversations, audio, and results between stages.

A strong candidate has years of building and operating real systems in Python and AWS, works with managed services and Terraform, and has run workloads at scale with cost awareness and initiative on a

Qualifications

• Several years building and operating real systems in Python and AWS.
• Experience with managed services and Terraform.
• Experience running systems under load and cost-aware design.

Responsibilities

• Own backend machinery for large-scale evaluations of conversational AI.
• Manage distributed workers, queues, orchestration, and the data layer.
• Move conversations, audio, and results between stages with reliability and cost control.

Skills

Python

AWS

Terraform

Distributed queues

Cloud cost

Tools

AWS

Terraform

Distributed systems tooling

Job description

Coval, based in San Francisco, is seeking a senior backend engineer to own the platform that evaluates conversational AI. You will build and operate the backend that coordinates distributed workers, queues, orchestration, and the data layer moving conversations, audio, and results between stages.

A strong candidate has years of building and operating real systems in Python and AWS, works with managed services and Terraform, and has run workloads at scale with cost awareness and initiative on a