AI Model Evaluation DevOps Engineer - Remote

mercor; United States; A distancia; USD 96.000 - 138.000; Jornada completa

Descripción de la vacante

Mercor is seeking a DevOps/SRE/Cloud Engineer (Coding Agent Experience) for remote contract work. You will work with frontier AI coding agents to execute complex infrastructure tasks and review model-generated infrastructure across AWS, GCP, Azure, Kubernetes, and CI/CD pipelines.

The role emphasizes evaluating model outputs, identifying reliability issues, and applying engineering judgment to real-world scenarios in a remote setting.

Formación

• 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
• Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD, or observability tooling.
• Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Responsabilidades

• Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
• Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
• Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
• Compare outputs from multiple frontier models to assess strengths and weaknesses.
• Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Conocimientos

DevOps/SRE/Cloud

Herramientas

AWS

Azure

GCP

Kubernetes

Terraform

CI/CD pipelines

Observability tooling

Descripción del empleo

Mercor is seeking a DevOps/SRE/Cloud Engineer (Coding Agent Experience) for remote contract work. You will work with frontier AI coding agents to execute complex infrastructure tasks and review model-generated infrastructure across AWS, GCP, Azure, Kubernetes, and CI/CD pipelines.

The role emphasizes evaluating model outputs, identifying reliability issues, and applying engineering judgment to real-world scenarios in a remote setting.