Remote AI Model Evaluation DevOps Engineer

mercor; Schweiz; Remote; CHF 82,000 - 112,000; Full time

Job summary

mercor is seeking a DevOps/SRE/Cloud Engineer (Coding Agent Experience) for remote, contract work. You will leverage frontier AI coding agents to tackle complex infrastructure tasks and review model-generated implementations across cloud platforms, Kubernetes, and CI/CD pipelines.

You will identify reliability issues, compare outputs from several frontier models, and apply professional engineering judgment to realistic infrastructure scenarios.

Qualifications

• 2+ years of professional DevOps/SRE/Cloud Engineering experience.
• Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
• Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Responsibilities

• Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
• Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
• Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
• Compare outputs from multiple frontier models to assess strengths and weaknesses.

Skills

DevOps

SRE

Cloud engineering

AI tooling literacy

Tools

AWS

Azure

GCP

Kubernetes

Terraform

CI/CD

Observability tooling

Cursor

Claude Code

Codex

Windsurf

Gemini CLI

Job description

mercor is seeking a DevOps/SRE/Cloud Engineer (Coding Agent Experience) for remote, contract work. You will leverage frontier AI coding agents to tackle complex infrastructure tasks and review model-generated implementations across cloud platforms, Kubernetes, and CI/CD pipelines.

You will identify reliability issues, compare outputs from several frontier models, and apply professional engineering judgment to realistic infrastructure scenarios.