AI DevOps Evaluator for Frontier Code Agents

Mercor

Paris

Sur place

EUR 406 000 - 549 000

Plein temps

14 jours+

Recevez plus de réponses des employeurs

Envoyez un CV adapté au poste en quelques minutes.

Résumé du poste

Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments focused on realistic infrastructure engineering workflows.

The role involves reviewing model-generated implementations across cloud platforms, Kubernetes, CI/CD, observability, and automation. You will identify bugs, edge cases, and failure modes while applying sound engineering judgment.

Qualifications

2+ years of professional DevOps, SRE, or Cloud Engineering experience.
Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Experience supporting production-scale systems is preferred.

Responsabilités

Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
Identify bugs, edge cases, reliability issues, and failure modes.
Compare outputs from multiple frontier models and assess their strengths and weaknesses.
Apply professional engineering judgment to realistic infrastructure engineering scenarios.