AI Capable DevOps Engineer - Model Evaluator (Remote)

mercor

España

Remote

EUR 86,000 - 123,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking a DevOps / SRE / Cloud Engineer (Coding Agent Experience) to work remotely on a contract basis. You will use frontier AI coding agents to tackle infrastructure tasks and evaluate model-generated implementations across cloud platforms, Kubernetes, and CI/CD pipelines.

Candidates should have 2+ years in DevOps/SRE/Cloud Eng and experience with AWS, Azure, GCP, Terraform, and observability tools, plus regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, or

Qualifications

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Skills

DevOps experience
SRE experience
Cloud engineering
Kubernetes
CI/CD
Observability tooling
AI coding agents

Tools

AWS
Azure
GCP
Terraform
CI/CD pipelines
Observability tooling

Job description

Mercor is seeking a DevOps / SRE / Cloud Engineer (Coding Agent Experience) to work remotely on a contract basis. You will use frontier AI coding agents to tackle infrastructure tasks and evaluate model-generated implementations across cloud platforms, Kubernetes, and CI/CD pipelines.

Candidates should have 2+ years in DevOps/SRE/Cloud Eng and experience with AWS, Azure, GCP, Terraform, and observability tools, plus regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, or

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

DevOps Engineer - AI Model Evaluator
DevOps Engineer - AI Model Evaluator

mercor • Spain

Remote
EUR 86,000 - 123,000
AI Coding Agent Evaluator - Design & QA Real-World Tasks
AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift • Madrid

On-site
EUR 23,819 - 47,639
Senior AI/ML Software Engineer — Fully Remote
Senior AI/ML Software Engineer — Fully Remote

Ipronics • Valencia

Remote
EUR 184,000 - 258,000
Remote System Operations Engineer AI Trainer (Freelance)
Remote System Operations Engineer AI Trainer (Freelance)

10x.Team • Madrid

On-site
EUR 5,400 - 13,000
100% remote
AI Academy access
Flexible hours
Senior Full-Stack Engineer - Remote Contractor (AI Code QA)
Senior Full-Stack Engineer - Remote Contractor (AI Code QA)

AgileEngine, LLC. • Zaragoza

Remote
EUR 49,000 - 98,000
Remote Freelance System Operations Engineer & AI Trainer
Remote Freelance System Operations Engineer & AI Trainer

10x Team B.V • Spain

Remote
EUR 83,000 - 165,000
Remote freelance
Flexible hours
AI/ML Engineer – RAG Systems, AWS & Claude (Remote-friendly)
AI/ML Engineer – RAG Systems, AWS & Claude (Remote-friendly)

Provectus • Spain

Remote
EUR 70,000 - 120,000
Remote-friendly culture
Internal training and certifications
Medical insurance or budget for health
+1
Remote System Ops Engineer - AI Trainer (Freelance)
Remote System Ops Engineer - AI Trainer (Freelance)

10x Team • Spain

Remote
EUR 83,000 - 165,000
100% remote
Flexible project-based freelance work
Access to AI Academy
Remote Senior Full-Stack Engineer for AI Code Review
Remote Senior Full-Stack Engineer for AI Code Review

YO AI Labs • Madrid

Remote
EUR 61,000 - 123,000
Senior GenAI Engineer for Production AI on AWS
Senior GenAI Engineer for Production AI on AWS

Provectus • Comunidad de Madrid

On-site
EUR 90,000 - 130,000
Private medical insurance
Paid time off and holidays
Remote-friendly culture
+1