Remote DevOps SRE for AI Model Evaluations

Visa Hunt

United States

On-site

USD 96,432 - 151,536

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Remote work
Contract role with task-based pay

Job summary

Mercor is hiring a DevOps / SRE / Cloud Engineer (Coding Agent Experience) for a remote contract role. Compensation is $85/hour.

The position focuses on using frontier AI coding agents to perform and evaluate complex infrastructure tasks, review cloud infrastructure implementations, and ensure reliability through rigorous assessment. Must have 2+ years in DevOps/SRE/Cloud Engineering and experience with AWS/Azure/GCP, Kubernetes, Terraform, and CI/CD pipelines.

Qualifications

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Skills

DevOps/SRE experience
Cloud engineering
AI coding agent usage

Tools

AWS
Azure
GCP
Kubernetes
Terraform
CI/CD pipelines
Observability tooling

Job description

Mercor is hiring a DevOps / SRE / Cloud Engineer (Coding Agent Experience) for a remote contract role. Compensation is $85/hour.

The position focuses on using frontier AI coding agents to perform and evaluate complex infrastructure tasks, review cloud infrastructure implementations, and ensure reliability through rigorous assessment. Must have 2+ years in DevOps/SRE/Cloud Engineering and experience with AWS/Azure/GCP, Kubernetes, Terraform, and CI/CD pipelines.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote DevOps Engineer for AI Model Evaluation
Remote DevOps Engineer for AI Model Evaluation

Mercor • San Francisco (CA)

On-site
Remote Cloud Engineer & DevOps SRE — AI Coding Agent
Remote Cloud Engineer & DevOps SRE — AI Coding Agent

United States Digital Space LLC • United States

Remote
USD 99,000 - 135,000
Remote work
Remote Cloud Engineer | AI-Driven DevOps/SRE (Contract)
Remote Cloud Engineer | AI-Driven DevOps/SRE (Contract)

Mercor • Riga (KS)

Remote
USD 99,000 - 135,000
Remote Cloud Engineer (DevOps/SRE) with AI Coding Agents
Remote Cloud Engineer (DevOps/SRE) with AI Coding Agents

Mercor • New York (NY)

Remote
USD 103,000 - 131,000
AI-Driven DevOps Evaluator for Frontier Code Models
AI-Driven DevOps Evaluator for Frontier Code Models

Mercor • San Francisco (CA)

Hybrid
USD 55,000 - 91,000
AI-Driven DevOps Engineer & Model Evaluator
AI-Driven DevOps Engineer & Model Evaluator

Mercor • San Francisco (CA)

On-site
USD 15,000 - 22,000
DevOps Engineer - AI Model Evaluator
DevOps Engineer - AI Model Evaluator

Mercor • San Francisco (CA)

Hybrid
USD 55,000 - 91,000
DevOps Engineer - AI Model Evaluator
DevOps Engineer - AI Model Evaluator

Obsidian • New York (NY)

On-site
USD 455,000 - 647,000
DevOps Engineer - AI Model Evaluator - AI Trainer
DevOps Engineer - AI Model Evaluator - AI Trainer

Mercor • San Francisco (CA)

On-site
USD 15,000 - 22,000
DevOps Engineer - AI Model Evaluator
DevOps Engineer - AI Model Evaluator

Mercor • New York (NY)

On-site
USD 441,000 - 661,000