Remote Cloud Engineer for AI Evaluation & Architecture

AfterQuery; Redmond (WA); Remote; USD 124,000 - 220,000; Full time

Job summary

AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. You will build realistic cloud scenarios from architecture through incident response, write reasoning-backed reference answers, and assess model outputs for correctness, security, and cost efficiency.

The role is fully remote with flexible weekly hours, minimum 10 hours per week, and pay ranges from $85 to $165 per hour.

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP.
• Hands-on infrastructure as code with Terraform or CloudFormation.
• Depth in at least one area such as networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response.
• Write reference answers with the architectural reasoning behind each decision.
• Grade model output for correctness, security, and cost efficiency.
• Flag configurations that read plausible but would fail or overspend in production.

Skills

Cloud engineering

Infrastructure as Code

Clear written English

Tools

Terraform

CloudFormation

Kubernetes

Job description

AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. You will build realistic cloud scenarios from architecture through incident response, write reasoning-backed reference answers, and assess model outputs for correctness, security, and cost efficiency.

The role is fully remote with flexible weekly hours, minimum 10 hours per week, and pay ranges from $85 to $165 per hour.