Remote Cloud Engineer & AI Evaluation Specialist

AfterQuery; Portland (OR); Remote; USD 117,000 - 227,000; Part time

Benefits offered by this job

Remote work

Job summary

AfterQuery is seeking cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. This is a fully remote, async role with no fixed hours and a minimum of 10 hours per week.

You will design cloud scenarios across AWS, Azure or GCP, write reference answers explaining architectural reasoning, and evaluate model outputs for correctness, security, and cost efficiency. Compensation ranges $85 to $165 per hour, paid weekly via Stripe.

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP.
• Hands-on infrastructure as code experience with Terraform or CloudFormation.
• Depth in networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response.
• Write reference answers with the architectural reasoning behind each decision.
• Grade model output for correctness, security, and cost efficiency.
• Flag configurations that would fail or overspend in production.

Skills

Cloud engineering

IaC (Terraform/CloudFormation)

Written English

Remote work

Tools

Terraform

CloudFormation

Kubernetes

Job description

AfterQuery is seeking cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. This is a fully remote, async role with no fixed hours and a minimum of 10 hours per week.

You will design cloud scenarios across AWS, Azure or GCP, write reference answers explaining architectural reasoning, and evaluate model outputs for correctness, security, and cost efficiency. Compensation ranges $85 to $165 per hour, paid weekly via Stripe.