Remote Cloud Engineer & AI Evaluation Trainer

AfterQuery; San Juan (PR); Remote; USD 117,000 - 227,000; Full time

Benefits offered by this job

Fully remote

Fully async work

Weekly Stripe payments

Flexible hours

Job summary

AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used in frontier AI evaluations. You’ll design realistic cloud scenarios, write reference answers with architectural reasoning, and grade model outputs for correctness, security, and cost efficiency.

We offer full remote work with async collaboration, a pay range of $85–$165 per hour paid weekly via Stripe, and flexible minimum hours (10 hours/week).

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP.
• Hands on infrastructure as code experience with Terraform, CloudFormation, or similar.
• Depth in at least one area such as networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response.
• Write reference answers with the architectural reasoning behind each decision.
• Grade model output for correctness, security, and cost efficiency.
• Flag configurations that read plausible but would fail or overspend in production.

Skills

Cloud engineering

Written English

Documentation

Tools

Terraform

CloudFormation

AWS

Azure

GCP

Job description

AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used in frontier AI evaluations. You’ll design realistic cloud scenarios, write reference answers with architectural reasoning, and grade model outputs for correctness, security, and cost efficiency.

We offer full remote work with async collaboration, a pay range of $85–$165 per hour paid weekly via Stripe, and flexible minimum hours (10 hours/week).