Remote Cloud Engineer & AI Evaluation Architect

AfterQuery; Beaverton (OR); Remote; USD 117,000 - 227,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly pay via Stripe

Job summary

AfterQuery is a research lab hiring cloud engineers as independent contractors to author and grade infrastructure and automation scenarios used to test frontier AI models.

Remote, fully async work with no fixed hours. Pay ranges from $85 to $165 per hour, paid weekly via Stripe, with a minimum of 10 hours per week and scalable engagement. You will design scenarios, draft reference answers, and evaluate model outputs for correctness, security, and cost efficiency.

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP
• Hands on infrastructure as code experience with Terraform, CloudFormation, or similar
• Depth in at least one area such as networking, containers, serverless, or cost optimization
• Clear written English for documenting architecture and operational reasoning
• Able to commit at least 10 hours per week

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Skills

Cloud engineering

IaC experience

Written communication

Tools

Terraform

CloudFormation

Job description

AfterQuery is a research lab hiring cloud engineers as independent contractors to author and grade infrastructure and automation scenarios used to test frontier AI models.

Remote, fully async work with no fixed hours. Pay ranges from $85 to $165 per hour, paid weekly via Stripe, with a minimum of 10 hours per week and scalable engagement. You will design scenarios, draft reference answers, and evaluate model outputs for correctness, security, and cost efficiency.