Remote Cloud Architect & AI Evaluation Engineer

AfterQuery; Herndon (VA); Remote; USD 117,000 - 227,000; Full time

Benefits offered by this job

100% remote

Flexible hours

Weekly Stripe payments

Ongoing project work

Job summary

AfterQuery is hiring cloud engineers to author and grade the infrastructure and automation scenarios used to test frontier AI models. This is a fully remote contractor role with no fixed hours, paying hourly rates between $85 and $165 and weekly Stripe payments.

Work involves writing realistic cloud scenarios from design to incident response, plus scoring model outputs for correctness, security, and cost efficiency, and flagging configurations that could overspend in production.

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP.
• Hands on infrastructure as code experience with Terraform, CloudFormation, or similar.
• Depth in at least one area such as networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios, from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Skills

Cloud engineering

Terraform

CloudFormation

Networking

Containers

Serverless

Cost optimization

Written English

Tools

Terraform

CloudFormation

Job description

AfterQuery is hiring cloud engineers to author and grade the infrastructure and automation scenarios used to test frontier AI models. This is a fully remote contractor role with no fixed hours, paying hourly rates between $85 and $165 and weekly Stripe payments.

Work involves writing realistic cloud scenarios from design to incident response, plus scoring model outputs for correctness, security, and cost efficiency, and flagging configurations that could overspend in production.