Remote Cloud Architect & AI Evaluation Specialist

AfterQuery; Kansas City (MO); Remote; USD 117,000 - 227,000; Full time

Benefits offered by this job

Fully remote

Weekly Stripe payments

Flexible schedule

Job summary

AfterQuery is hiring cloud engineers to author and grade infrastructure and automation scenarios used in frontier AI evaluations. This fully remote, async contractor role requires crafting realistic cloud scenarios and providing justification for architectural choices.

You will grade model outputs on correctness, security, and cost efficiency, and flag risky configurations. The work is ongoing, with weekly Stripe payments and hours you set each week.

Qualifications

• 2+ years of professional cloud engineering experience.
• Hands-on infrastructure as code experience with Terraform or CloudFormation.
• Depth in at least one area such as networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response.
• Write reference answers with the architectural reasoning behind each decision.
• Grade model output for correctness, security, and cost efficiency.
• Flag configurations that would read as plausible but would fail or overspend in production.

Skills

2+ years cloud engineering

IaC experience (Terraform)

IaC experience (CloudFormation)

Networking/containers/serverless/cost-

Clear written English

10 hours per week commitment

Tools

Terraform

CloudFormation

Job description

AfterQuery is hiring cloud engineers to author and grade infrastructure and automation scenarios used in frontier AI evaluations. This fully remote, async contractor role requires crafting realistic cloud scenarios and providing justification for architectural choices.

You will grade model outputs on correctness, security, and cost efficiency, and flag risky configurations. The work is ongoing, with weekly Stripe payments and hours you set each week.