Remote Cloud Engineer & AI Evaluation Architect

AfterQuery; Norristown (Montgomery County); Remote; USD 117,000 - 227,000; Full time

Benefits offered by this job

100% remote

Weekly Stripe payments

Flexible hours per week

Ongoing project work

Job summary

AfterQuery is a research lab that builds the evaluation data frontier AI labs use to measure model performance in real work. We are hiring cloud engineers as contractors to author and grade infrastructure and automation scenarios.

You will design realistic cloud scenarios, write reference answers with architectural reasoning, and grade models for correctness, security, and cost efficiency. This is a fully remote, ongoing contractor role with flexible weekly hours.

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP.
• Hands-on IaC experience with Terraform or CloudFormation.
• Depth in at least one area such as networking, containers, serverless, or cost optimization.
• Clear written English for documenting architecture and operational reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Skills

Cloud engineering

Infrastructure as code

Terraform / CloudFormation

Cloud architecture

Written English

Tools

Terraform

CloudFormation

Kubernetes

Job description

AfterQuery is a research lab that builds the evaluation data frontier AI labs use to measure model performance in real work. We are hiring cloud engineers as contractors to author and grade infrastructure and automation scenarios.

You will design realistic cloud scenarios, write reference answers with architectural reasoning, and grade models for correctness, security, and cost efficiency. This is a fully remote, ongoing contractor role with flexible weekly hours.