DevOps Engineer - AI Trainer

AfterQuery; Fort Lauderdale (FL); Remote; USD 117,000 - 227,000; Part time

Benefits offered by this job

Fully remote

Weekly Stripe payments

Job summary

AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios those evaluations run on. You will design realistic cloud architectures, write reference answers with architectural reasoning, and assess models for correctness, security, and cost.

This is a fully remote, asynchronous contract with no fixed hours. Pay ranges from 85 to 165 USD per hour, payments weekly via Stripe, and a minimum commitment of 10 hours per week for ongoing project

Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP
• Hands on infrastructure as code experience with Terraform, CloudFormation, or similar
• Depth in networking, containers, serverless, or cost optimization
• Clear written English for documenting architecture and operational reasoning
• Able to commit at least 10 hours per week

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Skills

Cloud engineering

Written English

Remote work mindset

Tools

Terraform

CloudFormation

Kubernetes

Job description

Cloud engineers to build the infrastructure and automation scenarios frontier AI labs use to test model judgment.

AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios those evaluations run on.

What you'll actually do

• Author realistic cloud scenarios, from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Who this is for

• Engineers with at least 2 years of cloud engineering on AWS, Azure, or GCP
• Practitioners with hands on infrastructure as code experience such as Terraform or CloudFormation
• Engineers with depth in at least one area such as networking, containers, serverless, or cost optimization
• Clear writers who can document the reasoning behind an architectural decision

Contract and pay

• $85 to $165/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.
• Fully remote, fully async. No fixed hours.
• Minimum 10 hours per week, no maximum. Scale up or down week to week.
• Independent contractor. Ongoing project work rather than single task batches.

About AfterQuery

AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Why Apply

• $85 to $165/hr, paid weekly via Stripe
• 100% remote and fully async
• Shape how frontier models reason about cloud infrastructure
• Ongoing project work with hours you set each week

Responsibilities

• Author realistic cloud scenarios from architecture design through incident response
• Write reference answers with the architectural reasoning behind each decision
• Grade model output for correctness, security, and cost efficiency
• Flag configurations that read plausible but would fail or overspend in production

Required Qualifications

• 2+ years of professional cloud engineering experience on AWS, Azure, or GCP
• Hands on infrastructure as code experience with Terraform, CloudFormation, or similar
• Depth in at least one area such as networking, containers, serverless, or cost optimization
• Clear written English for documenting architecture and operational reasoning
• Able to commit at least 10 hours per week

Preferred Qualifications

• Certifications such as AWS Solutions Architect, Azure Administrator, or GCP Professional
• Kubernetes and container orchestration experience
• Multi cloud or large scale migration experience

About AfterQuery

AfterQuery is a research lab investigating the boundaries of artificial intelligence through novel datasets and experimentation. We believe great AI comes from exceptional, human-generated data.

We're backed by top investors, including Y Combinator and Box Group, and support all leading AI labs.