AWS Serverless Auditor - Cloud Expert

Mercor; San Francisco (CA); On-site; USD 90,000 - 130,000; Full time

Job summary

Mercor is seeking an evaluator to assess AWS serverless architectures and IaC implementations used in frontier AI model training. You will review multi-service designs, IAM boundaries, and event-driven behavior, delivering structured rubric-based feedback. The role emphasizes practical testing fidelity, cross-service integration, and strong technical judgment to guide improvements.

Qualifications

• 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions)
• Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM)
• Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics
• Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior

Responsibilities

• Evaluate quality, correctness, and cloud-architecture soundness of serverless and IaC tasks used for training/evaluating AI models
• Provide rubric-based written feedback on multi-service serverless designs and cross-service integration
• Assess IAM boundaries, failure/retry semantics, and testing fidelity across environments

Skills

AWS serverless

IaC (CDK/CF/SAM)

Event-driven architecture

IAM permissions

Local emulation testing

Tools

LocalStack

AWS CDK

CloudFormation

SAM

API Gateway

Lambda

DynamoDB

Job description

Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness — and provide clear, rubric-based written feedback.

Basic Qualifications

• 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions)
• Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM)
• Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics
• Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior

Preferred Qualifications

• AWS certifications (Solutions Architect / Developer)
• Experience with observability and cost-optimization for serverless workloads
• Prior code-review or task-grading experience