AI Task Evaluation: Serverless & IaC Auditor

HumanitApp; Northern (KY); Hybrid; USD 96,000 - 124,000; Full time

Job summary

HumanitApp seeks a reviewer to evaluate AWS serverless and IaC tasks used to train and evaluate frontier AI models. You will assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness and provide rubric-based feedback.

Required: 3+ years building AWS serverless apps and strong IaC experience (CDK/CFN/SAM). Familiarity with LocalStack and IAM boundaries is preferred. 40 hours per week, compensation at market rates.

Qualifications

• 3+ years hands-on experience building multi-service AWS serverless applications.
• Strong experience with infrastructure-as-code (CDK, CloudFormation, or SAM).
• Ability to assess event-driven architecture correctness, IAM boundaries, and failure/retry semantics.
• Familiarity with LocalStack or similar local emulation vs. real AWS behavior.

Responsibilities

• Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless tasks.
• Assess multi-service serverless designs and IaC fidelity across services.
• Provide rubric-based written feedback on integration and reliability.

Skills

AWS serverless

Lambda

API Gateway

DynamoDB

S3

EventBridge

SNS/SQS

Step Functions

Tools

AWS CDK

CloudFormation

SAM

Job description

HumanitApp seeks a reviewer to evaluate AWS serverless and IaC tasks used to train and evaluate frontier AI models. You will assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness and provide rubric-based feedback.

Required: 3+ years building AWS serverless apps and strong IaC experience (CDK/CFN/SAM). Familiarity with LocalStack and IAM boundaries is preferred. 40 hours per week, compensation at market rates.