AI Task Evaluation: Serverless & IaC Auditor

HumanitApp; United States; Híbrido; USD 96.000 - 124.000; Jornada completa

Descripción de la vacante

HumanitApp seeks a reviewer to evaluate AWS serverless and IaC tasks used to train and evaluate frontier AI models. You will assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness and provide rubric-based feedback.

Required: 3+ years building AWS serverless apps and strong IaC experience (CDK/CFN/SAM). Familiarity with LocalStack and IAM boundaries is preferred. 40 hours per week, compensation at market rates.

Formación

• 3+ years hands-on experience building multi-service AWS serverless applications.
• Strong experience with infrastructure-as-code (CDK, CloudFormation, or SAM).
• Ability to assess event-driven architecture correctness, IAM boundaries, and failure/retry semantics.
• Familiarity with LocalStack or similar local emulation vs. real AWS behavior.

Responsabilidades

• Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless tasks.
• Assess multi-service serverless designs and IaC fidelity across services.
• Provide rubric-based written feedback on integration and reliability.

Conocimientos

AWS serverless

Lambda

API Gateway

DynamoDB

S3

EventBridge

SNS/SQS

Step Functions

Herramientas

AWS CDK

CloudFormation

SAM

Descripción del empleo

Future projects, not immediate vacancies. Check each network's country and experience requirements.

Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness

and provide clear, rubric-based written feedback.

Basic Qualifications • 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions) • Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM) • Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics • Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior

Preferred Qualifications • AWS certifications (Solutions Architect / Developer) • Experience with observability and cost-optimization for serverless workloads • Prior code-review or task-grading experience

Mercor eligibility fields: Eligible work locations: United States.

AI evaluation

Compensation context

The listing states $70 - $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.

• Review the official description below for experience and equipment requirements.
• Confirm location eligibility, language requirements and weekly availability with the partner.

Not the right fit?

Use your CV to find relevant roles on HumanitApp. This is separate from a partner application.

Optional role alerts from HumanitApp. Subscribe only if you want weekly emails.

Can I start immediately through an Instant Work Offer?

This listing is not a promise of immediate work. Mercor may send separate offers to prequalified candidates. Read how Instant Work Offers work .

How should I compare the listed pay?

The listing states $70 - $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.

Does Apply use a referral link?

Yes. The button opens the exact verified Mercorlisting using the referral URL published for this role.

Is HumanitApp the employer?

No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.

Must I share my details here?

No. Choose the primary Apply action to continue directly without giving HumanitApp your name or email address.