Senior AI Quality Engineer: Adversarial Testing Lead

R/GA; Los Angeles (CA); Hybrid; USD 135,000 - 150,000; Full time

Job summary

Addition, an AI-focused studio within the R/GA network, is seeking a Senior AI Quality Engineer to elevate the quality of AI systems through rigorous testing, red-teaming, and automation.

You will collaborate with engineers, PMs, and clients in a hybrid setup across NYC, Los Angeles, or San Francisco, translating requirements into test plans, building evaluation frameworks, and gating launches to ensure reliable AI outputs.

Qualifications

• 4+ years in software QA, test engineering, or quality engineering
• 1–2 years of AI-powered/LLM-based systems experience
• Deep familiarity with AI failure modes (hallucination, prompt injection, context drift)
• Ability to read code and understand system architecture to write meaningful test plans

Responsibilities

• Translate product/technical requirements into structured test plans
• Write test scripts and automate testing; set up logging frameworks
• Perform red-teaming of AI systems before launch
• Act as quality gate on launches; document failures and blockers
• Build lightweight eval frameworks and test harnesses for recurring system types
• Develop and promote shared quality standards across projects
• Document failure patterns and trace inputs to root causes

Skills

Problem solving

Adaptability

High EQ

Effective communicator

Curiosity

Tools

Notion

Google Workspace

Figma/FigJam

Slack

Job description

Addition, an AI-focused studio within the R/GA network, is seeking a Senior AI Quality Engineer to elevate the quality of AI systems through rigorous testing, red-teaming, and automation.

You will collaborate with engineers, PMs, and clients in a hybrid setup across NYC, Los Angeles, or San Francisco, translating requirements into test plans, building evaluation frameworks, and gating launches to ensure reliable AI outputs.