Senior Director, AI Quality Engineering — Hybrid NYC

Socket.dev; New York (NY); Hybrid; USD 230,000 - 250,000; Full time

Benefits offered by this job

Health benefits

401(k) match

Therapist visits (Noom)

Fertility care support

Wellhub access

BrightHorizons

Professional Development Reimbursement

Donation matching

Job summary

Spring Health is seeking a Senior Quality Engineering leader to design and execute a comprehensive AI-native quality strategy across the software lifecycle. You will define high-quality standards, build agentic testing, and partner with security, clinical, and data teams to ensure safety, trust, and regulatory compliance.

You will lead a distributed QE organization, scale testing platforms, and drive measurable improvements in release confidence, automation coverage, and defect reduction,

Qualifications

• Proven experience leading and scaling quality engineering organizations in high-growth environments.
• Deep technical expertise in test automation architecture at scale with modern frameworks and CI/CD integration.
• Hands-on experience building evaluation and testing systems for AI/ML or LLM-powered products.
• Experience deploying AI agents or AI-assisted tooling into the SDLC with measurable gains.
• Shift-left transformation experience across large engineering organizations.
• Experience with HIPAA/SOC 2, PHI-safe data, auditability and regulatory requirements.

Responsibilities

• Define and drive the enterprise Quality Engineering strategy across the AI-native SDLC.
• Build modern testing frameworks for AI-powered products, LLM apps, and agentic workflows.
• Lead adoption of AI agents to automate test generation, regression testing, and defect analysis.
• Establish scalable testing practices across functional, integration, regression, performance, security, accessibility, and end-to-end testing.
• Develop reusable testing platforms and CI/CD quality tooling for engineering teams.
• Define validation frameworks ensuring reliability, safety, compliance and trust in AI systems.

Skills

QA leadership

Test automation architecture

AI/ML testing

AI agents/testing

Shift-left

Regulated domain experience

Cross-functional leadership

Executive-level communication

Measurement/metrics

Tools

Playwright

Cypress

pytest

Jest

Job description

Spring Health is seeking a Senior Quality Engineering leader to design and execute a comprehensive AI-native quality strategy across the software lifecycle. You will define high-quality standards, build agentic testing, and partner with security, clinical, and data teams to ensure safety, trust, and regulatory compliance.

You will lead a distributed QE organization, scale testing platforms, and drive measurable improvements in release confidence, automation coverage, and defect reduction,