Senior SDET — AI-First Quality & Automation

ComPsych Corporation; United States; On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Full benefits package

PTO, medical, dental, vision

401(k) with match

Wellness program

Job summary

ComPsych Corporation in the United States is seeking a Senior SDET who will own AI-driven quality across our customer-facing web and mobile experiences. You’ll define verification methods, drive automation, and ensure robust signal quality for non-deterministic outputs, with PHI guardrails and production-grade testing.

You’ll partner with Platform, Engineering, Product, and Design to set testability standards, manage synthetic data, and prevent hallucinations or unsafe outputs while shipping

Qualifications

• Experience verifying AI-powered products with non-deterministic outputs.
• Ability to design evaluation approaches and rubrics with thresholds.
• Experience building testing frameworks and data guardrails.

Responsibilities

• Define verification methods for AI-powered features and release criteria.
• Own the team's quality strategy and risk-based verification.
• Develop automation and evaluation tooling for model, prompt, and retrieval changes.
• Ensure fast, actionable test feedback and bug isolation.
• Manage synthetic data and PHI guardrails in CI environments.
• Collaborate with Platform to set environment and non-functional quality requirements.

Skills

AI-first mindset

Test automation

Concurrency & async

Observability & debugging

Root cause analysis

Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Automation frameworks

CI/CD pipelines

Model evaluation tooling

Golang/Java/Python

Job description

ComPsych Corporation in the United States is seeking a Senior SDET who will own AI-driven quality across our customer-facing web and mobile experiences. You’ll define verification methods, drive automation, and ensure robust signal quality for non-deterministic outputs, with PHI guardrails and production-grade testing.

You’ll partner with Platform, Engineering, Product, and Design to set testability standards, manage synthetic data, and prevent hallucinations or unsafe outputs while shipping