Senior AI Testing & Assurance Engineer (Remote)

Omada Health; United States; On-site; USD 179,000 - 224,000; Full time

Benefits offered by this job

Remote-first culture

Generous parental leave

Health, dental, and vision insurance

401k retirement savings plan

LSA - Lifestyle Spending Account

Mental Health Support

Job summary

Omada Health is seeking a Senior Software Engineer to join our agentic systems team, shaping AI-enabled testing across Engineering, Product, and Design. You’ll build tools and automated tests that fit engineers’ workflows, integrate with Claude, VS Code, and GitLab, and scale testing for mobile, web, and backend systems.

You will collaborate with security, compliance, and infra teams to safeguard PHI data, mentor teammates, and help define quality gates in release processes.

Qualifications

• 6+ years of experience in a Software Engineering or SDET role.
• Recent hands-on experience with agentic model harnesses and automated test orchestration.
• Strong experience building and maintaining automated tests and Gitlab CI/CD workflows.
• Experience with at least one modern test automation framework (e.g., Playwright, Appium, Cypress).
• Familiarity with mobile app testing, API testing, and web testing.
• Experience integrating and maintaining third-party QA and monitoring tools.
• Ability to collaborate cross-functionally, translate real-world workflows into technical requirements, and communicate tradeoffs clearly.
• Brilliant communication and documentation skills.
• Experience building Slack apps, chatops tooling, or similar conversational interfaces for internal teams.
• Familiarity with observability tools and practices to track AI usage, reliability, and cost over time.
• Practical experience managing infrastructure on AWS with Terraform
• Familiarity with AWS cloud infrastructure and secure-by-default patterns for handling secrets, credentials, and sensitive data.
• Background working in healthcare or other regulated industries where PHI/PII handling, auditability, and compliance are critical.

Responsibilities

• Design and build software testing tools that integrate with engineers’ day-to-day environments (e.g., Claude, VS Code, GitLab, Datadog, internal documentation, Slack chatops).
• Build and maintain automated test infrastructure that supports mobile, web, and backend engineering teams.
• Define AI-augmented software testing patterns and quality gates in our release management system
• Instrument and monitor AI usage, performance, and cost to help the team and engineering leadership understand our impact and our organizational maturity.
• Collaborate with security, compliance, and infrastructure teams to ensure that AI workflows are designed to handle PHI and other sensitive data safely.
• Create reusable examples, templates, and internal libraries that make it easy for teams to adopt AI-powered quality workflows
• Contribute to training, documentation, and office hours that help engineers, PMs, and designers become confident automated test users and partners.

Skills

SDET experience

Agentic model harnesses

GitLab CI/CD

Playwright/Cypress

AWS Terraform

Observability

Security & PHI handling

Tools

Playwright

Cypress

Terraform

GitLab

Datadog

Job description

Omada Health is seeking a Senior Software Engineer to join our agentic systems team, shaping AI-enabled testing across Engineering, Product, and Design. You’ll build tools and automated tests that fit engineers’ workflows, integrate with Claude, VS Code, and GitLab, and scale testing for mobile, web, and backend systems.

You will collaborate with security, compliance, and infra teams to safeguard PHI data, mentor teammates, and help define quality gates in release processes.