Senior SDET — AI Testing & Automation

Salesforce; Bellevue (WA); On-site; USD 149,000 - 246,000; Full time

Job summary

Salesforce Software Quality Senior Member of Technical Staff (SMTS) is seeking an enthusiastic engineer to drive AI-first testing and validation for enterprise-grade applications. You will define quality strategies, build scalable tests, and work with product development, AI, and data science teams to ensure production-ready outcomes.

This role emphasizes white-box testing, LLM integration validation, and fast-paced CI/CD delivery.

Qualifications

• Strong Java fundamentals; data structures and algorithms.
• Hands-on experience validating Large Language Models (LLMs) and AI evaluation frameworks.
• Proven track record delivering automation solutions in a fast-paced CI/CD environment.
• Excellent communication and collaboration across product, AI/ML, and data science teams.

Responsibilities

• Design and maintain AI-first testing frameworks and automation suites to validate complex workflows.
• Translate quality strategies into actionable automation plans for QA and CI/CD.
• Perform white-box testing, debug code, and reduce test flakiness across components.
• Evaluate model outputs for relevance, safety, and contextual accuracy in production environments.
• Collaborate with cross-functional teams to embed quality early in the agile delivery lifecycle.

Skills

Java fundamentals

AI/LLM validation

CI/CD automation

Cross-functional collaboration

Problem-solving & analysis

Job description

Salesforce Software Quality Senior Member of Technical Staff (SMTS) is seeking an enthusiastic engineer to drive AI-first testing and validation for enterprise-grade applications. You will define quality strategies, build scalable tests, and work with product development, AI, and data science teams to ensure production-ready outcomes.

This role emphasizes white-box testing, LLM integration validation, and fast-paced CI/CD delivery.