Senior SDET: AI-First Testing & Automation Tools

Salesforce; San Francisco (CA); On-site; USD 173,000 - 286,000; Full time

Job summary

Salesforce is seeking a Software Quality Lead LMTS to help infuse AI-first testing across RAO’s Sales Agent and Forecasting products. You’ll design and implement scalable QA frameworks, validate LLM integrations, and push deterministic behaviors within enterprise-grade workflows.

You’ll collaborate with product managers, data scientists, and AI engineers to accelerate velocity and accuracy, tackle test flakiness, and ensure high reliability of AI-powered sales automation for global teams.

Qualifications

• Strong Java fundamentals, data structures and algorithms.
• Hands-on experience evaluating Large Language Models (LLMs) for quality responses.
• Proven track record delivering automation solutions in CI/CD environments.
• Excellent cross-functional collaboration with product managers, engineers, and data scientists.
• Strong analytical and problem-solving abilities with focus on quality improvement.

Responsibilities

• Design, build, and maintain scalable, AI-first testing frameworks and automation suites.
• Translate quality strategies into actionable automation plans for RAO workflows.
• Perform white-box testing and contribute to fixing code and test flakiness.
• Implement evaluation processes for subjective quality dimensions of AI features.
• Collaborate with RAO ecosystem partners to ensure quality is integrated early in the lifecycle.

Skills

Java

AI/LLM validation

Agile delivery

Collaboration

Problem-solving

Tools

AWS

Azure

GCP

Job description

Salesforce is seeking a Software Quality Lead LMTS to help infuse AI-first testing across RAO’s Sales Agent and Forecasting products. You’ll design and implement scalable QA frameworks, validate LLM integrations, and push deterministic behaviors within enterprise-grade workflows.

You’ll collaborate with product managers, data scientists, and AI engineers to accelerate velocity and accuracy, tackle test flakiness, and ensure high reliability of AI-powered sales automation for global teams.