Senior AI Testing & Automation Engineer - Tooling

salesforce.com, inc.; San Francisco (CA); On-site; USD 173,000 - 260,000; Full time

Job summary

Salesforce is seeking a Software Quality Lead LMTS to drive AI-first testing and automation for Revenue Action Orchestration. You will design, implement and validate RAO workflows, focusing on LLM integrations, prompt accuracy, and robust testing strategies.

You will work with cross-functional teams across product, data science, and AI to deliver high-quality, scalable AI-driven sales automation solutions for enterprise customers.

Qualifications

• Strong Java skills with data structures and algorithms.
• Hands-on experience evaluating LLMs and AI evaluation frameworks.
• Proven track record delivering automation in CI/CD environments.
• Excellent cross-functional collaboration and communication.
• Strong analytical and problem-solving abilities.

Responsibilities

• Design, build, and maintain scalable, AI-first testing frameworks and automation for RAO workflows.
• Translate quality strategies into actionable automation plans for LLM integrations and prompt accuracy.
• Perform white-box testing and contribute to fixing code and test flakiness.
• Contribute to evaluation processes for AI feature quality, safety, and accuracy.
• Collaborate with product, engineering, and data science teams to embed quality early in delivery.

Skills

Java skills

AI/LLM validation

CI/CD automation

Collaboration & communication

Problem solving & analytics

Tools

AWS/Azure/GCP

Salesforce platform knowledge

White-box testing

Job description

Salesforce is seeking a Software Quality Lead LMTS to drive AI-first testing and automation for Revenue Action Orchestration. You will design, implement and validate RAO workflows, focusing on LLM integrations, prompt accuracy, and robust testing strategies.

You will work with cross-functional teams across product, data science, and AI to deliver high-quality, scalable AI-driven sales automation solutions for enterprise customers.