Director, AI Quality & Evaluation

Salesforce, Inc.; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid parental leave

401(k) plan

Employee stock purchase plan

Job summary

Salesforce, Inc. is seeking an experienced AI product leader to set direction for quality and evaluation in an early-stage product group.

You will turn frontier AI capabilities into dependable customer experiences through discovery, lead from an individual contributor role, and guide focused features from discovery to delivery, collaborating with researchers, applied scientists, and engineers. You will build roadmaps, define evaluation standards, investigate customer problems, and ensure

Qualifications

• Track record of building AI/ML products and delivering measurable customer outcomes with increasing ownership.
• Deep hands-on experience building AI agents and evaluation capabilities alongside AI research, applied science, or engineering teams.
• Strong understanding of AI/ML fundamentals and evaluation reliability.
• Product leadership skills, including prioritisation, customer investigation, experimentation, and clear communication of trade-offs.
• Comfort inspecting interaction traces and data, prototyping with coding agents, and working directly with customers.

Responsibilities

• Create a roadmap that connects customer needs, technical opportunities, and measurable outcomes.
• Define shared quality measures, evaluation coverage, and release criteria with research, engineering, and product partners.
• Investigate customer failures, define expected behaviour, run experiments, and validate whether changes improve outcomes.
• Apply sound evaluation practices to non-deterministic AI, including representative coverage, independent validation, and checks for overfitting.
• Lead a customer-facing capability that helps people understand AI performance and turn failed interactions into evaluation cases.
• Build a feedback and learning process across customer input, evaluation evidence, experiments, and releases.
• Coach product partners, designers, and programme managers in problem framing, experimentation, and delivery.

Skills

AI product leadership

Hands-on AI/ML

Experimentation

Customer investigation

Job description

Salesforce, Inc. is seeking an experienced AI product leader to set direction for quality and evaluation in an early-stage product group.

You will turn frontier AI capabilities into dependable customer experiences through discovery, lead from an individual contributor role, and guide focused features from discovery to delivery, collaborating with researchers, applied scientists, and engineers. You will build roadmaps, define evaluation standards, investigate customer problems, and ensure