Senior Director, Technical Product Management — AI Quality & Evaluation

100 Salesforce, Inc.

San Francisco (CA)

Hybrid

USD 218,000 - 365,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Salesforce is seeking a technical product leader to shape the next generation of Agentforce, blending startup speed with enterprise scale. You will own AI quality and evaluation, lead customer investigations, and drive cross-functional delivery with researchers, engineers, and designers.

This is a hands-on IC leadership role with growth potential. You will work closely with customers to define success, prototype with coding agents, and guide product decisions through credible evaluation and

Qualifications

  • Minimum Requirements include building AI/ML products with ownership and measurable impact.
  • Hands-on experience with AI agents and evaluation capabilities.
  • Strong AI/ML judgment across model behavior, prompting and tool workflows.
  • Ability to inspect data and traces, prototype with coding agents, and reason about experiments.
  • Clear communication with customers and senior leaders, even in uncertain situations.
  • Ability to work independently in a fast-moving environment and mentor others.

Responsibilities

  • Set a coherent product strategy and roadmap for AI quality and evaluation, aligning customer needs with technical opportunities and measurable outcomes.
  • Establish shared quality definitions, evaluation requirements, and release criteria with research, engineering, and product partners.
  • Lead customer investigations and experiments to test changes and validate impact.
  • Build an operating approach that connects customer feedback, evaluation evidence, and learning across teams.
  • Coach product partners, designers, and TPMs in problem framing, experimentation, and delivery.
  • Communicate differentiation and investment choices clearly to customers and senior stakeholders.

Skills

AI/ML products
Customer outcomes
Data inspection
Coding agents
Experiment design
Communication

Tools

Coding agents

Job description

Job Category Product Job Details

About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

What You’ll Be Doing & Why It Matters

Help build the next generation of Agentforce. We’re an entrepreneurial incubation team within Salesforce, combining the pace and ownership of a startup with access to enterprise customers and Salesforce’s distribution. We’re looking for a technical product leader with deep AI expertise who wants to turn frontier capabilities into products customers can rely on. Our team works closely with AI researchers, applied scientists, and engineers, uses coding agents extensively, and builds and experiments outside the core platform to iterate quickly. You’ll shape product strategy for AI quality and evaluation, establish how we measure progress, and personally lead a customer quality workstream and a focused feature from early learning through delivery. This is a hands‑on individual contributor leadership role, with an IC focus expected through 2027. You’ll lead through product ownership, technical judgment, and cross‑functional influence while coaching colleagues, including junior designers and technical program managers. People‑management responsibilities may develop as the product and team grow. You should enjoy inspecting traces and data, challenging evaluation results, prototyping with coding agents, and working directly with customers. Engineering partners own technical architecture and production implementation.

Core Responsibilities & Scope
  • Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
  • Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
  • Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
  • Personally lead customer investigations and experiments. For example, investigate why an agent gives an incorrect answer or fails a tool‑driven workflow, define the expected behavior, and partner with researchers and engineers to test a change and validate its customer impact.
  • Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
  • Partner with researchers, applied scientists, and engineers to design credible evaluations.
  • Apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non‑deterministic model behavior and grader reliability.
  • Lead delivery of capabilities that help customers understand and improve AI performance. For example, prototype an experience that turns a failed agent interaction into an evaluation case, makes the quality gap clear, and helps a customer verify whether a proposed change works.
  • Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example.
  • Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.
Minimum Requirements

A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact. Deep hands‑on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact. Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements. Current hands‑on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. You can define what good looks like for a non‑deterministic system and challenge conclusions with technical partners. Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. You can explain when lessons from a previous product apply and when the context demands a different approach. Experience establishing shared standards and resolving cross‑team disagreements while preserving clear accountability and delivery momentum. Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast‑moving environment. Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.

Preferred Qualifications

Evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products. Building in an AI‑native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from both successful and unsuccessful experiments. Hands‑on prototyping with coding agents and delivery of customer‑facing performance or outcome experiences. Leading initiatives that require agreement across research, engineering, product, and customer‑facing organizations.

What success looks like

Customers see credible improvement in real agent workflows, supported by evaluations they can trust. You independently take an initial quality problem from failure analysis through experimentation and customer validation, and deliver a focused feature with engineering. Teams make better release and investment decisions because of the evidence, product judgment, and coaching you bring.

Accommodations

If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non‑discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education. In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com. Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $218,400 - $365,200 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $263,200 - $401,400 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.

Additional Information

We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you've come to the right place.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Director, Technical Product Management — AI Quality & Evaluation
Senior Director, Technical Product Management — AI Quality & Evaluation

Salesforce • Seattle (WA)

On-site
USD 218,000 - 365,000
Lead Software Engineer, AI Labs (Product and Customer Facing)
Lead Software Engineer, AI Labs (Product and Customer Facing)

Salesforce, Inc. • San Francisco (CA)

On-site
USD 149,000 - 314,000
Software Engineering, AI Systems (PMTS)
Software Engineering, AI Systems (PMTS)

100 Salesforce, Inc. • San Francisco (CA)

On-site
USD 238,000 - 345,000
Medical
Dental
Vision
+2
Full Stack Engineer - Senior/Lead - Office of the CEO
Full Stack Engineer - Senior/Lead - Office of the CEO

Salesforce, Inc. • San Francisco (CA)

On-site
USD 173,000 - 260,000
Software Engineering - Principal
Software Engineering - Principal

100 Salesforce, Inc. • San Francisco (CA)

Hybrid
USD 237,000 - 344,000
Health insurance
401(k) plan
Employee stock purchase program
AI Labs Rotational Fellowship, Emerging Talent
AI Labs Rotational Fellowship, Emerging Talent

Salesforce, Inc. • San Francisco (CA)

On-site
USD 114,000 - 136,000
Mentorship programs
Talent development courses
Applied Research Engineer
Applied Research Engineer

Salesforce, Inc. • San Francisco (CA)

On-site
USD 197,000 - 314,000
Time off programs
Medical insurance
Dental insurance
+6
Principal AI Solutions Engineer - Salesforce AI Labs
Principal AI Solutions Engineer - Salesforce AI Labs

Salesforce, Inc. • San Francisco (CA)

On-site
USD 237,000 - 317,000
Software Engineering SMTS / LMTS - AI Core (REMOTE)
Software Engineering SMTS / LMTS - AI Core (REMOTE)

Salesforce, Inc. • United States

Remote
USD 173,000 - 260,000
Software Engineering SMTS / LMTS - AI Core (REMOTE)
Software Engineering SMTS / LMTS - AI Core (REMOTE)

Salesforce • Oregon

Hybrid
USD 173,000 - 286,000