Associate Evaluations Manager

Salesforce; California (MO); On-site; USD 120,000 - 170,000; Full time

Job summary

Salesforce is seeking an Associate Evaluations Manager for the Digital Success Data & AI team. You will measure, monitor, and improve Agentforce performance on Salesforce Help, with emphasis on quality, latency, and instruction adherence.

You will build scalable evaluation frameworks, collaborate with Support Delivery, Engineering, Operations, and Data Science, and translate results into defensible insights guiding product decisions and launches.

Qualifications

• 1+ years of experience in Salesforce environments or similar.
• Strong analytical mindset with ability to translate findings into actions.
• Operational rigor to execute repeatable evaluation workflows.
• Clear written communication for cross-functional audiences.
• Comfort with data, spreadsheets, dashboards, and trends.
• Strong reading comprehension and critical thinking.
• Fluency with Salesforce reporting tools or quick ramp on similar tools.
• Curiosity and learning agility to adapt to evolving AI behaviors.

Responsibilities

• Support the Agentforce baselining program using synthetic and automated tooling.
• Analyze evaluation results, identify root causes, surface trends, and propose recommendations.
• Maintain and evolve evaluation frameworks, rubrics, and guidelines.
• Deliver clear reporting and business reviews to inform decisions.
• Define, monitor, and interpret key evaluation metrics and risks.
• Enable internal partners on evaluation processes and findings.
• Strengthen the evaluation feedback loop across testing and datasets.
• Perform targeted evaluations for new features and urgent initiatives.
• Audit and refine the utterance repository to stay current.
• Synthesize customer and internal feedback into actionable insights.
• Advocate for tooling, process, and workflow improvements.
• Proactively surface risks and partner on mitigations.

Skills

Salesforce experience

Analytical mindset

Operational rigor

Clear communication

Data fluency

Reading comprehension

Tool proficiency

Learning agility

Tools

Salesforce reporting environments

Tableau

Testing Center

Observability

Job description

Job Category

Program & Project Management

Job Details

About Salesforce

Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

As an Associate Evaluations Manager on the Digital Success Data & AI team, you will help measure, monitor, and improve the performance of Agentforce on Salesforce Help. You will execute ongoing synthetic evaluations across Answer Quality, latency, instruction adherence, and other core capabilities, translating results into clear, actionable insights that inform product decisions, operational improvements, and leadership reporting.

You will contribute to operational excellence by building clear documentation, repeatable processes, and scalable evaluation frameworks that increase confidence in agent performance. This role partners closely with Support Delivery, Engineering, Operations, and Data Science to evaluate new features, identify risks and opportunities, and ensure quality at launch.

You will also help evolve our evaluation ecosystem by refining LLM judge prompts, golden datasets, and evaluation assets while identifying opportunities to increase automation, reliability, and efficiency. Success in this role requires analytical rigor, curiosity, and ownership-someone comfortable working through ambiguity, solving problems end-to-end, and consistently delivering defensible insights that drive action.

Your Impact

• Support the Agentforce baselining program, using synthetic and automated tooling to continuously measure and improve performance.
• Analyze evaluation results independently, identifying root causes, surfacing trends, and translating insights into actionable recommendations for models, implementations, and processes.
• Maintain and evolve evaluation frameworks, scoring rubrics, and guidelines to ensure consistent, defensible, and scalable assessments.
• Deliver clear, influential reporting and business reviews that inform stakeholders and drive product and operational decisions.
• Define, monitor, and interpret key evaluation metrics, proactively identifying risks, regressions, and improvement opportunities.
• Enable internal partners on evaluation processes and findings, building trust and shared understanding across teams.
• Strengthen the evaluation feedback loop across automated testing, LLM-judge prompts, and golden datasets to continuously improve testing sophistication.
• Perform targeted evaluations for new features and urgent initiatives, ensuring quality and market readiness.
• Audit and refine the utterance repository to keep testing relevant, high quality, and aligned with evolving product capabilities.
• Synthesize customer and internal feedback into actionable insights, helping shape product direction and operational improvements.
• Advocate for tooling, process, and workflow improvements that increase evaluation efficiency, scalability, and reliability.
• Proactively surface risks and partner on mitigations, ensuring issues are addressed before they impact customers.

Required Skills

• 1+ years of professional experience working in Salesforce environments (program, analyst, operations, or product context). Demonstrated ability to take ownership of tasks and drive outcomes independently.
• Strong analytical mindset: comfortable reviewing conversational AI outputs, identifying failure patterns, conducting root cause analysis, and translating findings into actionable recommendations.
• Operational rigor and attention to detail: able to execute repeatable evaluation workflows accurately and consistently in a fast-paced, ambiguous environment.
• Clear written communication skills: able to document findings, produce internal documentation, and communicate insights concisely for cross-functional audiences.
• Comfort working with data: proficiency in spreadsheets (e.g., Google Sheets), reporting, and basic dashboard interpretation to derive insights and track trends.
• High reading comprehension and critical thinking: able to evaluate nuanced generative AI responses against quality standards and expected behaviors.
• Tool fluency: ability to work confidently in Salesforce reporting environments (Agentforce, Tableau, Testing Center, Observability) or quickly ramp on similar tools.
• Curiosity and learning agility: resourceful in exploring new tools, understanding evolving AI behaviors, and continuously improv