Senior Staff AI Platform Engineer - GenAI & ML Evaluation

Pinterest; Palo Alto (CA); Hybrid; USD 258,000 - 429,000; Full time

Job summary

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform team to scale Pinterest’s AI/ML evaluation platform for GenAI workloads across the company. You will shape the roadmap, drive modernization, and ensure reliable, high-quality evaluations that inform product decisions.

Collaborating with engineering, research, product, and safety, you will establish evaluation standards, metrics, and governance to deliver trusted AI-powered experiences and robust launch decisions.

Qualifications

• 3+ years of designing and operating evaluation systems for GenAI/ML
• Strong Python programming and distributed systems knowledge
• Experience with GenAI evaluation libraries and frameworks

Responsibilities

• Identify modernization opportunities and scale the roadmap for a company-wide evaluation system
• Define cross-team technical strategy and drive adoption of shared evaluation capabilities
• Make durable architectural decisions to improve user experience and reliability of the evaluation platform
• Establish evaluation methodologies balancing automated metrics and human judgment
• Lead cross-team workstreams and manage risks to deliver impact

Skills

Python

Distributed systems

AI tooling

Education

Bachelor’s degree in Computer Science or Engineering or related field

Tools

AutoEvals

OpenEvals

Ragas

Job description

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform team to scale Pinterest’s AI/ML evaluation platform for GenAI workloads across the company. You will shape the roadmap, drive modernization, and ensure reliable, high-quality evaluations that inform product decisions.

Collaborating with engineering, research, product, and safety, you will establish evaluation standards, metrics, and governance to deliver trusted AI-powered experiences and robust launch decisions.