Senior AI Platform Engineer — GenAI Evaluation

Pinterest; United States; Hybride; USD 209 000 - 429 000; Plein temps

Résumé du poste

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform team to scale our AI/ML evaluation platform across the company. You will shape architecture, set the roadmap, and collaborate with research, product, and safety to improve quality and trust in AI-powered experiences.

You'll drive cross-team initiatives, define evaluation standards, and deliver durable solutions for GenAI workloads, with a hybrid in-office requirement and a base US salary range of $208,592 to $429,454 per

Qualifications

• 3+ years designing and operating evaluation systems for GenAI and ML.
• Strong Python programming and distributed systems knowledge.
• Familiar with GenAI evaluation libraries like AutoEvals, OpenEvals, Ragas.
• 5+ years building scalable platforms for distributed experimentation and release monitoring.
• Strong judgment on GenAI risks (robustness, bias, privacy, security).
• Bachelor’s degree in CS/Engineering or equivalent.

Responsabilités

• Identify modernization opportunities and scale the company-wide evaluation system.
• Define cross-team technical strategy and drive adoption of shared eval capabilities.
• Make durable architectural decisions for the eval platform.
• Establish evaluation methodologies balancing metrics, human feedback, safety, and outcomes.
• Lead cross-team workstreams and manage risks to deliver impact.

Connaissances

GenAI evaluation

Python programming

Distributed systems

OpenEvals/Ragas

Experimentation platforms

Cross-team collaboration

Risk judgment

Formation

Bachelor's degree in CS/Engineering

Outils

AI tools

Description du poste

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform team to scale our AI/ML evaluation platform across the company. You will shape architecture, set the roadmap, and collaborate with research, product, and safety to improve quality and trust in AI-powered experiences.

You'll drive cross-team initiatives, define evaluation standards, and deliver durable solutions for GenAI workloads, with a hybrid in-office requirement and a base US salary range of $208,592 to $429,454 per