Senior Staff AI Platform Engineer: ML Eval & GenAI

United States

Hybrid

USD 209,000 - 429,000

Full time

4 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Pinterest is hiring a Senior Staff Software Engineer for the AI Platform team. You will shape and scale Pinterest’s AI/ML evaluation system across the company, guiding modernization and safe, reliable deployments for GenAI workloads.

Join a cross-functional group partnering with engineering, research, product, and safety to raise the bar on evaluation quality, launch decisions, and trust in AI-powered experiences.

Qualifications

3+ years designing and operating evaluation systems for GenAI/ML.
Experience with benchmark design, golden datasets, automated metrics, human evaluation, model grading, and failure analysis.
5+ years building scalable platforms for distributed experimentation, versioning, observability and release management.

Responsibilities

Identify modernization opportunities and scale the roadmap for a company-wide evaluation system.
Define cross-team strategy, align partner teams, and drive broad adoption of shared evaluation capabilities.
Make durable architectural decisions to improve UX and reliability of the AI/ML evaluation platform.
Establish evaluation methodologies balancing automated metrics, human feedback, and safety outcomes.
Lead complex cross-team workstreams, resolve tradeoffs and deliver impact.

Skills

Python

Distributed systems

GenAI

RecSys

AutoEvals

OpenEvals

Ragas

Education

Bachelor’s degree in Computer Science or related field

Tools

OpenEvals

AutoEvals

Ragas

Job description

Join a cross-functional group partnering with engineering, research, product, and safety to raise the bar on evaluation quality, launch decisions, and trust in AI-powered experiences.

Get your free, confidential resume review.

or drag and drop your file here.