Senior Staff AI Platform Engineer – GenAI Evaluation (Equity)

Showcify, Inc.; Palo Alto (CA); Híbrido; USD 209.000 - 429.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Equity

Base salary transparency

Descripción de la vacante

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform to scale the AI/ML evaluation system across the company, shaping modernization and execution of a durable evaluation framework for GenAI workloads.

You will partner with engineering, research, product, and safety to improve quality, launch decisions, and trust in AI-powered experiences. In-office collaboration is 1-2 times per quarter, with a US-wide setup.

Formación

• 3+ years of deep hands-on experience designing evaluation systems for GenAI/ML
• Strong Python programming with understanding of distributed systems

Responsabilidades

• Identify modernization opportunities and scale the roadmap for a company-wide evaluation system
• Define cross-team technical strategy and drive broad adoption of shared evaluation capabilities
• Make durable architectural decisions that improve user experience and reliability of the AI/ML evaluation platform
• Establish evaluation methodologies balancing automated metrics, human input, safety and business outcomes
• Lead cross-team workstreams and manage technical tradeoffs and risks

Conocimientos

Python

Distributed systems

GenAI evaluation

Experimentation concepts

Educación

Bachelor's degree in CS/Engineering

Herramientas

AutoEvals

OpenEvals

Ragas

Descripción del empleo

Pinterest is seeking a Senior Staff Software Engineer for the AI Platform to scale the AI/ML evaluation system across the company, shaping modernization and execution of a durable evaluation framework for GenAI workloads.

You will partner with engineering, research, product, and safety to improve quality, launch decisions, and trust in AI-powered experiences. In-office collaboration is 1-2 times per quarter, with a US-wide setup.