Lead Big Data & AI Platform Architect

Pinterest; San Francisco (CA); Hybrid; USD 243,000 - 500,000; Full time

Job summary

Pinterest is seeking a Principal Software Engineer to lead the next generation of data infrastructure powering big data and AI applications. You’ll drive architecture, scale compute engines, and guide data processing at exabyte-scale to empower Pinners’ experiences.

The role emphasizes collaboration, deep expertise in big data and Kubernetes, and leadership across teams. In-office presence 1–2 times per quarter is required; US-based applicants only.

Qualifications

• 12+ years of industry experience with a proven track record of technical excellence.
• 8+ years of experience building and support large scalable Kubernetes or big data platform.
• Deep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow).
• Proficiency in one or more programming languages (Java, Go, Scala, Python).
• Experiences in Kubernetes and AWS technologies.
• Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress.
• Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.

Responsibilities

• Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications.
• Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling.
• Work with internal customers on critical business use cases that rely on big data.
• Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale.
• Contribute to the team’s technical vision and long-term roadmap.

Skills

Kubernetes

Big Data

Data infra

Java

Python

Go

Scala

AWS

Leadership

Collaboration

Education

Bachelor's in CS

Tools

Flink

Spark

Presto

Kubernetes

Ray

PyTorch

TensorFlow

AWS

Job description

Pinterest is seeking a Principal Software Engineer to lead the next generation of data infrastructure powering big data and AI applications. You’ll drive architecture, scale compute engines, and guide data processing at exabyte-scale to empower Pinners’ experiences.

The role emphasizes collaboration, deep expertise in big data and Kubernetes, and leadership across teams. In-office presence 1–2 times per quarter is required; US-based applicants only.