Real-Time Data Platform Engineer for AI Personalization

Sierra AI; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Job summary

Sierra AI is seeking a senior data/platform engineer to join our in-person team in San Francisco. You will design and operate large-scale data systems, with real-time pipelines and a focus on fast, trustworthy analytics across millions of conversations.

You will work on long-term agent memory, CDP primitives, and improve personalization loops to lift business outcomes. A strong emphasis on performance, API design, and cross-functional collaboration guides the role.

Qualifications

• 4–7+ years of hands-on development experience
• Experience building large-scale data systems and pipelines
• Proficiency in Go, Scala, or Python
• Experience with Spark, Flink, Trino/Presto
• Knowledge of Iceberg or Hudi data lakehouse
• Data governance, lineage, and testing practices
• Experience with ML-powered product features such as personalization or recommendations

Responsibilities

• Architect and build the core data platform to handle data at scale with low latency
• Develop real-time pipelines, analytics products, and personalization primitives
• Own interactive OLAP querying, orchestration, and experimentation layers
• Build systems for long-term agent memory and reusable CDP primitives
• Implement data models and optimize analytical query patterns for OLAP and cloud warehouses

Skills

Backend development

Full-stack engineering

Data modeling

ML features

Event streaming

Education

Bachelor's in CS or related field

Tools

Spark

Flink

Trino/Presto

Iceberg

Hudi

Go

Scala

Python

Kafka

Kinesis

ECharts

D3.js

Job description

Sierra AI is seeking a senior data/platform engineer to join our in-person team in San Francisco. You will design and operate large-scale data systems, with real-time pipelines and a focus on fast, trustworthy analytics across millions of conversations.

You will work on long-term agent memory, CDP primitives, and improve personalization loops to lift business outcomes. A strong emphasis on performance, API design, and cross-functional collaboration guides the role.