Senior AI Platform Engineer: Evaluation & Launch Readiness

Nrg Bluewater Wind; Lehi, Northern (UT, KY); Hybrid; USD 165,000 - 240,000; Full time

Benefits offered by this job

Free daily lunch and drinks on site

Paid holidays and flexible paid time

Onsite health clinic

401(k) + Employer Match

Employee Discounts

Job summary

Vivint Smart Home in Lehi, Utah is seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. You will create evaluation, observability, safety, and launch-readiness infrastructure to ship AI features with measurable quality and impact.

You will own datasets and evaluation suites, develop observability for model quality, latency, cost and safety, and define launch-readiness gates across camera, personalization, multimodal, and energy

Qualifications

• Bachelor's degree in CS/SE/Data Science or related field.
• 10+ years of software/ML engineering or AI platform experience.
• Experience evaluating, deploying, or monitoring production AI systems.
• Strong Python and data engineering skills.
• Experience with offline/online evaluation, data quality, model monitoring, or observability systems.
• Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails.
• Strong communication skills and ability to set standards across teams.

Responsibilities

• Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
• Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance.
• Develop observability for model quality, latency, cost, drift, safety, and customer impact.
• Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
• Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
• Define reusable standards for AI quality, monitoring, safety, and operational readiness.

Skills

Python

Data engineering

AI platform

Model evaluation

Observability

Communication

Safety guardrails

Education

Bachelors in CS/SE/Data Science

Tools

GCP/AWS

Vertex AI

SageMaker

MLflow

Datadog

OpenTelemetry

Job description

Vivint Smart Home in Lehi, Utah is seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. You will create evaluation, observability, safety, and launch-readiness infrastructure to ship AI features with measurable quality and impact.

You will own datasets and evaluation suites, develop observability for model quality, latency, cost and safety, and define launch-readiness gates across camera, personalization, multimodal, and energy