Senior AI Platform Engineer — Evaluation & Safety

Vivint; Washington; On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Free lunch

Drinks on site

Paid holidays

Health clinic onsite

401(k) employer match

Employee discounts

Innovation Weeks

Job summary

Vivint is seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. You will create the evaluation, observability, safety, and launch-readiness infrastructure needed to ship AI features with measurable quality, reliability, and customer impact.

You will own datasets, evaluation suites, and governance across models, prompts, and multimodal components, collaborating with Product, Privacy, Security, and Engineering to raise trustworthy AI

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Data Science, or related field.
• 10+ years of software/ML platform experience in AI systems.
• Experience evaluating, deploying, or monitoring production AI systems.
• Strong Python and data engineering skills.
• Experience with offline/online evaluation, data quality, model monitoring, or observability.
• Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails.

Responsibilities

• Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
• Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance.
• Develop observability for model quality, latency, cost, drift, safety, and customer impact.
• Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
• Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
• Define reusable standards for AI quality, monitoring, safety, and operational readiness.

Skills

Python

Data engineering

LLM evaluation

Observability

Communication

Production AI systems

Education

Bachelor's degree in CS/SE/DS or related field

Tools

GCP/AWS

Vertex AI

SageMaker

Datadog

OpenTelemetry

Job description

Vivint is seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. You will create the evaluation, observability, safety, and launch-readiness infrastructure needed to ship AI features with measurable quality, reliability, and customer impact.

You will own datasets, evaluation suites, and governance across models, prompts, and multimodal components, collaborating with Product, Privacy, Security, and Engineering to raise trustworthy AI