Senior ML Engineer - AI Content Evaluation Lead

Pattern; Lehi (UT); Hybrid; USD 130,000 - 190,000; Full time

Benefits offered by this job

Unlimited PTO

Paid Holidays

Onsite Fitness Center

401(k) match

Job summary

Pattern seeks a Senior Machine Learning Engineer to own evaluation systems for its generative content platform. You will build datasets, rubrics, and automated judges, and own model-side improvements across non-deterministic outputs for hundreds of thousands of listings.

You will partner with data science and brand teams to set thresholds, quantify qualitative gains, and reduce rework by enforcing quality gates before brand review. This role is hybrid, based in Lehi, UT.

Qualifications

• Strong code and system design experience in any language or stack.
• 3+ years owning production software services end to end.
• Formal statistics or machine learning training, or equivalent depth built on the job.
• Experience engineering systems with non-deterministic outputs where correctness is measured.
• Nice to have: LoRA/PEFT, LLM or generative media production, evaluation-system ownership.

Responsibilities

• Build and maintain datasets, rubrics, and automated judges evaluating content engine changes.
• Convert brand rejection reasons into labeled training data for model improvements.
• Quantify qualitative improvements to generated content.
• Define and defend approval thresholds for generated content with data science and brand teams.
• Build quality gates to catch problematic outputs before brand review.

Skills

Code and system design

Production services ownership

Statistics / ML training

Non-deterministic system engineering

LoRA/PEFT (nice to have)

Job description

Pattern seeks a Senior Machine Learning Engineer to own evaluation systems for its generative content platform. You will build datasets, rubrics, and automated judges, and own model-side improvements across non-deterministic outputs for hundreds of thousands of listings.

You will partner with data science and brand teams to set thresholds, quantify qualitative gains, and reduce rework by enforcing quality gates before brand review. This role is hybrid, based in Lehi, UT.