Senior ML Engineer, Nova AI Platform

Iterable, Inc.; Atlanta (GA); On-site; USD 150,000 - 250,000; Full time

Job summary

Iterable is the AI customer engagement platform trusted by global brands. We are seeking a Senior Machine Learning Engineer to drive evaluation and automatic optimization for Nova, leading models and agents from research to production.

You will own evaluation loops, improve prompts and tools, and connect real interactions to measurable product improvements. You’ll work with Nova retrieval and product teams, gaining autonomy from research through production.

Qualifications

• 5+ years hands-on MLE experience deploying ML systems at scale.
• Master's or PhD in CS/ML/AI or related field.
• Shipping reliable changes that measurably improve product experience.
• Strong Python and modern ML frameworks experience.

Responsibilities

• Build evaluation systems for models and agents: benchmarks, LLM judges, simulations, trajectory analysis, and regression tests.
• Create a loop that takes failures from diagnosis to fix to measured improvement.
• Turn evaluation results into automatic optimization of prompts, context, tools, rubrics, and agent harnesses.
• Build synthetic data pipelines for evaluation and post-training, with attention to quality, privacy, and reproducibility.
• Apply recent research (LLM-as-judge, reward modeling, test-time search, post-training) to production.
• Mentor engineers on the team and help set the technical direction for Nova.

Skills

Python

Production ML pipelines

LLM evaluation

Cross-team collaboration

Strong communication

Education

Master's or PhD in Computer Science, ML, AI, or related field

Tools

Modern ML frameworks

LLM APIs (Anthropic, OpenAI, Google)

Job description

Iterable is the AI customer engagement platform trusted by global brands. We are seeking a Senior Machine Learning Engineer to drive evaluation and automatic optimization for Nova, leading models and agents from research to production.

You will own evaluation loops, improve prompts and tools, and connect real interactions to measurable product improvements. You’ll work with Nova retrieval and product teams, gaining autonomy from research through production.