Senior ML Engineer — AI Evaluation & Production Systems

Iterable, Inc.; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Iterable, Inc. in the US is hiring a Senior Machine Learning Engineer to work on Nova, the intelligence layer that helps customer experience teams adapt in real time and improve every interaction.

You'll own evaluation and automatic optimization for Nova's models and agents, measuring performance, diagnosing failures, and driving prompt/context/tool improvements in production.

Join a team that values growth mindset, autonomy, and collaboration as you shape the future of AI at Iterable.

Qualifications

• Hands-on ML engineering with production-scale ML pipelines.
• Advanced degree in CS/ML or related field.
• Experience evaluating LLMs/agents and production readiness.
• Strong Python, modular code, and ML frameworks.
• Experience with prompt/context optimization or reinforcement learning.

Responsibilities

• Build evaluation systems for models and agents: benchmarks, LLM judges, simulations, trajectory analysis, and regression tests.
• Create a loop from diagnosis to fix to measured improvement.
• Turn evaluation results into automated optimization of prompts, context, tools, rubrics, and agent harnesses.
• Build synthetic data pipelines for evaluation and post-training, with attention to quality, privacy, and reproducibility.
• Apply recent research to production and mentor engineers on the team to set Nova's technical direction.

Skills

Python

LLM evaluation

Production ML

Cross-team collaboration

Education

Master's or PhD in CS/ML

Tools

ML frameworks

Job description

Iterable, Inc. in the US is hiring a Senior Machine Learning Engineer to work on Nova, the intelligence layer that helps customer experience teams adapt in real time and improve every interaction.

You'll own evaluation and automatic optimization for Nova's models and agents, measuring performance, diagnosing failures, and driving prompt/context/tool improvements in production.

Join a team that values growth mindset, autonomy, and collaboration as you shape the future of AI at Iterable.