Senior ML Engineer, Nova AI Platform

Iterable, Inc.; Boston (MA); On-site; USD 150,000 - 250,000; Full time

Job summary

Iterable, Inc. is seeking a Senior Machine Learning Engineer for the Nova intelligence layer. You’ll lead evaluation and automatic optimization for Nova’s models, measuring performance and identifying failure points to drive improvements in prompts, context, tools, and agent harnesses.

You’ll work with Nova’s retrieval and product teams to connect live interactions to measurable gains. You will own the process from research and experimentation to production reliability, shaping the future of AI

Qualifications

• 5+ years of hands-on MLE experience deploying complex ML systems at scale.
• Master's or PhD in Computer Science, ML, AI, or related field.
• Active focus on applying recent research to ship reliable improvements.

Responsibilities

• Build evaluation systems for models and agents (benchmarks, LLM judges, simulations, trajectory analysis).
• Create loops from failure diagnosis to automatic improvement of prompts, context, tools, and agent harnesses.
• Turn evaluation results into automated optimization for prompts, context, tools, rubrics, and harnesses.
• Build synthetic data pipelines for evaluation and post-training with privacy and reproducibility in mind.
• Apply cutting-edge research to production (LLM-as-judge, reward modeling, test-time search).
• Mentor engineers and help set the technical direction for Nova.

Skills

Python proficiency

LLM evaluation

Production ML pipelines

Cross-team collaboration

Research application

Education

Master's or PhD in CS/ML/AI or related field

Tools

Python

ML frameworks (TensorFlow/PyTorch)

LLM APIs (Anthropic/OpenAI/Google)

Job description

Iterable, Inc. is seeking a Senior Machine Learning Engineer for the Nova intelligence layer. You’ll lead evaluation and automatic optimization for Nova’s models, measuring performance and identifying failure points to drive improvements in prompts, context, tools, and agent harnesses.

You’ll work with Nova’s retrieval and product teams to connect live interactions to measurable gains. You will own the process from research and experimentation to production reliability, shaping the future of AI