Senior ML Engineer, Nova AI at Enterprise Scale

Iterable, Inc.; New York (NY); On-site; USD 150,000 - 250,000; Full time

Job summary

Iterable, Inc. seeks a Senior Machine Learning Engineer for its Nova platform. You will lead evaluation and automatic optimization of Nova models and agents, measuring performance, diagnosing failures, and driving improvements across prompts, context, tools, and harnesses.

You will own research-to-production lifecycles, building robust pipelines and synthetic data for evaluation, while mentoring teammates and guiding the AI direction at Iterable.

Qualifications

• 5+ years hands-on MLE experience deploying ML systems at scale.
• Strong Python skills with readable, maintainable code.

Responsibilities

• Build evaluation systems for models and agents: benchmarks, LLM judges, simulations, trajectory analysis, and regression tests.
• Create a loop that takes failures from diagnosis to fix to measured improvement.
• Turn evaluation results into automatic optimization of prompts, context, tools, rubrics, and agent harnesses.
• Build synthetic data pipelines for evaluation and post-training with quality, privacy, and reproducibility.
• Apply recent research to production, such as LLM-as-judge, reward modeling, test-time search, post-training.
• Mentor engineers on the team and help set the technical direction for Nova.

Skills

MLE experience

Python

LLMs evaluation

Cross-team collaboration

Production ML pipelines

Education

Master's or PhD in CS/ML

Tools

PyTorch/TensorFlow

Job description

Iterable, Inc. seeks a Senior Machine Learning Engineer for its Nova platform. You will lead evaluation and automatic optimization of Nova models and agents, measuring performance, diagnosing failures, and driving improvements across prompts, context, tools, and harnesses.

You will own research-to-production lifecycles, building robust pipelines and synthetic data for evaluation, while mentoring teammates and guiding the AI direction at Iterable.