Senior ML Engineer, Nova AI Platform

Royper Royco LLC; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Iterable is hiring a Senior Machine Learning Engineer for the Nova intelligence layer. You will lead evaluation and automatic optimization of models and agents, shaping prompts, context, tools, and agent harnesses, with end-to-end ownership from research to production.

You will work with the Nova retrieval and product teams to connect real interactions to measurable improvements and mentor engineers on the team to set technical direction.

Qualifications

• 5+ years of hands-on MLE experience deploying ML systems at scale.
• Master's or PhD in CS/ML/AI or related field.
• Strong Python, readable and modular code, with modern ML frameworks.
• Experience evaluating LLMs/agents including multi-turn behavior and tool use.
• Experience with prompt/context optimization, post-training, or reinforcement learning.
• Experience with multiple LLM APIs (Anthropic, OpenAI, Google).
• Excellent communication and cross-team collaboration.

Responsibilities

• Build evaluation systems for models and agents: benchmarks, LLM judges, simulations, trajectory analysis, and regression tests.
• Create a loop that takes failures from diagnosis to fix to measured improvement.
• Turn evaluation results into automatic optimization of prompts, context, tools, rubrics, and agent harnesses.
• Build synthetic data pipelines for evaluation and post-training, with attention to quality, privacy, and reproducibility.
• Apply recent research (LLM-as-judge, reward modeling, test-time search, post-training) to production.
• Mentor engineers on the team and help set the technical direction for Nova.

Skills

MLE production systems

Python programming

Cross-team collaboration

Research-to-production mindset

Communication

Education

Master's or PhD in CS/ML/AI

Tools

LLM APIs (Anthropic/OpenAI/Google)

ML frameworks

Job description

Iterable is hiring a Senior Machine Learning Engineer for the Nova intelligence layer. You will lead evaluation and automatic optimization of models and agents, shaping prompts, context, tools, and agent harnesses, with end-to-end ownership from research to production.

You will work with the Nova retrieval and product teams to connect real interactions to measurable improvements and mentor engineers on the team to set technical direction.