Senior ML Engineer, Nova AI – Autonomy in Production

Iterable, Inc.; Austin (TX); On-site; USD 150,000 - 250,000; Full time

Job summary

Iterable, Inc. seeks a Senior Machine Learning Engineer for Nova, the AI intelligence layer. You will lead evaluation and automatic optimization for Nova models and agents, measuring performance, locating failure points, and driving improvements from prompts to tool harnesses.

You’ll own research-to-production work and guide the Nova team’s technical direction. You will work autonomously from research through production, collaborating with retrieval and product teams, and shaping the future of

Qualifications

• 5+ years hands-on MLE experience deploying complex ML systems at scale.
• Master's or PhD in CS, ML, AI or related field.
• Strong Python skills with readable, modular code and modern ML frameworks.

Responsibilities

• Build evaluation systems for models and agents (benchmarks, LLM judges, simulations).
• Create loops from diagnosis to automatic improvement of prompts, context, tools, and harnesses.
• Turn evaluation results into automated prompt optimization and production improvements.
• Develop synthetic data pipelines for evaluation and post-training with privacy and reproducibility.
• Mentor engineers and shape Nova's technical direction.

Skills

MLE production

Python

LLM evaluation

Cross-team collaboration

Automation

Education

Master's or PhD in CS/ML/AI

Tools

Python ML frameworks

LLM APIs (Anthropic, OpenAI, Google)

Job description

Iterable, Inc. seeks a Senior Machine Learning Engineer for Nova, the AI intelligence layer. You will lead evaluation and automatic optimization for Nova models and agents, measuring performance, locating failure points, and driving improvements from prompts to tool harnesses.

You’ll own research-to-production work and guide the Nova team’s technical direction. You will work autonomously from research through production, collaborating with retrieval and product teams, and shaping the future of