Staff Data Scientist - Generative AI for Customer Ops

Cover Genius; Sydney; Hybrid; AUD 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid schedule

Professional growth

AI-first culture

Job summary

Cover Genius is hiring a Staff Data Scientist for Generative AI on the Customer Ops Team. You will own agentic AI system design, from prototype to production, influencing architecture and engineering practices.

You will build evaluation datasets, tools, and pipelines while collaborating with Engineering, Product, Operations, Compliance, and Analytics to ensure scalable, auditable, and safe AI systems. This role emphasizes hands-on delivery, setting architecture and evaluation strategies, and

Qualifications

• 8+ years in data science or ML, with 2–3 years shipping LLM-based or agentic systems into production.
• Deep expertise in LLM evaluation, ground-truth datasets and rubric design, and multi-agent analysis.
• Strong Python engineering with practical experience of agent and tool-use patterns and cloud platforms.
• Proven track record influencing technical direction beyond own team, shaping architecture and standards.
• Bachelor's degree in a relevant field; postgraduate achievement desirable.

Responsibilities

• Own the design of agentic AI systems and determine model vs. code boundaries.
• Build evaluation foundations and ground-truth datasets with robust rubrics.
• Ship production systems hands-on: prompts, tools, and evaluation pipelines.
• Lead engineers through design reviews and cross-team collaboration.
• Raise AI capability across the organisation with reusable guidance and tooling.
• Define metrics and report progress to leadership; drive end-to-end outcomes.
• Assess opportunities for agentic AI and run proofs of concept.

Skills

LLM evaluation

Python engineering

Agentic systems

Production rollout

Cross-functional collaboration

Mentoring engineers

Education

Bachelor's degree in a relevant field

Postgraduate degree desirable

Tools

AWS Bedrock

Temporal

MCP

Function calling

Job description

Cover Genius is hiring a Staff Data Scientist for Generative AI on the Customer Ops Team. You will own agentic AI system design, from prototype to production, influencing architecture and engineering practices.

You will build evaluation datasets, tools, and pipelines while collaborating with Engineering, Product, Operations, Compliance, and Analytics to ensure scalable, auditable, and safe AI systems. This role emphasizes hands-on delivery, setting architecture and evaluation strategies, and