Senior ML Infra Engineer for High-Performance AI

United States Digital Space LLC; Town Of Cambridge; On-site; AUD 140,000 - 190,000; Full time

Job summary

the company Entertainment Assistant team is hiring a Senior Software Engineer with strong ML infrastructure experience to deliver reliable conversational experiences at scale. You will own production systems across ranking, model delivery, evaluation and LLM-agent behaviour, collaborating with ML, product, data and platform partners.

This hands-on role spans software architecture, ML lifecycle decisions and production operations, improving paths to train, evaluate, deploy and observe models

Qualifications

• Strong production software-engineering experience, including designing, testing, operating and debugging distributed services.
• Meaningful ownership of ML infrastructure or production model delivery, with clear evidence of your contribution and its operational or adoption impact.
• A practical understanding of the ML lifecycle: training, evaluation, versioning, deployment, online validation, monitoring and safe rollback.
• Experience designing for latency, resilience, observability and cost in production systems.
• Experience with LLMs, embeddings, semantic search, retrieval or agent systems, including how you evaluate quality and control failure modes.
• Experience with caching systems and the trade-offs involved in using caching for low-latency services.
• A commitment to automation, CI/CD, code quality and evidence-led engineering decisions.
• A collaborative approach and the ability to explain technical trade-offs to partners across disciplines.
• A degree in Computer Science, Electrical Engineering or a related field, or equivalent practical experience.
• Experience with AWS or GCP, Kubernetes, SQL warehouse and batch-processing technologies such as Trino, Presto or Spark, Kafka or other streaming systems, and Go or Python would be useful.

Responsibilities

• Own fulfilment-ranking pipelines from training orchestration and quality gates through deployment and online validation.
• Build and operate an offline-evaluation platform, combining LLM-as-judge harnesses with deterministic checks for answer quality.
• Develop the the company Entertainment Assistant's LLM agent, including tool routing, retrieval, guardrails and answer caching.
• Design caching as an intentional latency and cost lever for high-volume services.
• Build observability for ML and LLM systems, including latency attribution, quality metrics, tracing and per-request cost.
• Improve the reliability and operability of distributed systems, and lead the diagnosis of difficult cross-service failures.
• Drive accountable AI-assisted engineering practices across the team, building on the agents already used in release workflows.
• Work across machine-learning, product, data and platform boundaries to turn ambiguous problems into measurable delivery outcomes.

Skills

Production software engineering

ML infrastructure

LLM agents

AWS/GCP

Kubernetes

Go

Python

Kafka

SQL warehouses

Trino/Presto/Spark

Node.js

Education

Bachelor's degree in CS/EE or related field

Tools

Kubernetes

Trino/Presto/Spark

Kafka

Go

Python

SQL

Job description

the company Entertainment Assistant team is hiring a Senior Software Engineer with strong ML infrastructure experience to deliver reliable conversational experiences at scale. You will own production systems across ranking, model delivery, evaluation and LLM-agent behaviour, collaborating with ML, product, data and platform partners.

This hands-on role spans software architecture, ML lifecycle decisions and production operations, improving paths to train, evaluate, deploy and observe models