Senior AI Engineer - Production LLMs & Scaled Systems

Excolo.; Sydney; Hybrid; AUD 160,000 - 200,000; Full time

Job summary

Excolo. in Sydney is seeking a senior AI/ML engineer to shape how we deploy large language models at scale. You'll own features from concept to production, with executive backing and a clear roadmap.

You will build and maintain the infrastructure, tackle cost and latency, and collaborate with product managers and data engineers. This is a hands-on, growth-focused role with mentoring opportunities as the team expands.

Qualifications

• Strong software engineering fundamentals with 5+ years experience, including recent production AI/ML work.
• Hands-on experience building with LLMs: RAG, prompt engineering, fine tuning, model APIs and evals
• Solid Python and experience with cloud platforms (AWS or Azure)
• Experience getting models into production, not just notebooks. You know monitoring, versioning and rollback for AI systems
• Ability to talk trade-offs with non-technical stakeholders and push back when something shouldn’t be built
• Full working rights in Australia

Responsibilities

• Design and ship LLM-powered features into production, including RAG pipelines and evaluation frameworks.
• Build and maintain the infrastructure behind it: vector databases, embedding pipelines, model serving and monitoring.
• Manage cost, latency and quality trade-offs across model providers (OpenAI, Anthropic, open source).
• Write production Python and deploying on AWS or Azure with CI/CD.
• Set engineering standards for how AI gets built across the business, including guardrails and testing.
• Work closely with product managers, data engineers and stakeholders to take ideas from prototype to production.
• Mentor mid-level engineers as the team grows

Skills

LLM development

Python

Model deployment

Cloud platforms

Cost/latency trade-offs

Stakeholder communication

MLOps tooling

Mentoring

Tools

LangChain

LlamaIndex

PyTorch

TensorFlow

MLflow

SageMaker

Azure ML

AWS

Job description

Excolo. in Sydney is seeking a senior AI/ML engineer to shape how we deploy large language models at scale. You'll own features from concept to production, with executive backing and a clear roadmap.

You will build and maintain the infrastructure, tackle cost and latency, and collaborate with product managers and data engineers. This is a hands-on, growth-focused role with mentoring opportunities as the team expands.