AI Platform Engineer

Kaizen Global Technologies; Sydney; On-site; AUD 150,000 - 230,000; Full time

Job summary

Kaizen Global Technologies in Sydney is seeking an AI/ML Platform Engineer with 7+ years of experience to own the operational lifecycle of AI agents, plan LLM evaluations, manage version upgrades, and uphold platform security and reliability across production environments.

You will maintain GCP infrastructure including Cloud Run, Cloud SQL, and Load Balancers, implement comprehensive monitoring and observability to detect issues early, configure authentication with Okta, enforce secure access

Qualifications

• 7+ years of experience in AI/ML platforms or related infrastructure roles.
• Experience operating AI agents and managing lifecycle (LLMs, agents, upgrades).
• Strong knowledge of cloud security, governance, and incident response.

Responsibilities

• Manage operational lifecycle of AI agents, including LLM evaluations, version upgrades, and platform security.
• Manage and maintain GCP infrastructure including Agent Runtime, Cloud Run, Cloud SQL, and Load Balancers.
• Implement monitoring and observability solutions to track platform metrics and improve performance.
• Configure authentication and access controls, including Okta integration and secure infrastructure practices.
• Collaborate with cross-functional teams to manage shared services, governance, and operational standards.

Skills

GCP core services

LLM operations

Monitoring & observability

IAM & security

Cross-functional collaboration

Job description

Job Title: AI/ML Platform Engineer

Location: Sydney

Experience: 7+ years

Key Responsibilities

• Manage the operational lifecycle of AI agents, including LLM evaluations, version upgrades, and platform security.
• Manage and maintain GCP infrastructure including Agent Runtime, Cloud Run, Cloud SQL, and Load Balancers.
• Implement monitoring and observability solutions to track platform metrics, identify issues, and improve performance.
• Configure and maintain authentication and access controls, including Okta integration and secure infrastructure practices.
• Collaborate with cross-functional teams to manage shared services, core infrastructure, governance, and operational standards.

Skills Required

• Strong hands-on experience with GCP services, particularly Cloud Run, Cloud SQL, Load Balancing, and Agent Runtime.
• Experience with AI/ML platform operations, including LLM evaluation, AI agent lifecycle management, and Agent Runtime orchestration.
• Proficiency in monitoring, observability, and metric analysis using cloud and AI-platform monitoring tools such as Braintrust.
• Experience with Identity & Access Management (IAM) and authentication solutions, particularly Okta.
• Strong understanding of cloud security, infrastructure operations, governance, troubleshooting, and cross-functional collaboration.