GCP AI/ML Engineer

Kaizen Global Technologies; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

Kaizen Global Technologies is seeking an experienced Platform Operations professional to manage the end-to-end lifecycle of AI agents, including LLM evaluations, upgrades, and orchestration. You will oversee Google Cloud Platform infrastructure and shared services to ensure reliable operation.

You will implement robust monitoring and observability to track platform metrics, identify issues, and drive proactive resolution, while coordinating with cross-functional teams on identity, access, and

Qualifications

• Experience operating AI agents and LLM ecosystems.
• Proficiency with cloud monitoring and observability tools.
• Knowledge of IAM and security best practices.

Responsibilities

• Manage the operational lifecycle of AI agents, including LLM evaluations, version upgrades, and orchestration.
• Oversee GCP infrastructure and shared services, ensuring reliable operation and alignment with platform standards.
• Implement monitoring and observability solutions to track platform metrics and drive proactive resolution.
• Manage identity, access, and governance in collaboration with cross-functional teams, ensuring secure and compliant platform operations.

Skills

AI Operations

Monitoring

Security & IAM

Tools

Google Cloud Monitoring

Braintrust

Metrics Analysis

Okta

Authentication

Access Management

Infrastructure Security

Job description

• Manage the operational lifecycle of AI agents, including LLM evaluations, version upgrades, Agent Runtime orchestration, security, and performance optimisation.
• Oversee GCP infrastructure and shared services, ensuring reliable operation and alignment with platform standards.
• Implement monitoring and observability solutions to track platform metrics, identify issues, and drive proactive resolution.
• Manage identity, access, and governance in collaboration with cross-functional teams, ensuring secure and compliant platform operations.

Key Skills

• AI Operations: LLM Evaluation, Agent Runtime Orchestration
• Monitoring: Google Cloud Monitoring, Braintrust, Metrics Analysis
• Security & IAM: Okta, Authentication, Access Management, Infrastructure Security