DevOps Platform Engineer | AI & LLMOps Infrastructure

K&K Global Talent Solutions INC.; Toronto; On-site; CAD 120,000 - 160,000; Full time

Job summary

K&K Global Talent Solutions INC. seeks an Agent & DevOps Platform Engineer to design and scale secure multi-account AWS environments and automation pipelines for autonomous AI agent frameworks.

You will bridge Platform Engineering with LLMOps, building robust CI/CD pipelines, secure IAM patterns, and container platforms to ship code reliably at enterprise scale.

Qualifications

• 3–5+ years of hands-on platform engineering in enterprise environments.
• Strong Python for infrastructure tooling, APIs, and automation.
• Cloud native experience with AWS deployments and IAM security.
• Production experience with Docker and Kubernetes (EKS/ECS).
• Experience building or scaling AI/LLM-based tools or agents.
• Knowledge of Git-based workflows and DevSecOps practices.

Responsibilities

• Architect, deploy, and manage multi-account AWS environments using Terraform, CloudFormation, or AWS CDK.
• Build, deploy, and scale enterprise developer platforms and agent tooling.
• Implement advanced AWS IAM architectures with least-privilege access and cross-account security.
• Package and orchestrate distributed container systems with Docker and Kubernetes/EKS/ECS.
• Develop guardrails for production AI workloads including prompt management and observability.
• Create reusable CI/CD patterns and enforce strong security in automation pipelines.
• Mentor teams and resolve platform bottlenecks in ambiguous environments.

Skills

Platform engineering

Python

Java

Node.js

Groovy

AWS

Docker

Kubernetes

AWS IAM

AI/LLMOps

Git workflows

DevSecOps

Tools

Terraform

CloudFormation

AWS CDK

LangChain

LlamaIndex

EKS

ECS

CI/CD tooling

Job description

Location: Onsite- Toronto, ON

Job type: Full-Time/Permanent Hiring

As an Agent & DevOps Platform Engineer, you will design, scale, and secure the foundational infrastructure that powers our next-generation developer platforms and autonomous AI/LLM agent frameworks. This is a highly specialized role bridging the gap between advanced cloud-native Platform Engineering and cutting-edge LLMOps. You will not just build standalone AI applications—you will build the highly automated, multi-account AWS environments, robust CI/CD pipelines, and secure IAM patterns that allow autonomous agents and developers to ship code reliably, securely, and at enterprise scale.

Key Responsibilities

• Infrastructure as Code & Automation: Architect, deploy, and manage highly reliable multi-account AWS environments using Terraform, CloudFormation, or AWS CDK.
• Agent & Tooling Orchestration: Build, deploy, and scale enterprise developer platforms, integrating agentic orchestration frameworks (e.g., LangChain, LlamaIndex) and custom toolchains into production pipelines.
• Bulletproof Identity & Access: Implement advanced AWS IAM architectures under the principle of least privilege, designing secure cross-account access, service-to-service authentication, and Kubernetes service accounts.
• Container Platform Engineering: Package and orchestrate distributed container systems using Docker and enterprise container platforms (Amazon EKS, ECS, or Kubernetes), configuring robust networking, ingress, and workload security.
• LLMOps & Platform Observability: Build the guardrails for production AI workloads, implementing systems for prompt management, tool execution, model evaluation, observability (CloudWatch), and cost-reliability metrics.
• Scale CI/CD & DevSecOps: Treat security as a core software design constraint. Author high-quality reusable pipeline patterns, build automation workflows, and enable decentralized DevOps practices across multiple business units.
• System Ownership & Culture: Act as a technical mentor whose coaching is reflected in clean working code, robust pipelines, and reusable modules. Define and solve core platform bottlenecks in ambiguous environments.

Required Qualifications

• Experience: 3–5+ years of hands-on platform engineering, cloud architecture, and CI/CD operations within complex enterprise environments.
• Programming: Strong proficiency in Python for infrastructure tooling, API integrations, agent services, and advanced production scripting.
• Technical Ecosystems: Working competence in at least one additional development ecosystem (e.g., Java, .NET, Node.js, or Groovy).
• Cloud Native & Containers: Deep production experience with AWS cloud-native deployments and container orchestration via Docker and Kubernetes / Amazon EKS / ECS.
• AWS Security Mastery: Comprehensive knowledge of complex AWS IAM structures, including roles, policies, trust relationships, and secure machine-to-machine authentication.
• AI/LLMOps Engineering: Direct experience building, deploying, or scaling AI/LLM-based tools or agents in or near production. Solid understanding of prompt management, tool usage, and agent testing.
• Methodology: Strong grasp of Git-based workflows, release management at scale, and an uncompromising DevSecOps approach to system design.

Nice-to-Have Skills

• Hands-on usage of advanced AWS ecosystem tools: ECR, Lambda, Bedrock, CloudWatch, S3, Secrets Manager, Systems Manager, and VPC networking.
• Familiarity with Kubernetes internals: Helm, service accounts, ingress controllers, and network policies.
• Prior experience working with framework tools like LangChain or LlamaIndex.
• Experience driving agile delivery models using Scrum, Kanban, or SAFe across multiple teams.