AI Platform Engineer: Build & Govern Scalable AI Gateways

Randstad Enterprise; Montreal (administrative region); Hybrid; CAD 140,000 - 200,000; Full time

Job summary

Randstad Enterprise in Montreal is seeking an AI Platform Engineering Specialist to design, deploy, and operate the AI Gateway across Azure and AWS. You will develop Python services, integrate model providers, and implement secure authentication and data layers, while advancing IaC and CI/CD pipelines.

The role involves Kubernetes orchestration, observability, and collaboration with security, network, and platform teams to ensure production readiness and governance.

Qualifications

• Strong, production-grade Python with FastAPI/Flask and testing.
• Hands-on Kubernetes deployment, config, and troubleshooting.
• OIDC/OAuth 2.0 token validation and JWKS handling.
• Azure services including AKS / Entra ID / OpenAI or Foundry experience.
• AWS experience: IAM/STS, Bedrock, EKS, CloudWatch.
• Infrastructure as code: Terraform / Bicep / CDK and Jenkins or GitHub Actions.
• SQL and relational data modeling with migrations.
• Clear written and verbal communication with security/network teams.

Responsibilities

• Design, build and operate the AI Gateway's deployments on Azure and AWS.
• Develop Python services providing inference and APIs.
• Integrate model providers across Azure and AWS with signing, streaming, and quotas.
• Implement cloud-native authentication and secrets handling.
• Build entitlement and authorization data layer across SQL Server and PostgreSQL.
• Own platform controls: rate limiting, audit logging, chargeback reporting.
• Deploy on Kubernetes (on-prem, AKS, EKS) using Helm, GitOps and Terraform.
• Build observability with Prometheus, Grafana, Loki and Snowflake.
• Collaborate with security/network/platform teams and produce evidence for reviews.
• Support production: on-call, incidents, and harden code.
• Write tests and documentation and review peers' changes.

Skills

Python

Kubernetes

OIDC/OAuth 2.0

Azure

AWS

SQL

Communication

CI/CD concepts

Tools

Terraform

Jenkins

GitHub Actions

Job description

Randstad Enterprise in Montreal is seeking an AI Platform Engineering Specialist to design, deploy, and operate the AI Gateway across Azure and AWS. You will develop Python services, integrate model providers, and implement secure authentication and data layers, while advancing IaC and CI/CD pipelines.

The role involves Kubernetes orchestration, observability, and collaboration with security, network, and platform teams to ensure production readiness and governance.