Lead Platform Engineer: AI Platform & Kubernetes

EPAM Systems; Colombia; On-site; COP 120,000,000 - 200,000,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off

Upskilling programs

Global career opportunities

Job summary

EPAM Systems is looking for a Lead Platform Engineer to build and operate shared AI platform services powering agentic workflows, including LLM gateways, MCP tooling, and observability by default.

You will enable teams with secure, scalable Kubernetes-based delivery, deep telemetry, and cost visibility while onboarding model providers, designing the MCP layer, and implementing robust authentication and policy controls. This role collaborates with global teams to advance AI platform reliability.

Qualifications

• 5+ years platform engineering experience.
• Advanced Kubernetes skills for running production services.
• Strong AI platforms experience across model gateways, routing, and agent runtimes.
• Hands-on Langfuse experience for AI tracing and evaluation metadata.
• Practical Model Context Protocol (MCP) experience with servers, registries, and tool boundaries.

Responsibilities

• Build shared AI platform services such as LLM gateways, proxy layers, routing, fallback, and supporting APIs with telemetry and cost attribution.
• Operate and scale platform services on Kubernetes using GitOps workflows with Helm and Kustomize, including progressive delivery and autoscaling.
• Onboard model providers and model versions across environments with routing rules, quotas, tiering, fallback behavior, and deprecation paths.
• Design and run the MCP layer, including server deployment, tool registration and discovery, session handling, and safe permission boundaries.
• Implement authentication, authorization, and tenancy using OAuth2/OIDC, SSO, JWT, API keys, and managed secrets.
• Instrument AI platform behavior end to end using OpenTelemetry, metrics, and structured logs alongside application-level AI traces.
• Build dashboards, alerts, and reports for AI reliability, performance, quality, and evaluation outcomes.

Skills

Leadership

Platform engineering

Kubernetes

Langfuse

OpenTelemetry

OAuth2/OIDC

Tools

GitOps

Helm

Kustomize

MCP tooling

Job description

EPAM Systems is looking for a Lead Platform Engineer to build and operate shared AI platform services powering agentic workflows, including LLM gateways, MCP tooling, and observability by default.

You will enable teams with secure, scalable Kubernetes-based delivery, deep telemetry, and cost visibility while onboarding model providers, designing the MCP layer, and implementing robust authentication and policy controls. This role collaborates with global teams to advance AI platform reliability.