Lead Platform Engineering

EPAM Systems, Inc.; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Healthcare benefits

Employee financial programs

Paid time off and sick leave

Upskilling and certifications

Job summary

EPAM Systems, Inc. is seeking a Lead Platform Engineer to build and operate shared AI platform services powering agentic workflows with secure, scalable Kubernetes delivery and deep telemetry.

The role focuses on implementing authentication, observability, and tenancy with OAuth2/OIDC, SSO, JWT and managed secrets, plus developing self-service onboarding and provisioning for teams. English proficiency is required for collaboration across global teams.

Qualifications

• 5+ years of platform engineering experience.
• Advanced Kubernetes skills for production services.
• Experience with AI platforms across model gateways and runtimes.
• Hands-on Langfuse experience for AI tracing and evaluation metadata.

Responsibilities

• Build shared AI platform services such as LLM gateways, proxy layers, routing, and APIs with telemetry and cost attribution.
• Operate and scale platform services on Kubernetes using GitOps workflows with Helm and Kustomize.
• Onboard model providers and versions with routing rules, quotas, tiering, and deprecation paths.
• Design and run the MCP layer including server deployment, tool discovery and safe permission boundaries.

Skills

Platform engineering

Leadership

Kubernetes

OpenTelemetry

OAuth2/OIDC

Langfuse

Communication

English Proficiency (B2)

Tools

Helm

Kustomize

GitOps

MCP tooling

Job description

We are looking for a Lead Platform Engineer to build and operate shared AI platform services that power agentic workflows, including LLM gateways, MCP tooling, and observability by default. You will enable teams with secure, scalable Kubernetes-based delivery, deep telemetry, and cost visibility.ResponsibilitiesBuild shared AI platform services such as LLM gateways, proxy layers, routing, fallback, and supporting APIs with telemetry and cost attributionOperate and scale platform services on Kubernetes using GitOps workflows with Helm and Kustomize, including progressive delivery and autoscalingOnboard model providers and model versions across environments with routing rules, quotas, tiering, fallback behavior, and deprecation pathsDesign and run the MCP layer, including server deployment, tool registration and discovery, session handling, and safe permission boundariesImplement authentication, authorization, and tenancy using OAuth2/OIDC, SSO, JWT, API keys, and managed secretsInstrument AI platform behavior end to end using OpenTelemetry, metrics, and structured logs alongside application-level AI tracesImplement Langfuse telemetry patterns for traces, spans, prompts, completions, feedback, evaluations, latency, errors, and token usageBuild dashboards, alerts, and reports for AI reliability, performance, quality, and evaluation outcomesDesign cost and usage observability across LLM vendors with attribution by app, team, user, model, workflow, and environmentCreate showback or chargeback-ready metrics and feed insights into routing, tiering, and capacity decisionsApply policy guardrails including PII detection, filtering, audit logging, and retention controls for prompts, completions, and tracesEnable the agent lifecycle with publishing, versioning, registry discovery, memory management, resilience, and explainability signalsBuild self-service onboarding and provisioning workflows, templates, and portals or CLIs for teamsPartner with engineering teams to define and enforce observability standards as the default delivery pathRequirements5+ years platform engineering experienceStrong leadership skills to set standards and mentor engineersProven project ownership for designing and operating shared internal platformsAdvanced Kubernetes skills for running production servicesStrong AI platforms experience across model gateways, routing, and agent runtimesHands-on Langfuse experience for AI tracing and evaluation metadataPractical Model Context Protocol (MCP) experience with servers, registries, and tool boundariesStrong OpenTelemetry skills for traces, metrics, and structured logsSolid security knowledge in OAuth2/OIDC, SSO, JWT, and secrets managementExcellent stakeholder communication skills with application and developer teamsUpper-Intermediate English proficiency (B2)Nice to haveLangChain experience for agent workflow integration and analysisLangGraph experience for graph-based agent orchestrationRetrieval-Augmented Generation (RAG) experience including evaluation and tuningWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn