Senior Platform Engineer (AI Platforms)

EPAM Systems, Inc.; Colombia; A distancia; COP 120.000.000 - 180.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Paid time off

Upskilling & cert courses

LinkedIn Learning access

Descripción de la vacante

EPAM Systems, Inc. seeks a Senior Platform Engineer to build shared AI platform services powering LLM integrations and agent runtimes.

You will run Kubernetes-based gateway, MCP, and telemetry capabilities used by multiple application teams, with cost attribution designed in from day one. You will implement model onboarding, routing rules, quotas, tiering, and version deprecation paths, while ensuring observability and guardrails across environments.

Formación

• 3+ years in senior platform engineering with AI platforms.
• Strong Kubernetes experience in production environments.
• Hands-on Langfuse for AI observability patterns.
• Experience with MCP servers and registries.
• OpenTelemetry for distributed tracing, metrics, logs.
• GitOps using Helm and Kustomize in production.
• IAM/Security knowledge including OAuth2/OIDC/SSO/JWT.
• English language level at B2 for collaboration.

Responsabilidades

• Build and operate shared AI platform services including LLM gateways and runtimes.
• Design onboarding across environments with routing rules and quotas.
• Implement end-to-end observability with metrics and logs for platforms.
• Maintain MCP layer for tool registration, discovery, and tracing.
• Run Kubernetes-based gateway and telemetry with GitOps.
• Apply guardrails, auditing, and retention policies for data safety.
• Create dashboards and cost-attribution reports for reliability.

Conocimientos

Platform engineering

Kubernetes

Langfuse

MCP

OpenTelemetry

GitOps

IAM & security

Distributed tracing

English (B2)

Herramientas

Helm

Kustomize

LangChain

LangGraph

Descripción del empleo

We are looking for a Senior Platform Engineer to build shared AI platform services that power LLM integrations and agent runtimes, with observability, guardrails, and cost attribution designed in from day one. You will run and evolve Kubernetes-based gateway, MCP, and telemetry capabilities that application teams rely on.ResponsibilitiesBuild and operate shared AI platform services including LLM gateways, routing, fallback, MCP layers, and agent runtimesDesign and run model onboarding across environments with routing rules, quotas, tiering, and version deprecation pathsImplement end-to-end observability for platform components using OpenTelemetry, metrics, and structured logsImplement and maintain Langfuse telemetry including traces, spans, prompts, completions, feedback, and evaluation metadataDesign and operate the MCP layer for tool registration, discovery, session handling, permission boundaries, and tool-call tracingRun platform services on Kubernetes with GitOps using Helm and Kustomize, autoscaling, health checks, and progressive rolloutImplement authentication, authorization, and tenancy with OAuth2/OIDC, SSO, JWT validation, and API key managementApply guardrails and policy enforcement including PII detection, filtering, audit logging, and retention rulesBuild dashboards, alerts, and reports for reliability, latency, errors, quality signals, and production behaviorDesign cost and usage observability across model providers with attribution by app, team, user, model, and environmentCreate showback-ready metrics for token usage, model mix, cache behavior, and vendor spend to guide routing and capacitySupport agent lifecycle capabilities including publishing, versioning, discovery, memory, scaling, and resilienceBuild developer self-service workflows for onboarding, provisioning, templates, and internal portals or CLIsRequirementsSenior-level platform engineering experience (3+ years) with AI platform servicesStrong Kubernetes experience (3+ years) operating production servicesHands-on Langfuse experience implementing AI observability patternsStrong Model Context Protocol (MCP) experience building or operating MCP servers and registriesStrong OpenTelemetry experience for distributed tracing, metrics, and structured logsProduction GitOps experience using Helm and Kustomize for declarative deliveryStrong IAM and security knowledge covering OAuth2/OIDC, SSO, JWT, and secrets handlingStrong communication skills to partner with engineering and developer teamsUpper-Intermediate English proficiency (B2) for collaboration and documentationNice to haveHands-on LangChain experience for agent or tool integration patternsHands-on LangGraph experience for graph-based agent workflowsRetrieval-Augmented Generation (RAG) experience with evaluation and retrieval quality tuningWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.