Senior Platform Engineer (AI Platforms)

EPAM Systems, Inc.; México; A distancia; MXN 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

EPAM Systems, Inc. is seeking a Senior Platform Engineer in Mexico to build shared AI platform services powering LLM integrations and agent runtimes. You will run and evolve Kubernetes-based gateways, MCP layers, and telemetry capabilities, with guardrails and cost attribution built in from day one.

Responsibilities include model onboarding, end-to-end observability, and deployment via GitOps using Helm and Kustomize. Strong security, IAM, and OAuth2/OIDC expertise are essential for success.

Formación

• 3+ years of senior platform engineering experience
• Strong Kubernetes experience operating production services
• Hands-on Langfuse experience for AI observability
• Strong MCP experience building or operating MCP servers and registries
• Strong OpenTelemetry experience for tracing, metrics, and logs
• Production GitOps experience using Helm and Kustomize
• Strong IAM and security knowledge covering OAuth2/OIDC, SSO, JWT, and secrets handling
• Excellent communication skills and English proficiency (B2+)

Responsabilidades

• Build and operate shared AI platform services including LLM gateways, routing, and agent runtimes
• Design model onboarding with routing rules, quotas, tiering, and deprecation paths
• Implement end-to-end observability with OpenTelemetry across components
• Develop Langfuse telemetry including traces, prompts, and evaluation metadata
• Run platform services on Kubernetes with GitOps, autoscaling, and progressive rollout
• Apply guardrails and policy enforcement including PII detection and audit logging
• Create showback-ready metrics for token usage, model mix, and vendor spend
• Support agent lifecycle capabilities including publishing, versioning, and discovery

Conocimientos

Kubernetes operations

OpenTelemetry

Langfuse

MCP (Model Context Protocol)

OAuth2/OIDC

SSO

JWT

IAM & security

English communication

Herramientas

Helm

Kustomize

GitOps

Descripción del empleo

We are looking for a Senior Platform Engineer to build shared AI platform services that power LLM integrations and agent runtimes, with observability, guardrails, and cost attribution designed in from day one. You will run and evolve Kubernetes-based gateway, MCP, and telemetry capabilities that application teams rely on.ResponsibilitiesBuild and operate shared AI platform services including LLM gateways, routing, fallback, MCP layers, and agent runtimesDesign and run model onboarding across environments with routing rules, quotas, tiering, and version deprecation pathsImplement end-to-end observability for platform components using OpenTelemetry, metrics, and structured logsImplement and maintain Langfuse telemetry including traces, spans, prompts, completions, feedback, and evaluation metadataDesign and operate the MCP layer for tool registration, discovery, session handling, permission boundaries, and tool-call tracingRun platform services on Kubernetes with GitOps using Helm and Kustomize, autoscaling, health checks, and progressive rolloutImplement authentication, authorization, and tenancy with OAuth2/OIDC, SSO, JWT validation, and API key managementApply guardrails and policy enforcement including PII detection, filtering, audit logging, and retention rulesBuild dashboards, alerts, and reports for reliability, latency, errors, quality signals, and production behaviorDesign cost and usage observability across model providers with attribution by app, team, user, model, and environmentCreate showback-ready metrics for token usage, model mix, cache behavior, and vendor spend to guide routing and capacitySupport agent lifecycle capabilities including publishing, versioning, discovery, memory, scaling, and resilienceBuild developer self-service workflows for onboarding, provisioning, templates, and internal portals or CLIsRequirementsSenior-level platform engineering experience (3+ years) with AI platform servicesStrong Kubernetes experience (3+ years) operating production servicesHands-on Langfuse experience implementing AI observability patternsStrong Model Context Protocol (MCP) experience building or operating MCP servers and registriesStrong OpenTelemetry experience for distributed tracing, metrics, and structured logsProduction GitOps experience using Helm and Kustomize for declarative deliveryStrong IAM and security knowledge covering OAuth2/OIDC, SSO, JWT, and secrets handlingStrong communication skills to partner with engineering and developer teamsUpper-Intermediate English proficiency (B2) for collaboration and documentationNice to haveHands-on LangChain experience for agent or tool integration patternsHands-on LangGraph experience for graph-based agent workflowsRetrieval-Augmented Generation (RAG) experience with evaluation and retrieval quality tuningWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.