Senior AI SRE - Reliability, Observability & Cost Control

EPAM Systems, Inc.; Warszawa; Hybrid; PLN 170,000 - 320,000; Full time

Benefits offered by this job

Health insurance

Multisport

Shopping vouchers

Referral bonuses

Job summary

EPAM Systems, Inc. is seeking a Senior Site Reliability Engineer to own reliability of production AI systems, bridging deployment and operability on Azure with cost, security, and quality baked in.

You will lead end-to-end deployments, build LLM-aware observability, define SLOs, manage incidents, drive FinOps for AI workloads, and ensure security posture across the lifecycle while collaborating with pods and architectural teams.

Qualifications

• 5+ years of experience operating cloud production systems.
• Expertise in Azure IaaS/PaaS operations, infrastructure as code (Terraform/Bicep), and CI/CD tooling.
• Proficiency in observability stacks with LLM tracing, container orchestration, and Python/Bash automation.
• Knowledge of FinOps basics for AI workloads.
• Familiarity with daily AI use in operations work, including incident triage, runbook drafting, log analysis, and automation code.

Responsibilities

• Own deployment end-to-end, including infrastructure as code, CI/CD pipelines, and environment management on Azure, ensuring every environment is rebuildable from source
• Build LLM-aware observability with traces on every model call, production quality signals such as eval sampling, drift detection, and guardrail-trigger rates, plus cost and latency dashboards
• Define and defend SLOs covering availability, latency, and quality objectives per solution, balancing delivery speed against stability with data-driven error budgets
• Run incident management, including on-call models, runbooks written before incidents occur, and blameless postmortems afterward
• Manage the cost of intelligence by monitoring token economics per solution, wiring in budgets and alerts, and conducting capacity planning proactively
• Keep the security posture current through patching, secret rotation, access reviews, and audit readiness across the solution's entire lifecycle
• Shape operability requirements before handover, ensuring they land in the pod's definition of done, and run hypercare jointly with sign-off on what will be operated
• Feed operational patterns, failure modes, and cost learnings back to the pods and the Architect

Skills

Azure IaaS/PaaS

Terraform/Bicep

CI/CD tooling

LLM tracing

Container orchestration

Python scripting

Bash scripting

FinOps basics

Job description

EPAM Systems, Inc. is seeking a Senior Site Reliability Engineer to own reliability of production AI systems, bridging deployment and operability on Azure with cost, security, and quality baked in.

You will lead end-to-end deployments, build LLM-aware observability, define SLOs, manage incidents, drive FinOps for AI workloads, and ensure security posture across the lifecycle while collaborating with pods and architectural teams.