GenAI Ops Engineer: Build, Scale & Secure AI Pipelines

EPAM Systems; Turkey; On-site; TRY 2,917,000 - 4,375,000; Full time

Benefits offered by this job

Private health insurance

English courses

Continuous upskilling

Job summary

EPAM Systems is seeking a GenAI Ops Engineer to build, deploy and sustain the operational infra for large-scale generative AI models across major clouds. You will work with data scientists, ML engineers and software developers to ensure scalable, reliable GenAI services and agent ecosystems.

The role requires strong experience in CI/CD, IaC, container orchestration, and monitoring, with a focus on multi-agent workflows and tool integrations. Fluent English is required.

Qualifications

• 3+ years in a DevOps/SRE/MLOps role focused on cloud infra.
• Experience deploying and operating LLM inference services.
• Familiarity with IaC, CI/CD, and container orchestration.
• Hands-on with tracing/metrics and eval pipelines.
• Experience with multi-agent workflows and tool integration.
• Knowledge of guardrails, data security and compliance.
• Fluent English (B2+).

Responsibilities

• Build and manage CI/CD pipelines for LLMs and AI agents.
• Orchestrate multi-agent workflows and A2A communications.
• Integrate tools via MCP and secure external APIs.
• Apply IaC across cloud platforms to support GenAI workloads.
• Monitor, log and optimize model serving and inference.
• Ensure security, governance and compliance in GenAI infra.

Skills

Cloud platforms (AWS,GCP,Azure)

CI/CD pipelines

Scripting (Python,Bash)

IaC (Terraform,AWS CDK,CloudFormation)

Docker

Kubernetes

LLM inference & tooling (vLLM, Triton,

Observability & tracing (OpenTelemetry

Retrieval pipelines & vector stores (P

Multi-agent workflows (LangGraph, Crew

Security & guardrails

Education

Master's degree or PhD in CS/AI

Tools

Terraform

Docker

Kubernetes

AWS

GCP

Azure

Model Context Protocol (MCP)

Job description

EPAM Systems is seeking a GenAI Ops Engineer to build, deploy and sustain the operational infra for large-scale generative AI models across major clouds. You will work with data scientists, ML engineers and software developers to ensure scalable, reliable GenAI services and agent ecosystems.

The role requires strong experience in CI/CD, IaC, container orchestration, and monitoring, with a focus on multi-agent workflows and tool integrations. Fluent English is required.