GenAI Ops Engineer: Build, Scale & Secure AI Pipelines

EPAM Systems; Turkey; Sur place; TRY 2 917 000 - 4 375 000; Plein temps

Avantages offerts par ce poste

Private health insurance

English courses

Continuous upskilling

Résumé du poste

EPAM Systems is seeking a GenAI Ops Engineer to build, deploy and sustain the operational infra for large-scale generative AI models across major clouds. You will work with data scientists, ML engineers and software developers to ensure scalable, reliable GenAI services and agent ecosystems.

The role requires strong experience in CI/CD, IaC, container orchestration, and monitoring, with a focus on multi-agent workflows and tool integrations. Fluent English is required.

Qualifications

• 3+ years in a DevOps/SRE/MLOps role focused on cloud infra.
• Experience deploying and operating LLM inference services.
• Familiarity with IaC, CI/CD, and container orchestration.
• Hands-on with tracing/metrics and eval pipelines.
• Experience with multi-agent workflows and tool integration.
• Knowledge of guardrails, data security and compliance.
• Fluent English (B2+).

Responsabilités

• Build and manage CI/CD pipelines for LLMs and AI agents.
• Orchestrate multi-agent workflows and A2A communications.
• Integrate tools via MCP and secure external APIs.
• Apply IaC across cloud platforms to support GenAI workloads.
• Monitor, log and optimize model serving and inference.
• Ensure security, governance and compliance in GenAI infra.

Connaissances

Cloud platforms (AWS,GCP,Azure)

CI/CD pipelines

Scripting (Python,Bash)

IaC (Terraform,AWS CDK,CloudFormation)

Docker

Kubernetes

LLM inference & tooling (vLLM, Triton,

Observability & tracing (OpenTelemetry

Retrieval pipelines & vector stores (P

Multi-agent workflows (LangGraph, Crew

Security & guardrails

Formation

Master's degree or PhD in CS/AI

Outils

Terraform

Docker

Kubernetes

AWS

GCP

Azure

Model Context Protocol (MCP)

Description du poste

EPAM Systems is seeking a GenAI Ops Engineer to build, deploy and sustain the operational infra for large-scale generative AI models across major clouds. You will work with data scientists, ML engineers and software developers to ensure scalable, reliable GenAI services and agent ecosystems.

The role requires strong experience in CI/CD, IaC, container orchestration, and monitoring, with a focus on multi-agent workflows and tool integrations. Fluent English is required.