Senior AI Platform Engineer — Production‑Ready LLM & RAG

EPAM Systems, Inc.; Turkey; On-site; TRY 450,000 - 750,000; Full time

Job summary

EPAM Systems, Inc. seeks a Senior AI Engineer to build an enterprise AI platform with Databricks-native components. You will design and deploy AI agents across GCP and Azure, ensuring robust, scalable, and compliant solutions within the platform’s shared services.

You will own the RAG pipelines, integrate with MCP servers and LLM Gateway, and implement guardrails and evaluation loops to meet quality standards. Strong Python, prompt engineering, and Databricks expertise are required.

Qualifications

• 3+ years of experience building LLM-based applications in Python.
• Hands-on experience with RAG pipelines, retrieval, chunking, embedding, reranking, and generation.
• Proficiency in prompt engineering, including system prompts, few-shot patterns, and output structuring.
• Experience with LLM orchestration frameworks such as LangChain, LlamaIndex, or equivalent.
• Familiarity with LLM evaluation techniques, including LLM-as-judge, RAG faithfulness metrics, and RAGAS or equivalent.
• Expertise in Databricks and MLflow, including experiment tracking and model serving awareness.
• Knowledge of MCP (Model Context Protocol) or equivalent tool-use / function-calling patterns.
• Experience with vector stores such as Chroma, Pinecone, or Databricks Vector Search.

Responsibilities

• Participate in use case deep-dive sessions and translate business requirements into specifications.
• Design and implement the RAG pipeline including document retrieval and embedding.
• Integrate agents with platform MCP servers and LLM Gateway for routing.
• Implement prompt engineering practices and iteratively improve prompts.
• Wire guardrails for reference agents and protect against prompt injections.
• Run evaluation cycles using the platform Evaluation Framework to meet quality gates.
• Collaborate on data schema and retrieval interface design with Data Engineers.

Skills

Python

RAG pipelines

Prompt engineering

LangChain

LLM evaluation

Vector stores

REST API

OAuth

English communication

Tools

Databricks

MLflow

Chroma

Pinecone

Databricks Vector Search

Job description

EPAM Systems, Inc. seeks a Senior AI Engineer to build an enterprise AI platform with Databricks-native components. You will design and deploy AI agents across GCP and Azure, ensuring robust, scalable, and compliant solutions within the platform’s shared services.

You will own the RAG pipelines, integrate with MCP servers and LLM Gateway, and implement guardrails and evaluation loops to meet quality standards. Strong Python, prompt engineering, and Databricks expertise are required.