Senior AI Platform Engineer - Scalable LLM Ops

EPAM Systems; Poland; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid by design

Remote work within Poland

Relocation opportunities

Certifications: Anthropic, Gemini, GCP

Azure, AWS certifications

English classes

Health insurance

Multisport

Shop vouchers

Referral bonuses up to $2000

Job summary

EPAM Systems seeks a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform, a production-grade, cloud-native ecosystem enabling engineering teams to define, orchestrate, deploy, and observe AI agents at scale.

You will standardize agent development, implement advanced agentic evaluation frameworks, and build robust LLM-as-a-judge and CI/CD gates while enforcing strict security and quality standards.

Qualifications

• Strong Python skills for orchestration and automation.
• 1–2 years hands-on Generative AI and LLM experience.
• Practical ML engineering with data prep and cloud vector DBs.
• Experience designing evaluation frameworks for multi-agent systems.
• CI/CD gate design for AI models and automated testing.
• Backend/frontend architecture and cloud platform experience.

Responsibilities

• Develop scalable conversational AI systems across channels.
• Architect microservices and asynchronous systems for AI apps.
• Implement orchestration and decision logic in Python.
• Design evaluation frameworks for autonomous agents and gates.
• Establish automated LLM-as-a-judge patterns and pipelines.
• Tune AI models with fine-tuning/LoRA and model selection strategies.
• Collaborate with data teams to design AI data pipelines.
• Define CI/CD pipelines, container standards, and cloud strategies.

Skills

Python programming

LLM evaluation

Cloud infrastructure

LangChain & LangGraph

CI/CD gates

Backend & frontend architecture

AWS / GCP / Azure

ML engineering (data prep, vector DBs)

TensorFlow / PyTorch / Scikit-learn

Tools

LangChain

LangGraph

Vector databases

TensorFlow

PyTorch

Scikit-learn

Job description

EPAM Systems seeks a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform, a production-grade, cloud-native ecosystem enabling engineering teams to define, orchestrate, deploy, and observe AI agents at scale.

You will standardize agent development, implement advanced agentic evaluation frameworks, and build robust LLM-as-a-judge and CI/CD gates while enforcing strict security and quality standards.