Senior AI Platform Engineer

EPAM Systems; Poland; Hybrid; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Hybrid work model

Remote in Poland

Work abroad availability

Relocation assistance

Stock purchase plan

Job summary

EPAM Systems is seeking a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform, a production-grade, cloud-native ecosystem for defining, orchestrating, deploying, and observing AI agents at scale.

The role emphasizes standardizing agent development, implementing evaluation frameworks, and building LLM-as-a-Judge and CI/CD gates to accelerate delivery while enforcing security and quality standards.

Qualifications

• Proficient in Python for AI orchestration and automation.
• Hands-on experience with Generative AI and LLMs.
• ML engineering: data prep, vector databases in the cloud, model training/optimisation.
• Experience designing evaluation frameworks for multi-agent systems and tool selection.
• Experience building automated testing and evaluation gates in CI/CD pipelines.
• Familiar with cloud platforms and containerization.
• Knowledge of LangChain and LangGraph for multi-agent workflows.
• Strong backend/frontend architecture knowledge.

Responsibilities

• Develop and launch scalable conversational AI systems across channels.
• Architect microservices and asynchronous systems for AI apps.
• Use Python to implement orchestration and decision logic across tools and workflows.
• Design evaluation gates for autonomous agents, tracking multi-step workflows and session performance.
• Establish automated evaluation protocols using LLM-as-a-judge patterns.
• Tune AI models with fine-tuning and LoRA, selecting approaches between FT vs RAG.
• Collaborate with data specialists to design data pipelines for agent information.
• Design CI/CD pipelines, container standards, and cloud strategies for migrations and high availability.

Skills

Python

LLM evaluation

Cloud infrastructure

LangChain

LangGraph

TensorFlow / PyTorch

Backend architecture

Tools

AWS

GCP

Azure

CI/CD pipelines

Container orchestration

Job description

We are looking for a hands‑on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform, a production‑grade, cloud‑native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The role includes standardizing agent development across the organization, implementing advanced agentic evaluation frameworks (using AWS AgentCore), and building robust LLM‑as‑a‑judge and CI/CD deployment gates to reduce development from months to days while enforcing strict security and quality standards. Strong Python skills and deep expertise in LLM evaluation are required, along with experience in cloud infrastructure.

Responsibilities

• Develop and launch scalable conversational AI systems that operate across multiple channels, including chat, voice, email, and APIs
• Architect microservices and asynchronous systems for AI applications, ensuring high availability and performance
• Use Python to implement orchestration and decision logic - the control layer that manages tools, workflows, and system interactions
• Agentic Evaluation & Quality Gates: Design evaluation frameworks for autonomous agents tracking multi‑step workflows, tool‑calling accuracy, and session performance, integrating automated gates into CI/CD pipelines
• LLM‑as‑a‑Judge & Testing Pipelines: Establish automated evaluation protocols utilizing LLM‑as‑a‑judge patterns
• Optimize AI models through fine‑tuning and LoRA integration, making data‑driven decisions between different approaches (FT vs RAG)
• Work with data specialists to design pipelines for collecting, cleaning, and structuring information for AI agents
• Design CI/CD pipelines, container standards, and cloud strategies for infrastructure migrations, cost optimisation, and high availability

Requirements

• Strong background in Python, mainly for hooking up AI models, automating stuff, and handling orchestration logic
• 1–2 years of hands‑on experience with Generative AI and large language models (LLMs)
• Practical experience in machine learning engineering: data preparation, working with vector databases in the cloud, and training/optimising models
• Expertise in Agentic Evaluation: Hands‑on experience designing evaluation frameworks for complex, multi‑agent systems and evaluating reasoning traces, tool selection, and agentic workflows
• LLMOps & CI/CD Gate Design: Proven experience in building automated testing and evaluation gates within CI/CD pipelines for AI models
• Strong backend and frontend architecture experience
• Experience working with cloud platforms such as AWS, GCP, or Azure, including container orchestration and CI/CD pipelines
• Experience with agentic frameworks (LangChain, LangGraph) and multi‑agent system design
• Comfort with ML frameworks such as TensorFlow, PyTorch, or Scikit-learn is a plus

We offer

• We gather like‑minded people:
• Top tech minds driving innovation in AI, cloud and digital platform modernization
• Supportive team and agile, startup‑like culture
• Hybrid by design mode and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business‑driven relocation opportunities
• Thought leadership, mentoring, soft skills and well‑being programmes
• We cover it all:
• Participation in the Employee Stock Purchase Plan with a 15% discount
• Referral bonuses up to $2,000
• Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
• Corporate, social and well‑being events
• Please, note:
• Benefits listed above are available to employees only
• We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
• We will reach out to selected candidates exclusively

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI‑Native enterprises, driving measurable value from innovation and digital investments.