Principal AI & Data Engineer - Hybrid GenAI Pipelines

EPAM Systems; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

EPAM ESPP

Private medical insurance

Dental care

Life assurance

Pension plan

Lunch on Wednesdays in-office

In-office massages

Job summary

EPAM Systems in London is seeking a Principal AI & Data Engineer to design, build and productionize enterprise-grade AI and GenAI solutions on Azure and Databricks.

You will lead the development of scalable AI applications, intelligent agents and data-driven systems powered by LLMs, with hands-on experience across AI data engineering, cloud tech and GenAI adoption to drive innovation, reliability and scalability.

Qualifications

• Bachelor’s or Master’s degree in Statistics, Mathematics, Econometrics, Computer Science or a related field
• 8+ years of experience delivering data engineering, ML or AI solutions in enterprise environments
• Strong AI Data Engineering expertise with production-grade AI/GenAI systems
• Hands-on experience with Azure AI Foundry, Azure cloud services and Databricks AI technologies
• Deep understanding of LLMs and Retrieval-Augmented Generation (RAG) solutions
• Strong experience with MLflow, GenAI evaluation frameworks and model benchmarking methodologies
• Advanced programming in Python and SQL; solid data modeling and ETL/ELT skills
• Delta Lake, Delta Live Tables, Unity Catalog, Spark Structured Streaming and large-scale data processing

Responsibilities

• Develop and evaluate AI, GenAI and Agentic AI solutions using enterprise AI platforms and frameworks
• Build and optimize Retrieval-Augmented Generation (RAG) applications with embeddings, prompts and evaluation
• Design, develop and deploy AI agents using LangChain, LangGraph, AutoGen and similar frameworks
• Create scalable AI workflows using Databricks, MLflow, Azure AI Foundry and cloud services
• Build and maintain robust data pipelines using modern data engineering practices and streaming tech
• Deploy AI apps using Azure OpenAI, Azure AI Foundry, Databricks AI tools and Docker
• Design evaluation frameworks to measure model quality, reliability and reproducibility
• Implement CI/CD pipelines, tests, code quality controls and GitHub processes
• Collaborate with stakeholders to translate business needs into scalable AI solutions
• Contribute to architecture decisions, roadmaps and backlog from prototype to production

Skills

AI Data Engineering

Python

SQL

ETL/ELT

Delta Lake

Spark Structured Streaming

CI/CD

Education

Bachelor’s or Master’s degree in Statistics, Mathematics, Econometrics, Computer Science or related field

Tools

Databricks

Azure AI Foundry

Azure OpenAI

LangChain

LangGraph

AutoGen

GitHub

Job description

EPAM Systems in London is seeking a Principal AI & Data Engineer to design, build and productionize enterprise-grade AI and GenAI solutions on Azure and Databricks.

You will lead the development of scalable AI applications, intelligent agents and data-driven systems powered by LLMs, with hands-on experience across AI data engineering, cloud tech and GenAI adoption to drive innovation, reliability and scalability.