Lead AI Engineer with Databricks, Agentic AI

EPAM Systems; Turkey; On-site; TRY 5,926,000 - 8,889,000; Full time

Benefits offered by this job

Continuous upskilling

Corporate benefits

USD compensation

Private health insurance

IT equipment

Job summary

EPAM Systems is seeking a Lead AI Engineer to join our Trinity data platform team for PLM use cases. You will embed in the client's PLM group to design, build and operate the core intelligence layer, leveraging Databricks for agentic solutions and AI governance.

You will own end-to-end development of ingestion pipelines, information extraction, LLM-driven grouping, and a React-based front-end, while aligning with Azure networking and graph database integration.

Qualifications

• 5+ years of experience in AI/data engineering with Databricks expertise.
• Proficiency in ai_parse_document and Agent Bricks for ingestion/extraction.
• Strong Python skills (PySpark, pandas) and FastAPI.
• Frontend experience with React and REST integration.
• Familiarity with Azure networking and private endpoints.
• Knowledge of Graph Databases and Delta Lake/Lakebase.

Responsibilities

• Embed within the client's PLM team from day one to understand workflows.
• Design and implement document ingestion pipelines using Databricks ai_parse_document.
• Build and maintain Agent Bricks pipelines to extract structured fields from documents.
• Develop LLM-powered grouping and recommendation logic with ai_query and Model Serving.
• Build Databricks Apps front-end (React + Python) with upload and human-in-the-loop screens.
• Integrate Graph Database to map relationships between specifications, methods, and AI recommendations.
• Configure Azure Private Link/Private Endpoint connectivity for secure traffic.
• Implement structured logging, lineage tracking in Unity Catalog, and audit trails for governance.
• Contribute to ARB artefacts and technical design documentation.
• Collaborate with Business Analyst to translate PLM requirements into data models and pipelines.

Skills

AI/data engineering

Python

PySpark

FastAPI

LLM prompt engineering

React

REST integration

English (B2+)

Tools

Databricks

Unity Catalog

Model Serving

ai_parse_document

Graph Databases (Neo4j)

Delta Lake/Lakebase

REST API design

Azure DevOps

Job description

We are seeking a Lead AI Engineer with expertise in Databricks and Databricks Agentic AI processes to join our team. The successful candidate will play a crucial role in delivering agentic solutions within our Trinity data platform for PLM use cases. This position requires a seasoned professional with a strong background in AI engineering and a track record of leveraging Databricks for building agents, fully embedded within the PLM team to design, build and operate the core intelligence layer of the client's Product Lifecycle Management solution.

Responsibilities

• Embed fully within the client's PLM team from day one to understand supplier specification workflows, test method structures and properties management before writing a line of code
• Design and implement the document ingestion pipeline using Databricks ai_parse_document for PDF, Excel and Word supplier specification files, storing artifacts in Unity Catalog Volumes
• Build and maintain Agent Bricks (Information Extraction) pipelines to extract structured fields from supplier documents against the canonical PLM data model
• Develop and optimize LLM-powered grouping and recommendation logic using ai_query and Databricks Model Serving, to ensure outputs are explainable and auditable
• Build the Databricks Apps front-end (React + Python backend), including file upload, metadata grids, dropdown-driven forms, human-in-the-loop review/approval screens and write-back to Lakebase
• Integrate the Graph Database layer to store and traverse relationships between specifications, properties, test methods and AI recommendations
• Configure and maintain Azure Private Link / Private Endpoint connectivity, including DNS forwarding for databricksapps.com, to ensure all traffic stays within the client's corporate network perimeter
• Implement structured logging, lineage tracking in Unity Catalog, and audit trails to support Responsible AI governance requirements
• Contribute to ARB artefacts and technical design documentation as required
• Collaborate daily with the Business Analyst to translate PLM domain requirements into working data models and pipeline logic, and with the Delivery Manager to surface risks and effort estimates

Requirements

• 5+ years of experience in AI/data engineering, with expertise in Databricks, including Unity Catalog, Volumes and Model Serving
• Proficiency in ai_parse_document and Agent Bricks for document ingestion and information extraction
• Skills in Python, including PySpark, pandas and FastAPI
• Expertise in React for front-end development, including hooks and REST integration
• Familiarity with Azure networking, including Private Link, Private Endpoints and VNet
• Competency in LLM prompt engineering and ai_query
• Knowledge of Graph Databases such as Neo4j or equivalent
• Background in Delta Lake / Lakebase and REST API design and integration
• Understanding of Azure DevOps (ADO)
• English proficiency at B2 level or higher

Nice to have

• Background in GxP or regulated manufacturing data environments
• Familiarity with the client's Trinity AI governance pattern
• Experience with PLM or ERP systems (SAP, Teamcenter, Enovia)
• Databricks certification (Data Engineer Professional or ML Professional)
• Exposure to graph data modeling and lineage use cases

We offer

• CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
  • Diversity of tasks and projects
  • Assessment center for objective review of competency level
  • Personal development plan
  • Mentoring programs and leadership development
  • Certification and professional development support
  • Access to learning platforms including more than 2,500 internal courses
  • English courses taught by certified teachers
• CORPORATE BENEFITS
  • Extra leave days
  • Referral bonuses
• COMPENSATION PACKAGE
  • Competitive compensation paid in USD
  • Regular salary and performance reviews
• MEDICAL & HEALTHCARE
  • Private health insurance
  • Well-being events
• WORKING ENVIRONMENT
  • Recreation areas and kitchens
  • Tea, coffee and snacks
  • Sports equipment and game consoles
  • IT Equipment
  • Microsoft’s Software Assurance Home Use Program (HUP)

Please note that our Talent Attraction Team reviews applications and CVs submitted in English.

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.