Senior Data Engineer: AI-Driven Pipelines & Governance

Malvern Panalytical; Malvern; On-site; GBP 90,000 - 120,000; Full time

Job summary

Malvern Panalytical is seeking a Senior Data Engineer in the UK to design and own the data foundation powering AI-driven commercial workflows. You will architect, scale, and own data pipelines from CRM/ERP sources, serving as the technical authority for enterprise data.

You will implement governed data contexts, establish feedback loops for continuous learning, and deliver analytics products and Power BI dashboards to measure agent performance and commercial outcomes.

Qualifications

• 6+ years of hands-on data engineering experience in enterprise environments.
• Experience designing end-to-end data architectures and production pipelines.
• Strong expertise in Microsoft data stack (Fabric, Dataverse, Power BI).
• Proficient in Python and SQL.
• Experience with CRM/ERP data integration and API-based patterns.
• Knowledge of data governance, security, and data quality practices.

Responsibilities

• Data Architecture & Pipeline Engineering: Architect, build, and operate resilient data pipelines integrating Salesforce, SAP, and service data into highly governed analytical and operational data products.
• AI Context Management: Design and own the context layer for AI agents with curated, versioned data products and optimized retrieval interfaces.
• Intelligent Feedback Loops: Establish feedback systems to capture outcomes and corrections feeding data products and scoring logic.
• Advanced Reporting & Analytics: Oversee robust Power BI dashboards, semantic models, and datasets covering agent performance and data quality.

Skills

Microsoft data stack

Python

SQL

Power BI

Data architecture

API integration

Tools

Salesforce

SAP

Job description

Malvern Panalytical is seeking a Senior Data Engineer in the UK to design and own the data foundation powering AI-driven commercial workflows. You will architect, scale, and own data pipelines from CRM/ERP sources, serving as the technical authority for enterprise data.

You will implement governed data contexts, establish feedback loops for continuous learning, and deliver analytics products and Power BI dashboards to measure agent performance and commercial outcomes.