Data Engineer

Malvern Panalytical; Malvern; On-site; GBP 90,000 - 120,000; Full time

Job summary

Malvern Panalytical is seeking a Senior Data Engineer in the UK to design and own the data foundation powering AI-driven commercial workflows. You will architect, scale, and own data pipelines from CRM/ERP sources, serving as the technical authority for enterprise data.

You will implement governed data contexts, establish feedback loops for continuous learning, and deliver analytics products and Power BI dashboards to measure agent performance and commercial outcomes.

Qualifications

• 6+ years of hands-on data engineering experience in enterprise environments.
• Experience designing end-to-end data architectures and production pipelines.
• Strong expertise in Microsoft data stack (Fabric, Dataverse, Power BI).
• Proficient in Python and SQL.
• Experience with CRM/ERP data integration and API-based patterns.
• Knowledge of data governance, security, and data quality practices.

Responsibilities

• Data Architecture & Pipeline Engineering: Architect, build, and operate resilient data pipelines integrating Salesforce, SAP, and service data into highly governed analytical and operational data products.
• AI Context Management: Design and own the context layer for AI agents with curated, versioned data products and optimized retrieval interfaces.
• Intelligent Feedback Loops: Establish feedback systems to capture outcomes and corrections feeding data products and scoring logic.
• Advanced Reporting & Analytics: Oversee robust Power BI dashboards, semantic models, and datasets covering agent performance and data quality.

Skills

Microsoft data stack

Python

SQL

Power BI

Data architecture

API integration

Tools

Salesforce

SAP

Job description

Role Purpose

As a Senior Data Engineer within our Commercial Digital AI & Automation team, you will design, own, and scale the data foundation powering our next‑generation, AI‑driven commercial workflows. You will serve as the technical authority for our data architecture, designing and implementing highly reliable data pipelines from key CRM and ERP sources. In this role, you will architect the governed context layer that grounds AI agents in accurate business data, establish intelligent feedback loops to drive continuous learning, and deliver the advanced analytical products needed to measure agent performance and commercial outcomes.

Key Responsibilities

• Data Architecture & Pipeline Engineering: Architect, build, and operate resilient data pipelines integrating Salesforce, SAP, and service data into highly governed analytical and operational data products. Lead the technical implementation utilizing Microsoft Fabric, Dataverse, Python, and SQL.
• AI Context Management: Design and own the context layer for AI agents. Deliver curated, versioned data products with strict data contracts, entity resolution, and optimized retrieval interfaces to ground LLM/AI outputs.
• Intelligent Feedback Loops: Establish sophisticated feedback systems to capture agent outcomes, human corrections, and downstream results, seamlessly feeding them back into data products, prioritization models, and scoring logic.
• Advanced Reporting & Analytics: Oversee the delivery of robust Power BI dashboards, semantic models, and datasets covering critical agent performance, pipeline/funnel metrics, and data quality.
• Data Quality, Governance & Security: Set the standards for and implement robust data‑quality frameworks (completeness monitoring, deduplication, entity resolution, and source reconciliation). Define and enforce data lineage, access controls, retention, and compliance protocols in close partnership with IT and data owners.
• Integration Evolution: Drive the modernization of our data landscape by transitioning legacy, file/export‑based flows toward secure, modern, API‑based, in‑perimeter integration patterns.

Role Requirements

• Experience & Autonomy: 6+ years of hands‑on data engineering experience, with a proven track record of owning end‑to‑end data architectures and production pipelines supporting operational (not just analytical) enterprise use cases.
• Technical Stack Expertise: Deep expertise across the Microsoft data stack (Fabric, Dataverse, Power BI) alongside advanced Python and SQL development skills.
• Integration Expertise: Proven experience integrating complex enterprise data from Salesforce and/or SAP, specifically utilizing modern API‑based integration patterns.
• Advanced AI Data Engineering: Direct experience designing data modeling/entity resolution frameworks across CRM/ERP domains, as well as designing context/retrieval layers (e.g., RAG systems) and feedback loops for AI/LLM applications.
• Leadership & Stewardship: Proven ability to make independent architectural and tooling decisions, set technical standards for engineering teams, and ensure the absolute reliability of data feeding customer‑facing AI agents.

Leadership Behaviours

• Inspire Your People: Communicate a compelling technical vision, simplify complex architectural challenges, and plan for the long‑term interest of the business. Bring positive energy, ambition, high integrity, and a proactive willingness to learn from setbacks.
• Strengthen Your Team: Set a high bar for technical excellence, hold peers and collaborators accountable, and foster a growth mindset through coaching, mentoring, and active collaboration.
• Grow Your Business: Implement data strategies that deliver tangible business results. Put customers at the heart of what you build, proactively optimize existing processes, and champion the Spectris Business Systems.

Malvern Panalytical, Micromeritics and SciAps, part of the Spectris Group, are committed to a diverse and inclusive culture where everyone can thrive and achieve a fulfilling career. We encourage applications from underrepresented individuals and people with diverse backgrounds. Although we always select the most qualified applicant for each role and make all decisions without regard to race, sex, age, or any other protected class, we are an inclusive, equal opportunity organization that prizes diversity. Your unique perspective is important to us.