Data Engineer

Malvern Panalytical; Weßling; Vor Ort; EUR 90.000 - 140.000; Vollzeit

Zusammenfassung

Malvern Panalytical, part of the Spectris Group, seeks a Senior Data Engineer to design and scale the data foundation powering AI‑driven commercial workflows. You will own end-to-end data pipelines from CRM and ERP sources and architect the governed context layer for AI agents.

You will work with Microsoft Fabric, Dataverse, Python, and SQL to deliver robust data products, intelligent feedback loops, and insightful Power BI dashboards while upholding data quality, governance, and security

Qualifikationen

• 6+ years of hands-on data engineering experience.
• Proven end-to-end data architectures and production pipelines.
• Deep expertise with Microsoft data stack: Fabric, Dataverse, Power BI; Python/SQL.

Aufgaben

• Design, own, and scale data foundation powering AI-driven commercial workflows.
• Architect data pipelines integrating Salesforce and SAP into governed products.
• Develop context layers and retrieval interfaces for AI/LLM applications.
• Deliver Power BI dashboards and semantic models for agent performance metrics.
• Define data quality, governance, and security standards with IT and data owners.
• Modernize data landscape with API-based integrations.

Kenntnisse

Data architecture

End-to-end pipelines

Python

SQL

Power BI

Microsoft Fabric

Dataverse

API integration

AI data engineering (RAG)

Leadership & governance

Tools

Salesforce

SAP

APIs

Jobbeschreibung

Role Purpose

As a Senior Data Engineer within our Commercial Digital AI & Automation team, you will design, own, and scale the data foundation powering our next‑generation, AI‑driven commercial workflows. You will serve as the technical authority for our data architecture, designing and implementing highly reliable data pipelines from key CRM and ERP sources. In this role, you will architect the governed context layer that grounds AI agents in accurate business data, establish intelligent feedback loops to drive continuous learning, and deliver the advanced analytical products needed to measure agent performance and commercial outcomes.

Key Responsibilities

• Data Architecture & Pipeline Engineering: Architect, build, and operate resilient data pipelines integrating Salesforce, SAP, and service data into highly governed analytical and operational data products. Lead the technical implementation utilizing Microsoft Fabric, Dataverse, Python, and SQL.
• AI Context Management: Design and own the context layer for AI agents. Deliver curated, versioned data products with strict data contracts, entity resolution, and optimized retrieval interfaces to ground LLM/AI outputs.
• Intelligent Feedback Loops: Establish sophisticated feedback systems to capture agent outcomes, human corrections, and downstream results, seamlessly feeding them back into data products, prioritization models, and scoring logic.
• Advanced Reporting & Analytics: Oversee the delivery of robust Power BI dashboards, semantic models, and datasets covering critical agent performance, pipeline/funnel metrics, and data quality.
• Data Quality, Governance & Security: Set the standards for and implement robust data‑quality frameworks (completeness monitoring, deduplication, entity resolution, and source reconciliation). Define and enforce data lineage, access controls, retention, and compliance protocols in close partnership with IT and data owners.
• Integration Evolution: Drive the modernization of our data landscape by transitioning legacy, file/export‑based flows toward secure, modern, API‑based, in‑perimeter integration patterns.

Role Requirements

• Experience & Autonomy: 6+ years of hands‑on data engineering experience, with a proven track record of owning end‑to‑end data architectures and production pipelines supporting operational (not just analytical) enterprise use cases.
• Technical Stack Expertise: Deep expertise across the Microsoft data stack (Fabric, Dataverse, Power BI) alongside advanced Python and SQL development skills.
• Integration Expertise: Proven experience integrating complex enterprise data from Salesforce and/or SAP, specifically utilizing modern API‑based integration patterns.
• Advanced AI Data Engineering: Direct experience designing data modeling/entity resolution frameworks across CRM/ERP domains, as well as designing context/retrieval layers (e.g., RAG systems) and feedback loops for AI/LLM applications.
• Leadership & Stewardship: Proven ability to make independent architectural and tooling decisions, set technical standards for engineering teams, and ensure the absolute reliability of data feeding customer‑facing AI agents.

Leadership Behaviours

• Inspire Your People: Communicate a compelling technical vision, simplify complex architectural challenges, and plan for the long‑term interest of the business. Bring positive energy, ambition, high integrity, and a proactive willingness to learn from setbacks.
• Strengthen Your Team: Set a high bar for technical excellence, hold peers and collaborators accountable, and foster a growth mindset through coaching, mentoring, and active collaboration.
• Grow Your Business: Implement data strategies that deliver tangible business results. Put customers at the heart of what you build, proactively optimize existing processes, and champion the Spectris Business Systems.

Malvern Panalytical, Micromeritics and SciAps, part of the Spectris Group, are committed to a diverse and inclusive culture where everyone can thrive and achieve a fulfilling career. We encourage applications from underrepresented individuals and people with diverse backgrounds. Although we always select the most qualified applicant for each role and make all decisions without regard to race, sex, age, or any other protected class, we are an inclusive, equal opportunity organization that prizes diversity. Your unique perspective is important to us.