Data Engineer - AI Pipelines & DataOps

Meyandy LLC; Düsseldorf; Hybrid; EUR 70.000 - 110.000; Vollzeit

Zusammenfassung

Intersnack IT KG in Düsseldorf seeks a Data Engineer - AI Pipelines & DataOps to design scalable ingestion pipelines and APIs powering AI and analytics. You will work with AI engineers, data architects, and business teams across manufacturing edge devices and enterprise data platforms, focusing on quality, observability, and continuous improvement.

You will implement batch and streaming pipelines on Microsoft Azure and/or AWS, expose data assets via REST/GraphQL APIs, and apply

Qualifikationen

• Production-grade data pipelines on cloud platforms (Azure/AWS).
• Experience with at least one pipeline/framework (e.g., Apache Spark).
• Experience designing data APIs, data models, and data quality controls.

Aufgaben

• Design and implement scalable data ingestion pipelines for structured and unstructured data sources, including manufacturing systems and edge devices.
• Build and maintain batch and streaming pipelines using cloud-native tooling (Azure or AWS).
• Expose data assets and AI service endpoints via REST/GraphQL APIs for internal consumption.
• Implement CI/CD and DataOps practices for pipeline development and deployment.

Kenntnisse

Data pipelines

Cloud platforms

CI/CD

DataOps

Observability

Tools

Azure Data Factory

Azure Event Hubs

Databricks

AWS Glue

Kinesis

Lake Formation

Apache Spark

Jobbeschreibung

We Want You to Grow With Us High-quality, reliable data is the foundation on which every AI use case is built, and this role is responsible for making that foundation unshakeable. As our Data Engineer for AI Pipelines & DataOps, you will design and deliver the ingestion pipelines, streaming architectures, and APIs that feed Intersnack's AI and analytics systems with the data they need to perform at scale. You will report into the AI Programme and work in close collaboration with AI engineers, data architects, and business teams, with a particular focus on manufacturing environments, where edge device data presents unique ingestion challenges. At Intersnack, we build on a solid digital foundation, and your engineering work will be central to extending that foundation into the AI era.

What We Can Offer

This role offers the opportunity to work across a genuinely diverse data landscape, from manufacturing edge devices and IoT sensors to structured enterprise data systems across procurement and sales, giving you breadth of technical challenge that few data engineering roles can match. You will have direct influence over how AI and analytics use cases are enabled across a 4.5bn euro business, with the autonomy to define pipeline patterns, API standards, and DataOps practices that others will build on. Collaboration is at the heart of how we work, and you will be embedded in a programme team that spans data science, AI architecture, and business enablement. Dusseldorf is the home base, with flexibility for remote working.

How You Will Spend Your Time as Our Next Data Engineer - AI Pipelines & DataOps

You will design and build the data infrastructure that powers Intersnack's AI programme, from scalable ingestion pipelines that handle both structured enterprise data and unstructured signals from manufacturing environments, to the APIs that expose data, models, and AI services for consumption across the organisation. Your work will span architecture, implementation, and operations, with a strong focus on quality, observability, and continuous improvement.

What You Will Do

• Design and implement scalable data ingestion pipelines for structured and unstructured data sources, including manufacturing systems, edge devices, and enterprise data platforms, ensuring consistent data quality from source to consumption
• Build and maintain both batch and streaming data pipelines for analytics and AI use cases, leveraging cloud-native tooling on Microsoft Azure and/or AWS
• Design and expose REST or GraphQL APIs for data assets, machine learning model endpoints, and AI services, enabling reliable, governed consumption by internal applications and analytical systems
• Implement CI/CD practices and DataOps principles across pipeline development and deployment, supporting automated testing, versioning, and release management for data infrastructure
• Ensure data quality, lineage, and observability across all pipelines, implementing monitoring and alerting that surfaces data issues before they affect AI or analytics outputs
• Support the integration of manufacturing and edge device data, including IoT and OT systems, into the central data platform, addressing the specific latency, format, and volume challenges of operational technology environments
• Collaborate with data scientists and AI engineers to design and optimise data flows that support model training, inference, and knowledge retrieval pipelines
• Apply security-by-design practices to all pipeline and API design, including access control, encryption, and protections against data leakage, in line with Intersnack's sovereignty and compliance standards
• Contribute to the AI literacy and enablement programme by supporting colleagues in understanding data pipeline health, data quality standards, and the role of reliable data in AI outcomes

Essential Skills & Experience

• Proven experience designing and implementing production-grade data pipelines using cloud-native services on Microsoft Azure (e.g., Azure Data Factory, Azure Event Hubs, Databricks) and/or AWS (e.g., AWS Glue, Kinesis, Lake Formation)
• Strong proficiency in at least one pipeline or transformation framework (e.g., Apache Spark, db…)

Data Engineer - AI Pipelines & DataOps — Intersnack IT KG, Düsseldorf.

Mots-clés : Information Management.