Senior Data Platform Engineer - AI Pipelines (Hybrid Dublin)

Dow Jones; Dublin; Hybrid; EUR 100,000 - 130,000; Full time

Job summary

Storyful is hiring a Senior Data Platform Engineer to build scalable data pipelines and AI-ready infrastructure in Dublin. The role blends hands-on coding with leadership across data ingestion, processing, and platform reliability.

You will partner with ML and product teams to turn diverse data into production-ready capabilities, shaping storage, retrieval, and observability foundations for AI products. Hybrid work in Dublin is available.

Qualifications

• Strong experience in data engineering or platform engineering in production environments.
• Excellent Python skills and solid SQL fundamentals.
• Experience building reliable ingestion and transformation pipelines at scale.
• Strong understanding of data modeling across structured and unstructured datasets.
• Experience with workflow orchestration tools such as Airflow, Dagster, Prefect, Temporal, or equivalent.
• Strong cloud engineering experience in AWS, GCP, or Azure, with clear transferability across platforms.
• Experience with infrastructure as code and modern deployment practices.

Responsibilities

• Design and build scalable batch and streaming pipelines for structured, semi-structured, and unstructured data.
• Own the ingestion and processing architecture for documents, text, metadata, and other content sources.
• Build robust data workflows for parsing, chunking, enrichment, indexing, and retrieval.
• Create the platform foundations for AI products, including orchestration, data quality, observability, lineage, and cost-aware processing.
• Design storage patterns across object stores, relational databases, search/vector systems, and where appropriate graph or knowledge-based systems.
• Partner with ML and product engineering to productionise AI features, agentic workflows, and retrieval-backed user experiences.
• Define data contracts, schema evolution practices, and quality controls across services and teams.
• Improve reliability, freshness, and traceability of pipelines that feed customer-facing products.
• Contribute hands-on code while helping set engineering standards and mentoring other engineers.

Skills

Python

SQL

Data engineering

Platform engineering

Airflow

Dagster

Prefect

Temporal

AWS

GCP

Azure

Infrastructure as code

Distributed systems

Job description

Storyful is hiring a Senior Data Platform Engineer to build scalable data pipelines and AI-ready infrastructure in Dublin. The role blends hands-on coding with leadership across data ingestion, processing, and platform reliability.

You will partner with ML and product teams to turn diverse data into production-ready capabilities, shaping storage, retrieval, and observability foundations for AI products. Hybrid work in Dublin is available.