Senior Data Platform Engineer for AI Products

Dow Jones & Company, Inc.; Dublin; Hybrid; EUR 110,000 - 150,000; Full time

Job summary

Storyful is building the next generation of data and AI products on top of complex, high-volume, multi-source content. We are looking for a hands-on Senior Data Platform Engineer to build the technical foundations that make those products scalable, reliable, and production-ready.

This is a senior individual contributor role spanning data engineering and AI infrastructure, partnering with ML and software engineers, product managers, and leadership to turn raw data into trustworthy product

Qualifications

• Strong experience in data engineering or platform engineering in production environments.
• Excellent Python skills and solid SQL fundamentals
• Experience building reliable ingestion and transformation pipelines at scale
• Strong understanding of data modeling across structured and unstructured datasets
• Experience with workflow orchestration tools such as Airflow, Dagster, Prefect, Temporal, or equivalent
• Strong cloud engineering experience in AWS, GCP, or Azure, with clear transferability across platforms
• Experience with infrastructure as code and modern deployment practices
• Experience with distributed systems, event-driven patterns, and data-intensive applications
• Familiarity with search, vector, or retrieval systems used in AI-backed products
• Ability to work cross-functionally and act as a technical leader without losing hands-on depth

Responsibilities

• Design and build scalable batch and streaming pipelines for structured, semi-structured, and unstructured data
• Own the ingestion and processing architecture for documents, text, metadata, and other content sources
• Build robust data workflows for parsing, chunking, enrichment, indexing, and retrieval
• Create the platform foundations for AI products, including orchestration, data quality, observability, lineage, and cost-aware processing
• Design storage patterns across object stores, relational databases, search/vector systems, and where appropriate graph or knowledge-based systems
• Partner with ML and product engineering to productionise AI features, agentic workflows, and retrieval-backed user experiences
• Define data contracts, schema evolution practices, and quality controls across services and teams
• Improve reliability, freshness, and traceability of pipelines that feed customer-facing products
• Contribute hands-on code while helping set engineering standards and mentoring other engineers

Skills

Python

SQL

Data engineering

Batch processing

Streaming pipelines

Airflow

Dagster

Prefect

Temporal

Cloud platforms

IaC

Distributed systems

Retrieval systems

Knowledge graphs

Tools

Airflow

Dagster

Prefect

Temporal

Job description

Storyful is building the next generation of data and AI products on top of complex, high-volume, multi-source content. We are looking for a hands-on Senior Data Platform Engineer to build the technical foundations that make those products scalable, reliable, and production-ready.

This is a senior individual contributor role spanning data engineering and AI infrastructure, partnering with ML and software engineers, product managers, and leadership to turn raw data into trustworthy product