Lead Data Platform Engineer for AI-Driven Analytics

Anaplan; City of Westminster; On-site; GBP 110,000 - 140,000; Full time

Job summary

Anaplan is seeking a Principal Data Engineer to lead the data platform direction across ingestion, transformation, storage, serving and governance at scale. You will build high‑performing pipelines and establish standards that empower business users with massive datasets for planning, analytics and AI initiatives.

You will own data architecture, distributed processing, and modern data stack choices, collaborating with analytics, product and platform teams to deliver robust, scalable data

Qualifications

• Extensive data engineering experience across large-scale data platforms.
• Hands-on delivery of end-to-end data pipelines in production.
• Strong knowledge of distributed processing and data governance.
• Expertise in SQL and Python for data transformation and analytics.

Responsibilities

• Lead architecture, design, and deployment of scalable Big Data systems.
• Build robust ETL/ELT pipelines and data ingestion frameworks.
• Design storage layers including data lakes and data warehouses.
• Collaborate with analytics and platform teams to model data semantics.
• Ensure data quality, governance, and reliability across assets.
• Evaluate new tools and modern data stack components for adoption.

Skills

Distributed computing

Data architecture

Software engineering

SQL

Python

Data governance

Data quality

ETL/ELT design

Real-time & batch processing

Cloud data platforms

Data modeling

Collaboration with analytics teams

Tools

Apache Spark

Flink

Hadoop

Apache Kafka

Kinesis

Airflow

Dagster

Snowflake

BigQuery

Redshift

Databricks

Delta Lake

Apache Iceberg

Vector databases

NoSQL / Document stores

Job description

Anaplan is seeking a Principal Data Engineer to lead the data platform direction across ingestion, transformation, storage, serving and governance at scale. You will build high‑performing pipelines and establish standards that empower business users with massive datasets for planning, analytics and AI initiatives.

You will own data architecture, distributed processing, and modern data stack choices, collaborating with analytics, product and platform teams to deliver robust, scalable data