Principal Data Engineer: AI-Powered Data Platform

Anaplan; London; On-site; NOK 1,759,000 - 2,388,000; Full time

Job summary

Anaplan is seeking a Principal Data Engineer to drive the data platform across ingestion, transformation, storage and governance at scale. You will build robust data pipelines for real-time and batch processing to empower analytics and AI initiatives.

You will lead architecture decisions, implement scalable data systems including vector and NoSQL stores, and collaborate across analytics, product and platform teams to evolve data models and workflows.

Qualifications

• Extensive data engineering experience in complex environments.
• Strong knowledge of vector/noSQL/document stores and AI data infra.
• Hands-on production experience building scalable data platforms.
• Experience with Spark, Kafka, Airflow, and cloud data warehouses.
• Proficient in SQL and Python; familiar with CI/CD and IaC practices.

Responsibilities

• Lead the data architecture and deployment of high-throughput data systems.
• Architect and manage foundational data platforms for AI infrastructure.
• Develop end-to-end ETL/ELT pipelines and data ingestion frameworks.
• Design storage and processing layers: data lakes, warehouses, streaming.
• Build feature-rich pipelines handling large-scale enterprise data.
• Scale distributed queries and data transformations for low latency.
• Implement data quality, governance and data observability frameworks.
• Collaborate with analytics, product, and platform teams on data models.

Skills

Data engineering

Big data architecture

Distributed computing

ETL/ELT pipelines

Python

SQL

CI/CD

Data quality

Data governance

Cloud data platforms

Tools

Apache Spark

Apache Kafka

Airflow

Snowflake

Databricks

Delta Lake

Hadoop

Dagster

Kinesis

NoSQL databases

Job description

Anaplan is seeking a Principal Data Engineer to drive the data platform across ingestion, transformation, storage and governance at scale. You will build robust data pipelines for real-time and batch processing to empower analytics and AI initiatives.

You will lead architecture decisions, implement scalable data systems including vector and NoSQL stores, and collaborate across analytics, product and platform teams to evolve data models and workflows.