Senior Data Platform Engineer — Real-Time AI Infra

Anaplan; United States; Hybrid; USD 170,000 - 210,000; Full time

Job summary

Anaplan is seeking a Principal Data Engineer to own the data architecture and drive scalable data pipelines across our AI-enabled planning platform. You will lead end-to-end data systems from ingestion to governance, enabling real-time and batch analytics across massive datasets.

You will collaborate with analytics, product, and platform teams to model customer metrics and build robust data infrastructure using modern tools. Hybrid work with onsite days for some US-based employees.

Qualifications

• Extensive data engineering experience in complex environments.
• Deep understanding of vector, NoSQL, and document stores for AI infrastructure.
• Hands-on building and shipping large-scale data platforms in production.
• Strong experience with distributed data processing frameworks (Spark/Flink/Hadoop).
• Proficient with message brokers and streaming (Kafka/Kinesis).
• End-to-end data pipeline lifecycle including Airflow/Dagster workflows.
• Experience with cloud data warehouses (Snowflake/BigQuery/Redshift) and data lakes (Databricks/Delta Lake/Iceberg).
• Advanced SQL and Python; solid software development practices (testing, CI/CD, IaC).

Responsibilities

• Lead architecture, design, and deployment of scalable data systems into prod.
• Develop end-to-end ETL/ELT pipelines and data ingestion frameworks.
• Build storage and processing layers for analytics workloads (data lakes/warehouses).
• Create feature pipelines for enterprise datasets with batch and streaming balance.
• Optimize distributed queries and data transformations for low latency.
• Implement data quality, governance, and observability across assets.
• Collaborate with analytics, product, and platform teams on data models.
• Evaluate new tools and frameworks within the modern data stack.

Skills

Data engineering

Data architecture

Big data platforms

Spark/Flink/Hadoop

Kafka/Kinesis

Airflow/Dagster

Cloud data warehouses

Snowflake

BigQuery

Redshift

SQL

Python

CI/CD

IaC

Tools

Databricks

Delta Lake

Iceberg

Snowflake

BigQuery

Redshift

Airflow

Dagster

Job description

Anaplan is seeking a Principal Data Engineer to own the data architecture and drive scalable data pipelines across our AI-enabled planning platform. You will lead end-to-end data systems from ingestion to governance, enabling real-time and batch analytics across massive datasets.

You will collaborate with analytics, product, and platform teams to model customer metrics and build robust data infrastructure using modern tools. Hybrid work with onsite days for some US-based employees.