Principal Data Engineer: AI Data Platform Leader

Anaplan; Philadelphia (Philadelphia County); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Anaplan seeks a Principal Data Engineer to lead the data architecture across our scalable platform, enabling real-time and batch processing for enterprise planning and AI initiatives. You will shape data pipelines, storage, and governance to support massive data volumes and fast analytics.

You will collaborate with analytics, product, and platform teams, mentor engineers, and stay current with the modern data stack, cloud technologies, and observability practices in a hybrid, US-time-zone

Qualifications

• Extensive data engineering experience in complex data environments.
• Knowledge of vector, NoSQL, and document stores for AI infra.
• Hands-on experience building large-scale data platforms in production.
• Experience with Spark, Kafka, and data orchestration tools.

Responsibilities

• Lead data architecture and deployment of scalable, high-throughput systems.
• Design and manage foundational data systems for AI infrastructure.
• Develop end-to-end data pipelines and API services.
• Build storage/processing layers for analytics workloads (data lakes/warehouses).
• Collaborate with analytics, product, and platform teams on data models.

Skills

Data engineering

Big data pipelines

Distributed computing

Apache Spark

Apache Kafka

Python

SQL

CI/CD

Tools

Snowflake

BigQuery

Databricks

Redshift

Airflow

Dagster

Job description

Anaplan seeks a Principal Data Engineer to lead the data architecture across our scalable platform, enabling real-time and batch processing for enterprise planning and AI initiatives. You will shape data pipelines, storage, and governance to support massive data volumes and fast analytics.

You will collaborate with analytics, product, and platform teams, mentor engineers, and stay current with the modern data stack, cloud technologies, and observability practices in a hybrid, US-time-zone