Senior Data Platform Lead - Real-Time Financial Lakehouse

Airwallex; San Francisco (CA); Vor Ort; USD 255.000 - 300.000; Vollzeit

Zusammenfassung

Airwallex is looking for a Senior Manager of Data Platform Engineering in San Francisco to lead the data backbone of our financial systems. You will set the technical direction for high-volume ingestion, our Databricks lakehouse, and data orchestration, ensuring correctness, auditability, and near real-time capability.

You will mentor senior engineers, establish platform standards, guide migrations from legacy pipelines, and partner with product, accounting, ML, and platform teams to translate

Qualifikationen

• 8+ years in data platform, backend, or infra engineering with leadership experience.
• Proven experience managing senior engineers and building autonomous teams.
• Deep expertise in data platforms, distributed systems, data modeling, and production pipelines.
• Strong experience with Python and SQL, plus Spark, Databricks, Delta Lake, and dbt.

Aufgaben

• Lead and grow the data platform engineering team with technical direction and mentorship.
• Set strategy for high-volume data ingestion and lakehouse evolution with strong guarantees around correctness and replayability.
• Own migrations from legacy pipelines to lakehouse with validated parity and staged rollouts.
• Partner with product, accounting, ML, and platform leadership to translate business needs into scalable data platform capabilities.

Kenntnisse

Leadership

Python

SQL

Distributed systems

Data modeling

Communication

Tools

Databricks

Spark

Delta Lake

dbt

GCP

Terraform

Kubernetes

Jobbeschreibung

Airwallex is looking for a Senior Manager of Data Platform Engineering in San Francisco to lead the data backbone of our financial systems. You will set the technical direction for high-volume ingestion, our Databricks lakehouse, and data orchestration, ensuring correctness, auditability, and near real-time capability.

You will mentor senior engineers, establish platform standards, guide migrations from legacy pipelines, and partner with product, accounting, ML, and platform teams to translate