Principal Data Engineer – Lakehouse Migration & Governance

Allianz Technology; Minneapolis (MN); Hybrid; USD 110,000 - 150,000; Full time

Benefits offered by this job

Health insurance

401(K) with company match

Company paid holidays

Paid time off

Tuition reimbursement

Paid parental leave

Employee shares program

Employee discounts

Job summary

Allianz Technology seeks a senior data engineer to re-engineer a large enterprise data platform, spanning ingestion to consumption. You will reverse-engineer pipelines, validate data models, governance controls, and implement target-state lakehouse designs aligned to modern patterns.

With 7+ years in data engineering, you will migrate workloads to Databricks/Synapse Lakehouse, ensure data quality and governance, and mentor junior engineers while collaborating with governance and business

Qualifications

• Hands-on experience with modern lakehouse architectures and data governance patterns.
• Proven ability to re-engineer complex enterprise data platforms end-to-end.
• Strong skills in SQL, Python and Spark for large-scale data processing.
• Experience migrating workloads to Databricks and Synapse Lakehouse environments.
• Familiarity with CI/CD for data pipelines and infrastructure as code.
• Knowledge of SCD, CDC, data quality controls, and audit trails.

Responsibilities

• Contribute to technical assessment and re-engineering of an enterprise data platform from ingestion to consumption.
• Reverse-engineer and validate pipeline logic, data models, and governance controls.
• Identify gaps and technical debt; remediate sub-optimal implementations.
• Ensure correctness of data processing patterns including CDC and SCD handling.
• Implement target-state designs aligned to lakehouse principles with feature parity.
• Support evolution initiatives with parallel-run validations before cutover.
• Migrate workloads to modern data platforms while preserving governance semantics.
• Re-implement pipelines on target platforms; maintain audit, quality, and reconciliation standards.
• Collaborate with stakeholders to validate embedded business rules and data quality.
• Mentor engineers, review designs, and support decommissioning of legacy components.

Skills

Azure Synapse

Databricks

PySpark

Python

SQL

Data governance

SCD CDC

Lakehouse design

Data modeling

CI/CD

Terraform

Docker

YAML

Stakeholder collaboration

Tools

ADLS Gen2

Delta Lake

Oracle GoldenGate

Power BI

Azure SQL Data

Unity Catalog

Purview

Job description

Allianz Technology seeks a senior data engineer to re-engineer a large enterprise data platform, spanning ingestion to consumption. You will reverse-engineer pipelines, validate data models, governance controls, and implement target-state lakehouse designs aligned to modern patterns.

With 7+ years in data engineering, you will migrate workloads to Databricks/Synapse Lakehouse, ensure data quality and governance, and mentor junior engineers while collaborating with governance and business