Principal Data Engineer – Lakehouse Migration & Governance

Allianz Technology; Minneapolis (MN); Hybride; USD 110 000 - 150 000; Plein temps

Avantages offerts par ce poste

Health insurance

401(K) with company match

Company paid holidays

Paid time off

Tuition reimbursement

Paid parental leave

Employee shares program

Employee discounts

Résumé du poste

Allianz Technology seeks a senior data engineer to re-engineer a large enterprise data platform, spanning ingestion to consumption. You will reverse-engineer pipelines, validate data models, governance controls, and implement target-state lakehouse designs aligned to modern patterns.

With 7+ years in data engineering, you will migrate workloads to Databricks/Synapse Lakehouse, ensure data quality and governance, and mentor junior engineers while collaborating with governance and business

Qualifications

• Hands-on experience with modern lakehouse architectures and data governance patterns.
• Proven ability to re-engineer complex enterprise data platforms end-to-end.
• Strong skills in SQL, Python and Spark for large-scale data processing.
• Experience migrating workloads to Databricks and Synapse Lakehouse environments.
• Familiarity with CI/CD for data pipelines and infrastructure as code.
• Knowledge of SCD, CDC, data quality controls, and audit trails.

Responsabilités

• Contribute to technical assessment and re-engineering of an enterprise data platform from ingestion to consumption.
• Reverse-engineer and validate pipeline logic, data models, and governance controls.
• Identify gaps and technical debt; remediate sub-optimal implementations.
• Ensure correctness of data processing patterns including CDC and SCD handling.
• Implement target-state designs aligned to lakehouse principles with feature parity.
• Support evolution initiatives with parallel-run validations before cutover.
• Migrate workloads to modern data platforms while preserving governance semantics.
• Re-implement pipelines on target platforms; maintain audit, quality, and reconciliation standards.
• Collaborate with stakeholders to validate embedded business rules and data quality.
• Mentor engineers, review designs, and support decommissioning of legacy components.

Connaissances

Azure Synapse

Databricks

PySpark

Python

SQL

Data governance

SCD CDC

Lakehouse design

Data modeling

CI/CD

Terraform

Docker

YAML

Stakeholder collaboration

Outils

ADLS Gen2

Delta Lake

Oracle GoldenGate

Power BI

Azure SQL Data

Unity Catalog

Purview

Description du poste

Allianz Technology seeks a senior data engineer to re-engineer a large enterprise data platform, spanning ingestion to consumption. You will reverse-engineer pipelines, validate data models, governance controls, and implement target-state lakehouse designs aligned to modern patterns.

With 7+ years in data engineering, you will migrate workloads to Databricks/Synapse Lakehouse, ensure data quality and governance, and mentor junior engineers while collaborating with governance and business