Principal Data Engineer | Azure Synapse to Databricks (Hybrid)

Experis Technology Group; Minneapolis (MN); Híbrido; USD 83.000 - 90.000; Jornada completa

Descripción de la vacante

Experis is seeking a Principal Data Engineer to re-engineer a large Azure-based data platform and migrate workloads to Databricks. The role involves hands-on work across ingestion, transformation, and orchestration, with emphasis on data governance and reconciliation.

The candidate will reverse-engineer existing pipelines, validate data quality, and collaborate with governance and architecture teams to ensure a smooth transition to a lakehouse pattern.

Formación

• 7+ years in data engineering or platform migration.
• Hands-on with Azure Synapse and Databricks in migration projects.
• Experience with data governance, SCDs, and data quality controls.

Responsabilidades

• Lead re-engineering of an enterprise data platform from source to consumption.
• Reverse-engineer pipelines, data models, and governance controls.
• Migrate workloads to Databricks Lakehouse with governance intact.
• Collaborate with governance, architecture, and business stakeholders.

Conocimientos

Azure Synapse Analytics

Databricks

Spark (PySpark)

Delta Lake

Azure Data Lake Storage Gen2

Data governance

ETL/ELT

SQL

Python

CI/CD

Herramientas

Terraform

ARM templates

Docker

Azure DevOps

GitHub Actions

Descripción del empleo

Experis is seeking a Principal Data Engineer to re-engineer a large Azure-based data platform and migrate workloads to Databricks. The role involves hands-on work across ingestion, transformation, and orchestration, with emphasis on data governance and reconciliation.

The candidate will reverse-engineer existing pipelines, validate data quality, and collaborate with governance and architecture teams to ensure a smooth transition to a lakehouse pattern.