Senior Azure Synapse to Databricks Migration Engineer

Primus Connect; United States; Remote; GBP 96,000 - 126,000; Full time

Benefits offered by this job

Fully Remote

Job summary

Primus Connect is seeking a Senior Data Engineer for a 2-month fully remote contract in the UK. You will migrate 72 T-SQL stored procedures from Azure Synapse Dedicated SQL Pool to Databricks, ensuring performance and data accuracy. Strong expertise in Synapse, Databricks, Spark SQL, PySpark, and Delta Lake is essential.

The role focuses on optimizing migration patterns, validating results, and delivering a production-ready solution by end of December 2026. Start date 1 November 2026.

Qualifications

• Hands-on experience migrating complex SQL workloads from Synapse Dedicated SQL Pools to Databricks.
• Experience migrating SQL workloads between MPP SQL environments and Databricks.
• Strong understanding of architecture differences between Synapse SQL and Databricks.

Responsibilities

• Migrate ~72 T-SQL stored procedures from Azure Synapse to Databricks.
• Analyse code dependencies and execution patterns for migration approach.
• Refactor T-SQL logic for Databricks SQL, Spark SQL, and PySpark.
• Ensure datasets and pipelines are available for business consumption.
• Address differences between Synapse and Databricks execution models.
• Optimize query execution and data transformations.
• Validate data accuracy against migration thresholds.
• Troubleshoot migration issues and deliver production-ready solution.

Skills

Azure Synapse

Databricks

T-SQL

PySpark

Spark SQL

Delta Lake

Lakehouse

MPP architecture

Query tuning

Data migration

Tools

Databricks SQL

Azure Synapse Analytics

Job description

Primus Connect is seeking a Senior Data Engineer for a 2-month fully remote contract in the UK. You will migrate 72 T-SQL stored procedures from Azure Synapse Dedicated SQL Pool to Databricks, ensuring performance and data accuracy. Strong expertise in Synapse, Databricks, Spark SQL, PySpark, and Delta Lake is essential.

The role focuses on optimizing migration patterns, validating results, and delivering a production-ready solution by end of December 2026. Start date 1 November 2026.