Senior Data Platform Engineer: Azure Fabric & Databricks

Acuity Analytics; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

Acuity Analytics in the UK is seeking a Senior Data Engineer to design, build and optimise modern data platforms using the Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets and help organisations unlock the value of their data through Fabric, Databricks and Azure services.

Working within a collaborative engineering team, you will contribute to cloud-native data solutions, ensuring performance, scalability and governance across enterprise data

Qualifications

• 5+ years of commercial Data Engineer experience.
• Strong PySpark experience.
• Advanced SQL skills.
• Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory, Synapse Pipelines or Fabric Data Factory.
• Experience working with cloud-based data platforms.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Develop ETL/ELT solutions using PySpark and SQL.
• Build data integration solutions using Azure Data Factory and Microsoft Fabric.
• Design scalable lakehouse and data warehouse solutions.
• Optimise data performance, reliability and quality across cloud platforms.
• Collaborate with data scientists, analysts and software engineers to deliver business solutions.
• Implement data governance, security and best practices.
• Participate in code reviews and contribute to engineering standards.
• Troubleshoot production issues and continuously improve platform performance.

Skills

PySpark

SQL

Microsoft Fabric

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Synapse Pipelines

ETL/ELT design

Cloud data platforms

Job description

Acuity Analytics in the UK is seeking a Senior Data Engineer to design, build and optimise modern data platforms using the Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets and help organisations unlock the value of their data through Fabric, Databricks and Azure services.

Working within a collaborative engineering team, you will contribute to cloud-native data solutions, ensuring performance, scalability and governance across enterprise data