Senior Data Engineer: Azure Fabric & Data Platform Expert

Acuity Analytics; Bristol; On-site; GBP 70,000 - 110,000; Full time

Job summary

Acuity Analytics is seeking a Senior Data Engineer to design, build and optimize modern data platforms using the Microsoft Azure ecosystem. You will develop scalable data pipelines with PySpark and SQL, leveraging Microsoft Fabric, Azure Databricks and Azure Synapse Analytics to help organisations unlock the value of their data.

Working within a collaborative engineering team, you will implement data governance, security and best practices, troubleshoot production issues and continuously improve

Qualifications

• Strong commercial experience as a Data Engineer (5+ years).
• Strong experience with PySpark.
• Advanced SQL skills.
• Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory (ADF), Synapse Pipelines or Microsoft Fabric Data Factory.
• Experience working with cloud-based data platforms.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Develop ETL/ELT solutions using PySpark and SQL.
• Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric.
• Design scalable lakehouse and data warehouse solutions.
• Optimise data performance, reliability and quality across cloud platforms.
• Collaborate with data scientists, analysts and software engineers to deliver business solutions.
• Implement data governance, security and best practices.
• Participate in code reviews and contribute to engineering standards.
• Troubleshoot production issues and continuously improve platform performance.

Skills

PySpark

SQL

Microsoft Fabric

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Synapse Pipelines

Fabric Data Factory

Job description

Acuity Analytics is seeking a Senior Data Engineer to design, build and optimize modern data platforms using the Microsoft Azure ecosystem. You will develop scalable data pipelines with PySpark and SQL, leveraging Microsoft Fabric, Azure Databricks and Azure Synapse Analytics to help organisations unlock the value of their data.

Working within a collaborative engineering team, you will implement data governance, security and best practices, troubleshoot production issues and continuously improve