Senior Data Engineer (Microsoft Fabric & Azure Data Platform)

Acuity Analytics; Bristol; On-site; GBP 70,000 - 110,000; Full time

Job summary

Acuity Analytics is seeking a Senior Data Engineer to design, build and optimize modern data platforms using the Microsoft Azure ecosystem. You will develop scalable data pipelines with PySpark and SQL, leveraging Microsoft Fabric, Azure Databricks and Azure Synapse Analytics to help organisations unlock the value of their data.

Working within a collaborative engineering team, you will implement data governance, security and best practices, troubleshoot production issues and continuously improve

Qualifications

• Strong commercial experience as a Data Engineer (5+ years).
• Strong experience with PySpark.
• Advanced SQL skills.
• Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory (ADF), Synapse Pipelines or Microsoft Fabric Data Factory.
• Experience working with cloud-based data platforms.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Develop ETL/ELT solutions using PySpark and SQL.
• Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric.
• Design scalable lakehouse and data warehouse solutions.
• Optimise data performance, reliability and quality across cloud platforms.
• Collaborate with data scientists, analysts and software engineers to deliver business solutions.
• Implement data governance, security and best practices.
• Participate in code reviews and contribute to engineering standards.
• Troubleshoot production issues and continuously improve platform performance.

Skills

PySpark

SQL

Microsoft Fabric

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Synapse Pipelines

Fabric Data Factory

Job description

Please note: for this role, you must be based in UK, Malta, Bulgaria, or Portugal.

The creative mind behind every project. Put your skills to the test to build solutions that continue to shape the world we live in.

About Us

Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you.

Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.

About the Role

We're looking for a Senior Data Engineer to design, build and optimise modern data platforms using the Microsoft Azure ecosystem. You'll develop scalable data pipelines, transform complex datasets, and help organisations unlock the value of their data through Microsoft Fabric, Databricks and Azure services.

Working within a collaborative engineering team, you'll contribute to cloud-native data solutions, ensuring performance, scalability and best practices across enterprise data platforms.

Responsibilities

• Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Develop ETL/ELT solutions using PySpark and SQL.
• Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric.
• Design scalable lakehouse and data warehouse solutions.
• Optimise data performance, reliability and quality across cloud platforms.
• Collaborate with data scientists, analysts and software engineers to deliver business solutions.
• Implement data governance, security and best practices.
• Participate in code reviews and contribute to engineering standards.
• Troubleshoot production issues and continuously improve platform performance.

Requirements

• Strong commercial experience as a Data Engineer (5+ years).
• Strong experience with PySpark.
• Advanced SQL skills.
• Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory (ADF), Synapse Pipelines or Microsoft Fabric Data Factory.
• Experience working with cloud-based data platforms.
• Excellent problem-solving and communication skills.

Nice to Have

• Power BI
• Node.js
• LLM / Generative AI experience
• Data Science experience

Certifications (Preferred)

The following certifications are advantageous but not essential:

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Fabric Data Engineer Associate (DP-700)

People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details