Remote Azure Data Engineer - Databricks & Synapse

Tenth Revolution Group; Remote; GBP 100,000 - 125,000; Full time

Job summary

A leading recruitment agency in the UK is seeking an experienced Azure Data Engineer to design and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks and Azure Synapse Analytics, as well as a passion for transforming raw data into reliable datasets. Key responsibilities include developing data pipelines using Azure services and collaborating with stakeholders to deliver solutions. This is a remote role with competitive pay and benefits.

Qualifications

• 3+ years of experience as a Data Engineer or in a similar role.
• Strong experience with Azure Databricks (PySpark, Spark SQL).
• Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools).
• Solid understanding of data warehousing concepts and dimensional modeling.
• Proficiency in SQL and Python.
• Experience with Azure data services like Azure Data Lake Storage, Azure Data Factory, and Azure SQL.
• Familiarity with CI/CD pipelines and version control (Git, Azure DevOps).
• Experience working in Agile/Scrum environments.

Responsibilities

• Design, develop, and optimize end-to-end data pipelines using Azure services.
• Build and maintain scalable ETL/ELT workflows using Azure Databricks.
• Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics.
• Ingest data from multiple sources into Azure data platforms.
• Implement data modeling, transformation, and validation to ensure data quality.
• Optimize performance, cost, and scalability of data pipelines and queries.
• Collaborate with data analysts and stakeholders to deliver data solutions.
• Implement security, governance, and compliance best practices.
• Monitor, troubleshoot, and resolve pipeline and performance issues.
• Document data architecture, pipelines, and operational processes.

Skills

Azure Databricks (PySpark, Spark SQL)

Azure Synapse Analytics

SQL

Python

Azure Data Lake Storage (ADLS Gen2)

Azure Data Factory

Azure SQL

CI/CD pipelines

Git

Agile/Scrum

Tools

DevOps

Power BI

Job description

A leading recruitment agency in the UK is seeking an experienced Azure Data Engineer to design and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks and Azure Synapse Analytics, as well as a passion for transforming raw data into reliable datasets. Key responsibilities include developing data pipelines using Azure services and collaborating with stakeholders to deliver solutions. This is a remote role with competitive pay and benefits.