Azure Data Platform Engineer: Pipelines & Integration

Dains Accountants & Advisers; Birmingham; Hybrid; GBP 55,000 - 75,000; Full time

Benefits offered by this job

Flexible/hybrid working

25 days annual leave

Private medical insurance

Pension scheme

Cycle to work

Life assurance

Annual awards

Community involvement

Job summary

Dains Accountants & Advisers in Birmingham is seeking a Data Engineer to join the Data Team and contribute to the development, operation, and evolution of the Group's DataCube platform. You will integrate new data sources into the DataCube, develop and support data pipelines, and contribute to cloud data architecture.

The successful candidate will work across acquisitions and platform enhancements to support reporting, analytics, automation, and AI, collaborating with IT teams and stakeholders

Qualifications

• Proven experience in a Data Engineer role with hands-on ETL/ELT development.
• Strong SQL skills and ability to work with large data sets.
• Python development experience for data engineering and automation.
• Experience with Azure data technologies and cloud-based data lakes/warehouses.
• Experience designing data models, transformation frameworks and data integration solutions.
• Familiarity with Databricks, Fivetran, or Microsoft Fabric is desirable.

Responsibilities

• Lead data source integrations into the DataCube platform, including acquisitions and key business applications.
• Develop, optimise and maintain data pipelines and ETL/ELT processes.
• Monitor data quality, troubleshoot pipeline failures and implement monitoring/alerts.
• Support deployment and release activities across environments and work with IT teams on platform performance and security.
• Collaborate with analysts and stakeholders to translate requirements into scalable data solutions.

Skills

Data Engineering

SQL

Python

Azure

ETL/ELT

Data Modelling

Data Integration

Tools

Databricks

Fivetran

Microsoft Fabric

Job description

Dains Accountants & Advisers in Birmingham is seeking a Data Engineer to join the Data Team and contribute to the development, operation, and evolution of the Group's DataCube platform. You will integrate new data sources into the DataCube, develop and support data pipelines, and contribute to cloud data architecture.

The successful candidate will work across acquisitions and platform enhancements to support reporting, analytics, automation, and AI, collaborating with IT teams and stakeholders