Hybrid Data Engineer: Azure & Databricks

ICAEW; Milton Keynes; Hybrid; GBP 48,000 - 53,000; Full time

Benefits offered by this job

Private Medical Insurance

Holiday Buy/Sell Days

Gym Discounts

Travel Loans

Retail Perks

Enhanced Family Leave

Wellbeing Support

Volunteer Day

Job summary

ICAEW in Milton Keynes is seeking a Data Engineer to design and build data pipelines, data models and integrations to support analytics and reporting.

You will work with the Data Engineering Lead, Architects and Analysts to deliver reliable, scalable data solutions. Strong hands-on experience with Azure Data Factory, Databricks, Python and SQL is required. A hybrid working pattern is offered.

Qualifications

• Solid hands-on experience with Azure Data Factory and end-to-end pipeline delivery.
• Proficient in Python, Spark and SQL for data processing and transformation.
• Experience with Databricks in production or near-production environments.
• Practical experience building and maintaining ETL/ELT pipelines in a cloud environment.
• Knowledge of data modelling concepts including star schema and dimensional modelling.

Responsibilities

• Build and maintain robust data pipelines, ingestion processes and integrations using Azure Data Factory and Databricks and related services.
• Develop and maintain datasets and data models to support analytics and reporting, following modelling standards.
• Contribute to data lineage, metadata management and cataloguing practices, including exposure to Purview.
• Collaborate with Lead Data Engineer, Analysts and Architects to develop and improve engineering standards.
• Collaborate with other engineers through pairing, code reviews and shared problem-solving.

Skills

Python

SQL

Spark

Data Modelling

ETL/ELT

Star Schema

Dimensional Modelling

Tools

Azure Data Factory

Databricks

Azure Databricks

Job description

ICAEW in Milton Keynes is seeking a Data Engineer to design and build data pipelines, data models and integrations to support analytics and reporting.

You will work with the Data Engineering Lead, Architects and Analysts to deliver reliable, scalable data solutions. Strong hands-on experience with Azure Data Factory, Databricks, Python and SQL is required. A hybrid working pattern is offered.