Data Engineer: Databricks & Azure Platform (Remote)

Ivc; West of England; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Healthcare Cash Plan

Cycle to Work

Green Cars

Voluntary benefits

Staff pet care discount

Retail discounts

Job summary

IVCEvidensia in the UK veterinary sector is seeking a Data Engineer to design, build, and maintain scalable data pipelines on our Databricks platform, orchestrating data from source systems through to the group data platform.

You'll work with SMEs and the Data Architect to translate requirements into robust data solutions, with a focus on ELT, data modelling, and secure, scalable analytics within an Agile, DevOps culture.

Qualifications

• Strong knowledge of Databricks, Delta Lake, Unity Catalog, and Declarative Automation Bundles.
• Proficiency in PySpark for data transformation and processing.
• Solid experience with Azure services including Data Factory, Data Lake Storage, and DevOps.
• Experience with Azure SQL Server as the data warehouse foundation.
• Experience designing and maintaining ELT pipelines using REST APIs, JSON, and ELT protocols.
• Comfort with relational and non-relational data modelling.

Responsibilities

• Own the design, development, and maintenance of data pipelines underpinning our data strategy.
• Collaborate with SMEs and the Data Architect to translate requirements into deliverables.
• Work across Databricks and Azure SQL Server to ensure scalable, secure data solutions.

Skills

Databricks platform expertise

PySpark

Azure ecosystem

Data modelling

Stakeholder communication

Tools

Azure Data Factory

Azure Data Lake Storage

Azure DevOps

Azure SQL Server

Job description

IVCEvidensia in the UK veterinary sector is seeking a Data Engineer to design, build, and maintain scalable data pipelines on our Databricks platform, orchestrating data from source systems through to the group data platform.

You'll work with SMEs and the Data Architect to translate requirements into robust data solutions, with a focus on ELT, data modelling, and secure, scalable analytics within an Agile, DevOps culture.