Data Engineer, Databricks & Azure | Remote-First

Jackalope Digital LLC; West of England; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Healthcare

Cycle to Work

Green Cars salary sacrifice

Voluntary benefits

Staff pet care discounts

Retail discounts

Job summary

IVCEvidensia is seeking a Data Engineer to own the design, development, and optimisation of data pipelines on our Databricks platform, ensuring scalable, secure data flows from source systems to the group data platform.

You will collaborate with business SMEs and the Data Architect to implement the data management strategy, leveraging PySpark, Azure Data Factory, and Azure SQL Server within an agile DevOps culture.

Qualifications

• Databricks – hands-on experience building/managing workloads with Delta Lake, Unity Catalog, etc.
• PySpark – proficiency in writing/optimising PySpark code.
• Azure – experience with Azure Data Factory, Data Lake Storage, DevOps.
• Azure SQL Server – experience across SQL Server and Databricks integration.
• ELT & pipeline development – designing/maintaining pipelines via REST APIs, JSON.
• Data modelling – relational and non-relational data modelling fundamentals.

Responsibilities

• Own the design, development, and maintenance of data pipelines powering the data platform.
• Collaborate with business SMEs to translate requirements into deliverables.
• Work with Data Architect to shape the overarching data management strategy.

Skills

Databricks

PySpark

Azure

Azure SQL Server

ELT & pipeline development

Data modelling

Job description

IVCEvidensia is seeking a Data Engineer to own the design, development, and optimisation of data pipelines on our Databricks platform, ensuring scalable, secure data flows from source systems to the group data platform.

You will collaborate with business SMEs and the Data Architect to implement the data management strategy, leveraging PySpark, Azure Data Factory, and Azure SQL Server within an agile DevOps culture.