Azure Databricks Data Pipeline Engineer - Hybrid London

Opus Recruitment Solutions Ltd; Greater London; Hybrid; GBP 65,000 - 74,000; Full time

Job summary

Opus Recruitment Solutions Ltd is seeking an Azure Databricks Engineer for a hybrid role in London. You will design, optimise, and monitor data pipelines using Azure Databricks, ensuring reliability and scalability within a data transformation programme.

The contract is Inside IR35, 6 months, with 3 days on site per week in central London. Strong SQL, Python, ETL, and cloud experience are essential, and insurance sector knowledge would be advantageous.

Qualifications

• Experience with Azure Databricks, Spark and big data tooling.
• Proficient in SQL.
• Proficient in Python and ETL processes.
• Familiar with CI/CD practices for data pipelines.
• Insurance sector experience would be advantageous.

Responsibilities

• Design, develop, and optimise data pipelines using Azure Databricks.
• Ensure data reliability, scalability, and quality.
• Integrate data sources into a unified platform.
• Monitor and troubleshoot data workflows.

Tools

Azure Databricks

Spark

Job description

Opus Recruitment Solutions Ltd is seeking an Azure Databricks Engineer for a hybrid role in London. You will design, optimise, and monitor data pipelines using Azure Databricks, ensuring reliability and scalability within a data transformation programme.

The contract is Inside IR35, 6 months, with 3 days on site per week in central London. Strong SQL, Python, ETL, and cloud experience are essential, and insurance sector knowledge would be advantageous.