Azure Databricks Engineer

Opus Recruitment Solutions Ltd; Greater London; Hybrid; GBP 65,000 - 74,000; Full time

Job summary

Opus Recruitment Solutions Ltd is seeking an Azure Databricks Engineer for a hybrid role in London. You will design, optimise, and monitor data pipelines using Azure Databricks, ensuring reliability and scalability within a data transformation programme.

The contract is Inside IR35, 6 months, with 3 days on site per week in central London. Strong SQL, Python, ETL, and cloud experience are essential, and insurance sector knowledge would be advantageous.

Qualifications

• Experience with Azure Databricks, Spark and big data tooling.
• Proficient in SQL.
• Proficient in Python and ETL processes.
• Familiar with CI/CD practices for data pipelines.
• Insurance sector experience would be advantageous.

Responsibilities

• Design, develop, and optimise data pipelines using Azure Databricks.
• Ensure data reliability, scalability, and quality.
• Integrate data sources into a unified platform.
• Monitor and troubleshoot data workflows.

Tools

Azure Databricks

Spark

Job description

Azure Databricks Engineer | Hybrid | London | Inside IR35 | £350 - £400 | 6 months

I'm currently working with a client who is looking for an experienced Azure Databricks Engineer to work 3 days on site in London. You will join a data transformation programme. The role will involve designing and optimising data pipelines, integrating multiple data sources, and ensuring the reliability and scalability of the data platform.

Key Responsibilities:

• Design, develop, and optimize data pipelines using Azure Databricks.
• Ensure data reliability, scalability, and quality.
• Integrate data sources into a unified platform.
• Monitor and troubleshoot data workflows.

Skills Required:

• Expertise in Azure Databricks, Spark, and big data tools.
• Strong SQL skills
• Knowledge of Python, ETL processes and cloud technologies.
• Familiarity with CI/CD practices for data pipelines.
• Experience within the insurance sector would be highly beneficial

If this aligns with your skill set, you are available within 2 weeks and can work 3 days on site in central London per week then please apply for the job advert directly.