Azure Databricks Data Pipeline Engineer - Hybrid London

Opus Recruitment Solutions Ltd; Greater London; Ibrido; GBP 65.000 - 74.000; Tempo pieno

Descrizione del lavoro

Opus Recruitment Solutions Ltd is seeking an Azure Databricks Engineer for a hybrid role in London. You will design, optimise, and monitor data pipelines using Azure Databricks, ensuring reliability and scalability within a data transformation programme.

The contract is Inside IR35, 6 months, with 3 days on site per week in central London. Strong SQL, Python, ETL, and cloud experience are essential, and insurance sector knowledge would be advantageous.

Competenze

• Experience with Azure Databricks, Spark and big data tooling.
• Proficient in SQL.
• Proficient in Python and ETL processes.
• Familiar with CI/CD practices for data pipelines.
• Insurance sector experience would be advantageous.

Mansioni

• Design, develop, and optimise data pipelines using Azure Databricks.
• Ensure data reliability, scalability, and quality.
• Integrate data sources into a unified platform.
• Monitor and troubleshoot data workflows.

Strumenti

Azure Databricks

Spark

Descrizione del lavoro

Opus Recruitment Solutions Ltd is seeking an Azure Databricks Engineer for a hybrid role in London. You will design, optimise, and monitor data pipelines using Azure Databricks, ensuring reliability and scalability within a data transformation programme.

The contract is Inside IR35, 6 months, with 3 days on site per week in central London. Strong SQL, Python, ETL, and cloud experience are essential, and insurance sector knowledge would be advantageous.