Senior Data Architecture Lead - PySpark/Databricks (London)

BlueRose Technologies; London; On-site; GBP 65,000 - 85,000; Full time

Job summary

A leading technology firm in London is seeking a Mid-Senior level Data Engineer with extensive experience in PySpark and Databricks. The role involves understanding client requirements, developing data models, and guiding a team. Ideal candidates will have a minimum of 10 years in data engineering and strong communication skills, with proficiency in Azure Services and Erwin. This is a contract position for 6 months.

Qualifications

• Minimum 10 years of experience in Data Engineering.
• Expertise in Medallion architecture using Azure Services.
• Hands-on experience creating conceptual diagrams and developing data models.

Responsibilities

• Translate client requirements into technical solutions.
• Guide the data engineering team after requirement gathering.
• Prepare source-to-target mapping designs/documents.

Skills

PySpark

Databricks

SQL

Azure Services

Team collaboration

GitHub Workflows

Configuration using JSON

Tools

Erwin

ADF

Job description

A leading technology firm in London is seeking a Mid-Senior level Data Engineer with extensive experience in PySpark and Databricks. The role involves understanding client requirements, developing data models, and guiding a team. Ideal candidates will have a minimum of 10 years in data engineering and strong communication skills, with proficiency in Azure Services and Erwin. This is a contract position for 6 months.