Senior Data Architecture Lead - PySpark/Databricks (London)

BlueRose Technologies; London; Vor Ort; GBP 65.000 - 85.000; Vollzeit

Zusammenfassung

A leading technology firm in London is seeking a Mid-Senior level Data Engineer with extensive experience in PySpark and Databricks. The role involves understanding client requirements, developing data models, and guiding a team. Ideal candidates will have a minimum of 10 years in data engineering and strong communication skills, with proficiency in Azure Services and Erwin. This is a contract position for 6 months.

Qualifikationen

• Minimum 10 years of experience in Data Engineering.
• Expertise in Medallion architecture using Azure Services.
• Hands-on experience creating conceptual diagrams and developing data models.

Aufgaben

• Translate client requirements into technical solutions.
• Guide the data engineering team after requirement gathering.
• Prepare source-to-target mapping designs/documents.

Kenntnisse

PySpark

Databricks

SQL

Azure Services

Team collaboration

GitHub Workflows

Configuration using JSON

Tools

Erwin

ADF

Jobbeschreibung

A leading technology firm in London is seeking a Mid-Senior level Data Engineer with extensive experience in PySpark and Databricks. The role involves understanding client requirements, developing data models, and guiding a team. Ideal candidates will have a minimum of 10 years in data engineering and strong communication skills, with proficiency in Azure Services and Erwin. This is a contract position for 6 months.