Databricks Architect & Data Engineering Lead

Ernst & Young Advisory Services Sdn Bhd; Remote; GBP 85,000 - 110,000; Full time

Job summary

A leading global advisory firm is seeking a Senior Manager for Data Engineering to lead the development of data capabilities in the Financial Services sector. The successful candidate will have extensive experience in Databricks, focusing on data architecture, optimization, and transformation. Key responsibilities include architecting data solutions, ensuring compliance, and mentoring teams. This role offers a competitive remuneration package with opportunities for career development and support for flexible working arrangements.

Benefits

Competitive remuneration package

Flexible working arrangements

Career development opportunities

Qualifications

• A track record of delivering large Databricks data transformations.
• Deep understanding of Financial Services for AI and Data solutions.
• Experience building high-performing teams and strong leadership skills.
• Ability to engage with senior stakeholders on complex projects.

Responsibilities

• Lead the design and implementation of scalable data architecture solutions.
• Architect and optimize data pipelines for financial data.
• Collaborate with teams to align data architecture with financial regulations.
• Drive adoption of advanced analytics tools and ensure security.

Skills

Data architecture design

Databricks

Data pipeline optimization

Cross-functional collaboration

Data governance

Machine Learning

Apache Spark

Project management

Education

University degree, 2:1 or equivalent

Tools

Azure Databricks

Delta Lake

MLflow

Job description

A leading global advisory firm is seeking a Senior Manager for Data Engineering to lead the development of data capabilities in the Financial Services sector. The successful candidate will have extensive experience in Databricks, focusing on data architecture, optimization, and transformation. Key responsibilities include architecting data solutions, ensuring compliance, and mentoring teams. This role offers a competitive remuneration package with opportunities for career development and support for flexible working arrangements.