Senior Data Engineer

Arbuthnot; City Of London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A banking institution in London is seeking a Senior Data Engineer to develop and maintain data systems that support operations and reporting needs. The role involves mentorship of junior engineers and the development of data pipelines using Azure Data Stack. Candidates should have strong Python skills and experience with DevOps practices. This position offers a competitive salary and benefits including agile working arrangements.

Benefits

Competitive salary

Pension and holiday allowance

BUPA Health cover

Life Assurance

Income Protection scheme

Discretionary bonus

Flexible benefits

Qualifications

• Experience mentoring less experienced developers.
• Significant hands-on experience with Azure Data Stack.
• Highly developed Python and data pipeline development knowledge.

Responsibilities

• Develop data ingest and transformation pipelines.
• Support live platform and resolve issues.
• Promote Data Engineering best practices.

Skills

Strong communicator

Mentoring experience

Azure Data Stack

Python knowledge

DevOps experience

Infrastructure as Code

Agile Delivery

Education

Industry focused degree or equivalent experience

Tools

Azure Data Factory (ADF)

PySpark

Terraform

Job description

Overview

Arbuthnot Latham has been associated with banking since 1833. We combine private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology.

Job purpose

Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with the Technical Lead for Data Engineering to develop innovative solutions that address business needs.

As a Senior Data Engineer this person will also play a key role in the development of less experienced members of the team day to day.

To place the interests of customers at the centre of all activities, act in a way that is consistent with achieving good outcomes for consumers; and to comply with the FCA and PRA's Conduct Rules.

Key Responsibilities

• The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform.
• Support for the live platform day to day, resolving issues and meeting business requests as they arise within the team's SLAs.
• The enablement and promotion of Data Engineering best practices and DevOps standards, ensuring good code quality and continuous compliance with all relevant standards.
• Providing mentorship to junior engineers, helping them enhance their skills and knowledge. Promoting a collaborative environment to deliver and integrate end to end data solutions.
• Identifying and addressing technical debt efficiently, continuously improving data processes and workflows for enhanced efficiency.
• Working collaboratively with business stakeholders and operational teams to resolve issues and minimise the defect backlog.
• Supporting estimation processes to aid in planning and portfolio management.
• Keeping abreast of industry technical best practices and new trends, ensuring innovative development of systems to meet organisational immediate and future needs.

Risk

• Responsible for managing risks inherent to the role by diligently observing internal policies and procedures.

Key Interfaces

• Technical Lead for Data Engineering
• Business System Owner
• Head of Data Engineering
• Application Specialists and Application Support
• Information Security Manager
• Data Privacy Manager
• Infrastructure Engineers

Person Specification

Knowledge/Experience/Skills

• Strong communicator with both technical and non-technical communities
• Experience of mentoring less-experienced developers
• Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus)
• Highly developed python and data pipeline development knowledge, must include substantial PySpark experience
• Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery
• An understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus)
• Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance
• Demonstrable experience of working within Agile Delivery projects
• An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy, and information security

Desirable

• Financial services experience
• Awareness of data models in a Medalion Architecture
• Experience building Semantic, Metric or Analytic models
• Experience of building Machine Learning models
• Any experience in MLOps or operationalising Machine Learning
• Knowledge of Data Quality Frameworks in Python

Qualifications

• Industry focused degree or equivalent working experience
• Azure certifications are desirable

Competencies

• Developing Others
• Working Proactively
• Creativity and Innovation
• Problem Solving and Judgement
• Communication and Confidence

About Us

Life, Work and Benefits

Arbuthnot Latham is committed to equal-opportunities for all staff and candidates. We embrace inclusion & diversity and understand why they are critical for the success of our business and people.

• Agile working - (4 Days in London Office per week)
• Competitive salary, pension & holiday allowance
• BUPA Health cover
• 4x Life Assurance
• Income Protection scheme
• Discretionary bonus
• Market leading maternity/paternity and menopause policies
• Flexible benefits

Data Privacy and Reasonable adjustments

We take keeping your data security seriously. For more detail on how we may keep your data please refer to our Privacy Notice

https://careers.arbuthnotlatham.co.uk/files/RecruitmentPrivacyNotice.pdf

Reasonable adjustments

Please let us know of any adjustments or arrangements that you may need to help you apply to this role or that will help you during the recruitment process. If you wish to discuss any particular requirements or concerns you have because of a disability or medical condition please contact us at [email protected]. Information you provide about any disability or medical condition will remain confidential unless it is necessary to disclose it to other members of staff or outside agencies to ensure the health and safety of yourself and others, or to implement the adjustments you require. In these circumstances we will first discuss with you how and to whom the information may be disclosed.