Enable job alerts via email!

Lead Software Engineer - Azure Data

Royal London

Alderley Edge

Hybrid

GBP 60,000 - 100,000

Full time

7 days ago
Be an early applicant

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

An established industry player is looking for a Lead Software Engineer specializing in Azure Data to join their innovative team. This role is pivotal in designing and maintaining efficient ETL/ELT data pipelines, utilizing Azure Data Factory and Databricks to enhance data processing workflows. You will collaborate closely with data architects and business stakeholders to implement robust data lake and warehouse solutions, ensuring data quality and governance. If you are passionate about leveraging technology to drive business success and enjoy working in a supportive and inclusive environment, this opportunity is perfect for you.

Benefits

28 days annual leave
Up to 14% employer matching pension scheme
Private medical insurance
Inclusive workplace environment

Qualifications

  • Strong experience in building complex data pipelines using Azure Data Factory.
  • Expertise in Data Modeling and writing efficient SQL queries for analytics.

Responsibilities

  • Design and maintain ETL/ELT data pipelines for data ingestion and transformation.
  • Collaborate with stakeholders to implement data lake and warehouse architectures.

Skills

Azure Data Factory
ETL/ELT data pipelines
Data Modeling
T-SQL
Azure Synapse Analytics
Delta Lake
Azure DevOps
Data Governance
Data Quality Checks
Collaboration Skills

Education

Bachelor's Degree in Computer Science or related field

Tools

Azure Data Lake Storage
Databricks
Azure Active Directory
Azure Key Vault
Azure RBAC

Job description

Job Title: Lead Software Engineer (Azure Data)

Contract Type: Permanent

Working style: Hybrid 50% home/office based

We are seeking a highly skilled and experienced Lead Software Engineer (Azure Data) to join our dynamic team at Royal London. In this role, you will play a crucial role in providing deep technical expertise to help our teams design, develop, test, implement and support efficient solutions that meet business and customer requirements.

The successful candidate will have a real impact on how Royal London develops and supports our applications and will provide a blend of both solid leadership experience and technical expertise.

This role is focused within the Engagement Services platform with a focus on Azure Data and contributes to our purpose of strengthening the mutual choice for our customers, by providing the best technology solutions to our customers.

About the role

Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF) for automating data ingestion, transformation, and orchestration from diverse data sources.

Build scalable data integration processes to bring in data from on-premises, cloud, and external APIs into Azure Data Lake Storage (ADLS).

  • Data Transformation & Modeling:

Utilize Azure Data Factory/ Databricks (PySpark/Scala) to build scalable data processing and transformation workflows for both batch and streaming data.

Develop data models and implement data partitioning, indexing, and schema optimization to improve query performance in Azure Synapse Analytics.

  • Data Warehouse & Analytics Solutions:

Collaborate with data architects and business stakeholders to design and implement data lake and data warehouse architectures on Azure.

Create and optimize data models (star and snowflake schemas) for business intelligence (BI) and analytics workloads, ensuring high performance and scalability.

  • Data Governance & Quality:

Implement data governance practices to ensure data accuracy, completeness, and integrity across the Azure environment.

Develop and enforce data quality checks and validation rules to maintain high levels of data consistency using Azure Data Factory and Databricks.

  • Leads the delivery of complex technical solutions, provides technical advice and guidance to other software developers and takes responsibility for ensuring that all code meets Group standards, guidelines and quality gates for given technology.
  • Takes responsibility for ensuring technical solutions are safely implemented to production environment(s) without impact to internal or external customers.
  • Takes an active role on the transfer of knowledge and sharing of experiences relating to own area of technical expertise at practice level.

About you

  • Strong experience in building and orchestrating complex data pipelines in ADF.
  • Experience with Delta Lake for implementing data lakes and managing big data workloads efficiently.
  • Strong knowledge of Synapse Analytics (formerly SQL Data Warehouse) for data warehousing and advanced analytics.
  • Experience with T-SQL and optimizing complex queries for large datasets.
  • Experience with designing and managing data lakes using ADLS, with an understanding of hierarchical namespaces, partitioning strategies, and performance optimization techniques.
  • Expertise in Data Modeling (star and snowflake schemas) and writing efficient SQL queries for analytical workloads.
  • Experience with Azure DevOps for CI/CD pipeline creation and deployment automation for data pipelines and infrastructure.
  • Proficiency with Azure Active Directory (AAD), Azure Key Vault, and Azure RBAC for managing security and access control.
  • A growth mindset with the ability to lead a team, support, coach, and mentor others.
  • Able to communicate at all levels in a collaborative manner.
  • Good understanding of the full software development lifecycle, and an awareness of agile development practices.

About Royal London

We’re the UK’s largest mutual life, pensions and investment company, offering protection, long-term savings and asset management products and services.

Our People Promise to our colleagues is that we will all work somewhere inclusive, responsible, enjoyable and fulfilling. This is underpinned by our Spirit of Royal London values; Empowered, Trustworthy, Collaborate, Achieve.

We've always been proud to reward employees by offering great workplace benefits such as 28 days annual leave in addition to bank holidays, an up to 14% employer matching pension scheme and private medical insurance.

Inclusion, diversity and belonging

We’re an Inclusive employer. We celebrate and value different backgrounds and cultures across Royal London. Our diverse people and perspectives give us a range of skills which are recognised and respected – whatever their background.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.