DATA ENGINEER | 30198

The Emerald Group Ltd, Search and Selection; Greater London; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

The Emerald Group Ltd, Search and Selection is seeking a data engineer to manage and modernize our data pipelines in a hybrid London-based role. You will lift SSIS pipelines from AWS to Azure, model data for analysis, and work with diverse data sources. The role requires GDPR experience, 5+ years in data, and strong T-SQL, with DevOps and data governance practices. It offers 1 day in London and 4 days at home, plus exposure to insurance industry data.

Qualifications

• 5+ years of experience in data-related field, preferably within financial services.
• Experience with GDPR and handling sensitive data.
• Understanding MGA business and UK general insurance market.
• Experience with DevOps and data pipelines.
• Strong experience building SSIS pipelines.
• T-SQL proficiency.
• AWS / Azure exposure.

Responsibilities

• Lift & shift existing SSIS pipelines from AWS to Azure (70 – 80% of the role).
• Liaise with internal stakeholders to understand business requirements.
• Data modelling for analysis.
• Working with multiple data sources (structured and unstructured).
• Manage the data warehouse in terms of security, structure, dev / prod environments.
• Ensure data quality (accurate, consistent, reliable) and ensure data is validated and auditable as it flows through the pipelines.
• Monitor performance output and audit logs and apply updates as required to ensure environment operates effectively.

Skills

SSIS pipelines

T-SQL

AWS / Azure exposure

Data modelling

Data governance / GDPR

DevOps

Stakeholder liaison

Data quality

Tools

SSIS

SQL Server

Job description

Overview

Key responsibilities include but not limited to the following:

• “Lift & shift” existing SSIS pipelines from AWS to Azure (70 – 80% of the role)
• Liaise with internal stakeholders to understand business requirements
• Data modelling for analysis
• Working with multiple data sources (structured and unstructured)
• Manage the data warehouse in terms of security, structure, dev / prod environments
• Ensure data quality (accurate, consistent, reliable) and ensure data is validated and auditable as it flows through the pipelines
• Monitor performance output and audit logs and apply updates as required to ensure environment operates effectively

Overview

Key responsibilities include but not limited to the following:

• “Lift & shift” existing SSIS pipelines from AWS to Azure (70 – 80% of the role)
• Liaise with internal stakeholders to understand business requirements
• Data modelling for analysis
• Working with multiple data sources (structured and unstructured)
• Manage the data warehouse in terms of security, structure, dev / prod environments
• Ensure data quality (accurate, consistent, reliable) and ensure data is validated and auditable as it flows through the pipelines
• Monitor performance output and audit logs and apply updates as required to ensure environment operates effectively

Please note this is a hybrid role with 1 day a week in London, and 4 days from home. There may be the odd extra requirement based on business needs, but will average at 1 day per week from home.

Qualifications Required

• 5 years’+ experience working in a data related field preferably within the financial services industry

Experience Required

• Data classification, GDPR and working with sensitive data
• Understanding of MGA business and UK general insurance market
• Experience with DevOps and data pipelines
• Strong experience in building SSIS pipelines
• T-SQL
• AWS / Azure exposure