Data Engineer

7IM; Greater London; On-site; GBP 70,000 - 100,000; Full time

Job summary

7IM is seeking a data engineer to design, build, test and release data solutions that support business requirements. You will work in the data engineering team to deliver robust pipelines and contribute to modernising the data platform, tools and processes.

The role focuses on Azure-based data platforms, data governance, and working with stakeholders to implement scalable data solutions in a regulated financial services environment.

Qualifications

• Experience in a data engineering role in a regulated environment.
• Knowledge of modern data platforms: Data Lake, Lakehouse, Data Warehouse, Data Vault.
• Experience with ETL/ELT, Python/PySpark data transformations.
• Experience with Azure cloud data technologies and DevOps practices.
• Familiarity with data governance and and MS Purview.

Responsibilities

• Build robust, scalable data solutions meeting technical and security standards.
• Contribute to data solution design aligned with architecture and roadmap.
• Develop and release software using modern technologies and best practices.
• Maintain data models, pipelines and documentation.
• Collaborate with stakeholders to analyse needs and ensure alignment.
• Provide second-line support and guidance to application teams.

Skills

Data engineering

Regulated environment

Stakeholder management

Analytical skills

Communication

Ambiguity handling

Problem solving

Data modelling

Education

Relevant degree or equivalent experience

Azure DP-203

DGSP or similar (desirable)

Business qualifications/desirable

Tools

Azure Data Factory

Azure Data Lake Storage

Azure Databricks

MS Fabric

Power BI

Purview

SQL Server/Analysis Services/Integration Services

Job description

Purpose

Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools and processes.

About The Role

Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools and processes.

Responsibilities

• Build robust and scalable data solutions that meet technical and security standards
• Contribute to the design of data solutions in line with the architecture and roadmap
• Design, develop, test and release robust, scalable software solutions using modern technologies and best practices
• Develop and maintain data models, pipelines and documentation
• Adhere to engineering standards and help keep technical debt in check
• Collaborate with business stakeholders and technical teams to analyse needs, propose solutions and ensure alignment
• Contribute to initiatives that modernise technology, tools and development processes
• Peer review code and documentation for accuracy, maintainability and supportability
• Provide second-line support and guidance to application support teams
• Identify opportunities for technical efficiencies and share best practice
• Ensure compliance with regulatory standards and internal policies
• Other duties as reasonably required by line management and 7IM

Experience

About You

• Experience in a data engineering role, ideally within a regulated environment
• Knowledge of the following is required:
• Modern Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault
• Azure Data Technologies; Azure Data Lake Storage, Azure Data Factory, Azure Databricks, MS Fabric
• ETL / ELT processes and designing, building and testing data pipelines
• Building data transformations using Python /PySpark
• Azure Cloud Version control and CI/CD tools, specifically Azure DevOps Service
• Analytics and MI products including MS Power BI
• Data catalogue & governance using MS Purview
• Knowledge of the following would be desirable:
• Microsoft server-based data products (SQL Server, Analysis Services, Integration Services and Reporting Services)
• Enterprise Architecture tools (e.g. LeanIX, Ardoq), Frameworks (TOGAF) and core artefacts (Capability Models, Technical Reference Models, Data Flow Diagrams
• Experience developing and implementing technology roadmaps and target state architectures
• Experience integrating bespoke software, commercial off-the-shelf packages and third-party services
• Demonstrable experience of migrating on-premises workloads to cloud-native services
• Excellent analytical, problem-solving and communication skills
• Strong stakeholder management and influencing abilities at all levels
• Commitment to continuous learning and keeping skills current

Skills

• Able to work independently within the data space and comfortable dealing with some ambiguity
• Comfortable delivering to plan in a fast-paced environment
• Excellent verbal and written communication with a proven track record of stakeholder engagement and influencing both business and technical stakeholders
• Ability to communicate between the technical and non-technical - interpreting the needs of technical and business stakeholders, communicating how activities meet strategic goals and client needs
• Ability to analyse data to drive efficiency and optimisation, design processes and tools to monitor production systems and data accuracy
• Ability to produce, compare, and align different data models across multiple subject areas, reverse-engineering data models from a live system where required
• Excellent analytical and numerical skills are essential, enabling easy interpretation and analysis of large volumes of data
• Excellent problem-solving and data modelling skills (logical, physical, semantic and integration models)

Qualifications

• Relevant degree or equivalent experience.
• Azure DP-203 (or equivalent)
• Certification in Data Governance and Stewardship Professional (DGSP) or similar (desirable).
• Evidence of business experience or formal business qualifications (desirable).

Other Relevant Information

• Experience of wealth management (including operational knowledge) would be advantageous
• Prior experience working in Financial Services preferred thorough understanding of data security, data privacy, and GDPR required

About Us

Not Specified