Senior Data Engineer

ZipRecruiter; Cirencester; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to design and maintain scalable data pipelines and systems. The role involves ensuring data quality and optimizing workflows while working with various data tools and technologies. Ideal candidates will have extensive experience in data engineering and integration, along with a strong background in relevant technologies.

Qualifications

• Extensive experience in data engineering and integration.
• Experience with data tools including Snowflake, SQL, AWS, Azure.

Responsibilities

• Designing, implementing, and maintaining scalable data pipelines.
• Building, testing, and deploying data pipelines from various sources.
• Optimising data workflows for efficiency and troubleshooting issues.

Skills

Data Engineering

Data Integration

Root Cause Analysis

Troubleshooting

Education

Bachelor's degree in Data Science

Bachelor's degree in Computer Science

Bachelor's degree in Mathematics

Tools

Snowflake

SQL

AWS

Azure

Talend

MuleSoft

Matillion

SSIS

Job description

Job Description

This job is with St. James's Place, an inclusive employer and a member of myGwork – the largest global platform for the + business community. Please do not contact the recruiter directly.

Number of Roles Available: 2

The Data and Insights Division is comprised of four key areas: 1. Data Governance and Intelligence 2. Data Acquisition, Quality, Strategy and Literacy; 3. Data Insights; 4. Data Architecture, Platform and Engineering. This presents an opportunity to design a data strategy aligned with the organization's goals and execute the delivery of data effectively. D&I enables SJP to leverage value from its data through actionable insights and data led decision making.

The Data Architecture, Platform and Engineering(DAPE) Division integrates architecture, platform and engineering to establish guidelines, principles and development standards aimed at building a secure, resilient data platform for the future. It plays a key role in supporting the SJP data ecosystem, driving towards the SJP data strategy and advancing the decommissioning roadmap.

Working in the DAPE division the role holder will be responsible for designing, implementing and maintaining scalable data pipelines and systems allowing large datasets to be managed, processed, and analysed effectively. They will ensure that data flows are optimised, data quality measurement is enabled, and appropriate technologies utilised.

What you'll be doing:

• Developing data engineering solutions ensuring they balance both functional and non-functional requirements.
• Building, testing and deploying scalable data pipelines to ingest, transform and store large volumes of data, on a core system, from various sources such as Bluedoor, Rowan Dartington, Salesforce, 3rd Party Providers.
• Establishing, modifying and maintaining data structures and associated components and provide specialist expertise in the design characteristics of database management systems or data warehouse products.
• Designing and developing integration of the data platform with other enterprise systems, such as CRM, ERP, and marketing automation platforms allowing seamless data sharing and analysis across the organisation.
• Optimising data workflows for efficiency, speed and cost effectiveness and troubleshooting and resolving performance issues where necessary.
• Enabling the monitoring of infrastructure performance and health and ensuring the platform continues to meet analytical and business needs.
• Working with the Data Acquisition and Data Governance teams to ensure data quality, lineage and security frameworks are taken account of in all developments.
• Providing guidance in the selection, provision and use of database and data warehouse architectures, software and facilities.

Who we're looking for:

We are looking for an experienced Senior Data Engineer who will ensure best practice standards are followed, and all work aligns to the appropriate guidelines. The role holder will mainly be developing on the Data platform however other systems may also require development and maintenance. They will also ensure testing is carried out appropriately and assist the Data Platform team with enabling the implementation of principles and improvements.

Essential Criteria

• Extensive experience working in data engineering and data integration positions.
• Highly capable of using data tools and technologies including; Snowflake, SQL, AWS and/or Azure
• Highly experienced in projects lifecycle and experience working alongside PMS, BAs, Testers, and Developers.
• Key skills in root cause analysis, troubleshooting and resolving performance issues/defects.

Desirable Criteria

• Expert snowflake development and engineering knowledge.
• Capable of using other data tools including; Talend, MuleSoft, Matillion, SSIS.
• Experience in data integrations and integrating data to answer business questions.
• Competent stakeholder management skills and capable of fostering mutually beneficial relationships across multiple business areas.
• Bachelor's degree or equivalent in Data Science, Computer Science, Mathematics or similar STEM subject.

Special Requirements:

• Some business travel may be necessary