Data Engineering Lead

Michael Page; Weston-super-Mare; On-site; GBP 60,000 - 80,000; Full time

Job summary

A rapidly growing organization seeks a Data Engineering Lead/Data Architect to spearhead a major Data Transformation Programme. This role involves leading a team of Data Engineers, overseeing ETL processes, and developing a Snowflake data warehouse. Ideal candidates will possess strong skills in SQL, ETL tools, and cloud data warehousing, with an emphasis on delivering insights that drive commercial growth.

Benefits

Opportunity to work on a major Data Transformation Programme

Join a rapidly growing organization

Qualifications

• Experience with ETL/ELT tools, SQL Server, and Snowflake.
• Proven ability to convert business requirements into solutions.

Responsibilities

• Lead design and implementation of ETL/ELT processes.
• Architect and develop Snowflake data warehouse for reporting.
• Collaborate with business users to deliver requirements.

Skills

ETL

SQL

Data Architecture

Business Intelligence

Data Migration

Power BI

Tools

Snowflake

SQL Server

Matillion

MS BI stack

Job description

Opportunity to work on a major Data Transformation Programme

Opportunity to join a rapidly growing organization

About Our Client

A rapidly expanding manufacturer and retailer.

Job Description

We are seeking a Data Engineering Lead / Data Architect to support the ongoing development of our Data Strategy and roadmap, focusing on leveraging advanced analytics and insights to drive commercial growth. You will play a pivotal role, leading a small team of Data Engineers and BI Developers in our Cloud transformation. Knowledge of Data Architecture is highly desirable; however, a Senior Data Engineer eager to transition into this domain will also be considered.

Key Responsibilities:

1. Oversee and lead the design and implementation of ETL/ELT processes to ingest data from the new ERP system into Snowflake.
2. Architect and develop the Snowflake data warehouse to support reporting and analytics, incorporating existing SQL Server-based business logic, while optimizing for performance, scalability, and usability.
3. Collaborate closely with business users to understand, qualify, design, build, test, and deliver their requirements.
4. Coordinate with third-party providers to ensure cost-effective and optimized technology solutions, ensuring adherence to Service Level Agreements.
5. Guide the organization in data movement, storage, and retrieval strategies to maximize technological efficiency.
6. Design, implement, and manage BI infrastructure and services, delivering insights aligned with IT strategy and roadmap.
7. Act as a subject matter expert in data analytics, modeling, warehousing, data mining, and presentation to support future projects.
8. Ensure smooth operation of BI services, acting as an escalation point for support and technical teams.
9. Work with senior stakeholders to deliver KPI reporting.

Key Technical Areas:

• Systems Architecture: Knowledge of system architecture models for seamless data integration, storage, processing, and analytics.
• Business Analysis: Ability to translate stakeholder requirements into strategic application plans.
• Business Intelligence: Understanding of data lifecycle from ETL to insight generation.
• IT Security: Awareness of security challenges and mitigation techniques.
• Effective Governance: Managing projects, processes, and stakeholder relationships.
• Service and Supplier Management: Providing high-quality service management and external vendor oversight.

Key Skills & Experience:

Essential:

• Experience with ETL/ELT tools (Matillion preferred)
• Proficiency with SQL Server and Snowflake or similar cloud data warehousing solutions (Azure, AWS, etc.)
• Experience supporting analytics and reporting using Kimball methodology
• Experience with data migration and business logic mapping
• Proven ability to convert business requirements into solutions
• Experience with Power BI

Desirable:

• Experience with Business Systems reporting, including ERP
• Knowledge of MS BI stack (SSIS, SSAS)
• Familiarity with Microsoft Dynamics AX or IFS
• Manufacturing and supply chain experience
• Understanding of financial principles
• Experience with business KPI reporting

The Successful Applicant

Key Skills & Experience:

• Same as above, emphasizing ETL/ELT, SQL, Snowflake, Power BI, and relevant domain knowledge.

What's on Offer

Opportunity to work on a major Data Transformation Programme.

Opportunity to join a rapidly growing organization.