Data Engineering Lead

ZipRecruiter; Weston-super-Mare; On-site; GBP 70,000 - 90,000; Full time

Job summary

A rapidly expanding manufacturer and retailer seeks a Data Engineering Lead/Data Architect to drive their Data Strategy. This pivotal role involves leading a team to implement ETL processes, develop a Snowflake data warehouse, and ensure effective data management and analytics. The ideal candidate will have strong experience in ETL tools, SQL, and data architecture, with opportunities for significant impact in a growing organization.

Benefits

Opportunity to work on a major Data Transformation Programme

Opportunity to join a rapidly growing organization

Qualifications

• Experience with ETL/ELT tools and SQL Server.
• Ability to convert business requirements into solutions.

Responsibilities

• Lead the design and implementation of ETL/ELT processes.
• Architect and develop the Snowflake data warehouse.
• Collaborate with business users to deliver requirements.

Skills

ETL

SQL

Data Migration

Business Analysis

Data Analytics

Tools

Matillion

Power BI

Snowflake

SQL Server

Job description

Job Description

This rapidly expanding manufacturer and retailer is looking to appoint a Data Engineering Lead/Data Architect to support the continued evolution of their Data Strategy and roadmap towards using more advanced analytics and insights to drive commercial growth. You will be pivotal and hands-on in leading a small team of Data Engineers and BI Developers to support their Cloud transformation.

Client Details

Rapidly expanding manufacturer and retailer

Description

This rapidly expanding manufacturer and retailer is looking to appoint a Data Engineering Lead/Data Architect to support the continued evolution of their Data Strategy and roadmap towards using more advanced analytics and insights to drive commercial growth. You will be pivotal and hands-on in leading a small team of Data Engineers and BI Developers to support their Cloud transformation. Knowledge of Data Architecture is highly desirable, but a Senior Data Engineer looking to transition into this domain will also be considered.

Key Responsibilities:

1. Oversee and lead the design and implementation of ETL/ELT processes to ingest data from the new ERP system into Snowflake.
2. Architect and develop the Snowflake data warehouse to support reporting and analytics needs, incorporating existing SQL Server-based business logic, while optimizing the warehouse structure for performance, scalability, and ease of use.
3. Ensure that the BI and Data team work closely with business users to understand, qualify, design, build, test, and deliver their requirements.
4. Collaborate with and oversee third-party providers to ensure cost-effective and optimized technologies and services, while ensuring adherence to Service Level Agreements.
5. Provide direction on how the business moves, transforms, stores, and retrieves data to enable efficient and effective use of technology.
6. Design, implement, and manage the BI infrastructure and services, delivering business data insights aligned with the IT strategy and roadmap.
7. Act as a subject matter expert on data analytics, data modelling, warehousing, data mining, and presentation to support future projects.
8. Ensure smooth operation of BI services, acting as a point of escalation for support and technical issues.
9. Work with senior stakeholders and programme boards to deliver company KPI reporting.

Key Technical Areas:

• Systems Architecture: Knowledge of system architecture models, including design, behavior, and interaction of components for scalable, secure, and efficient data solutions.
• Business Analysis: Translate stakeholder requirements into strategic application plans aligned with organizational goals.
• Business Intelligence: Understanding of the data lifecycle from ETL to analysis and reporting, enabling trend identification and insights.
• IT Security: Awareness of security challenges and mitigation techniques.
• Effective Governance: Manage projects, policies, and stakeholder relationships effectively.
• Service and Supplier Management: Provide high-quality service management, aligning IT services with business needs.

Key Skills & Experience:

Essential:

• Experience with ETL/ELT tools (Matillion).
• Experience with SQL Server and Snowflake or other cloud data warehousing solutions (Azure/AWS).
• Experience using Kimball methodology for analytics and reporting.
• Experience with data migration and mapping business logic to new sources.
• Ability to convert business requirements into solutions.
• Proficiency with Power BI.

Desirable:

• Experience with Business Systems reporting, including ERP.
• Knowledge of MS BI stack (SSIS, SSAS).
• Knowledge of Microsoft Dynamics AX or IFS.
• Manufacturing and supply chain exposure.
• Understanding of financial principles.
• Experience with KPI reporting.

Profile

Key Skills & Experience:

• Same as above (see Essential and Desirable).

Job Offer

Opportunity to work on a major Data Transformation Programme.

Opportunity to join a rapidly growing organization.