Senior Data Engineer

5Y Technology LTD; Nottingham, Greater London; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

5% pension match

Salary sacrifice scheme

Job summary

5Y Technology LTD is seeking a Senior Data Engineer to lead the design, delivery and governance of enterprise-scale data platforms. You will work across architecture, engineering, and delivery, coordinating teams to implement Microsoft BI solutions using Azure Data Factory, Synapse and Power BI.

The role combines hands-on technical work with leadership, stakeholder engagement and strategic planning to maximise data value for customers while driving engineering best practices across the

Qualifications

• Degree in Computer Science, Mathematics or related technical discipline
• Minimum five years delivering business solutions using the Microsoft BI stack
• Microsoft CRM knowledge

Responsibilities

• Data Engineering Leadership: Champion data engineering capabilities across the business.
• Data Platform Delivery: Build and maintain enterprise data streaming systems and Azure-based data solutions.
• Data Architecture & Integration: Design enterprise data integration procedures and standards; maintain data models for analytics.
• Solution Design & Consultancy: Design and document technical solutions; facilitate requirements workshops and discussions.
• Database & Performance Optimisation: Tune large-scale databases and SQL workloads; optimise performance.
• Delivery & Project Management: Manage milestones and delivery timelines; coordinate agile and traditional delivery.
• Innovation & Research: Identify emerging technologies and platform improvements; drive continuous improvement across engineering practices.

Skills

Microsoft BI stack

Data engineering leadership

Stakeholder management

Architectural thinking

Education

Degree in Computer Science or Mathematics

Tools

Azure Data Factory

Azure Synapse

Power BI

SSAS

SSIS

SSRS

Azure Data Lake

Azure SQL Database

Azure SQL Data Warehouse

Cosmos DB

Snowflake

Oracle

PostgreSQL

SQL Server

Job description

Come help us build the future of data analytics and integration. Progress your career and start reshaping how companies use data for the better with 5Y.

Location Remote /Hybrid– Nottingham City Centre OR London (Soho)

Team Lead Position Yes

Salary Competitive

Pension 5% match & salary sacrifice scheme

Work abroad Within 3 hours of GMT for up to 90 days

Primary focus Enterprise Data Engineering & Data Platform Delivery

Technologies Azure Data Platform, Azure Data Factory, Azure Synapse, Power BI, SSAS, SSIS, SSRS

Experience Minimum 5 years Microsoft BI delivery experience

Qualification Degree in Computer Science, Mathematics or related technical discipline

Why this role exists

We are looking for an experienced Senior Data Engineer to lead the design, implementation and delivery of enterprise-scale data engineering solutions. The role combines deep technical expertise with leadership responsibility, ensuring data platforms, integration systems and analytics solutions are delivered to a high standard while establishing engineering best practices across the organisation.

You will be responsible for building scalable data solutions, coordinating teams, improving engineering standards and helping customers maximise the value of their data investments using modern Microsoft and cloud-based technologies.

The position requires a strong blend of technical capability, stakeholder engagement, architectural thinking and strategic planning to ensure robust, secure and future-ready data solutions are delivered successfully.

Outcomes

The outcomes we expect

01

Build scalable, secure and high-performing data platforms, integration solutions and analytics environments that meet customer and business requirements.

02

Define, maintain and promote data engineering best practices, standards and delivery frameworks across teams.

03

Enable better business decisions

Provide reliable, trusted and analytics-ready data that supports reporting, insight generation and business performance management.

04

Lead and coordinate technical teams

Guide technical teams through successful project delivery while resolving issues and maintaining delivery quality.

05

Drive innovation and improvement

Identify emerging technologies, modern engineering approaches and platform enhancements that improve customer outcomes and delivery efficiency.

Your ownership

Key responsibilities

1. Data Engineering Leadership

• Champion data engineering capabilities across the business.
• Coordinate teams and establish engineering standards.
• Promote reuse of existing data flows and integration patterns.
• Ensure engineering best practices are followed across projects.
• Provide technical leadership and mentoring to team members.

2. Data Platform Delivery

• Build and maintain enterprise data streaming systems.
• Design and implement Azure-based data solutions.
• Deliver modern data warehouse, analytics and reporting environments.
• Develop robust integration solutions across multiple systems.
• Ensure platforms remain scalable, secure and high performing.

3. Data Architecture & Integration

• Design enterprise data integration procedures and standards.
• Create and maintain data models suitable for analytical workloads.
• Evaluate architectural options considering cost, benefit and risk.
• Recommend appropriate technologies and platform approaches.
• Maintain alignment between enterprise data models and systems.

4. Solution Design & Consultancy

• Design and document technical solutions.
• Facilitate requirements workshops and technical discussions.
• Conduct stakeholder meetings and planning sessions.
• Produce implementation estimates and technical recommendations.
• Support customers throughout solution design and delivery.

5. Database & Performance Optimisation

• Implement and tune large-scale database environments.
• Optimise SQL workloads and stored procedures.
• Perform performance analysis and diagnostics.
• Improve scalability and platform resilience.
• Support migration and consolidation initiatives.

6. Delivery & Project Management

• Manage project milestones and delivery timelines.
• Support both agile and traditional delivery methodologies.
• Coordinate issue resolution and preventative actions.
• Ensure adherence to development policies and internal processes.
• Maintain consistent project governance and reporting.

7. Innovation & Research

• Research emerging technologies and industry trends.
• Evaluate new tools, platforms and delivery methods.
• Recommend innovations that improve customer outcomes.
• Support continuous improvement across engineering practices.
• Identify opportunities to modernise data platforms.

How we measure

Measures of success

Measure Area

Examples of Evidence

Solution Delivery Successful delivery of enterprise-scale data engineering projects.

Solution Delivery Reliable, scalable and optimised data platforms and integrations.

Data Quality Trusted, analytics-ready data available to business users.

Team Leadership Effective coordination, mentoring and technical guidance.

Stakeholder Satisfaction Positive feedback from business and technical stakeholders.

Innovation Adoption of beneficial technologies and process improvements.

Governance & Standards Consistent adherence to engineering standards and best practices.

Project Delivery Milestones achieved within agreed timelines and budgets.

The person we are looking for

You will be a highly technical and analytical data engineering professional with significant experience designing and delivering modern data platforms. You will be comfortable operating across architecture, engineering, delivery and stakeholder engagement, combining hands‑on technical capability with leadership and strategic thinking.

You will demonstrate strong communication skills, a passion for data engineering best practice and the ability to guide organisations through complex data transformation initiatives.

Degree in Computer Science, Mathematics or related technical discipline Dynamics AX knowledge

Minimum five years delivering business solutions using the Microsoft BI stack. Microsoft CRM knowledge

Azure Data Factory Snowflake

Power BI Python

SSAS Experience with Azure Data Lake

SSIS Experience with Azure SQL Database and Azure SQL Data Warehouse

SSRS Experience with Cosmos DB

Strong stakeholder management skills Experience with Oracle, PostgreSQL or SQL Server at enterprise scale

Database tuning and optimisation expertise

Experience with high-performance SQL and stored procedures

Data migration planning and delivery experience

Experience working in agile and traditional delivery environments

Strong technical documentation and solution design skills

Ability to coordinate teams and resolve technical challenges

Year one

Success in the first 12 months

• 1 Data engineering standards are established and consistently applied across projects.
• 2 Enterprise-scale data solutions are successfully delivered to customers.
• 3 Teams are effectively coordinated and supported throughout delivery.
• 4 Data integration and modelling practices are improved and standardised.
• 5 Platform performance, reliability and scalability are measurably improved.
• 6 Stakeholders have greater access to trusted, analytics-ready data.
• 7 Technical governance and delivery processes are embedded across projects.
• 8 Emerging technologies and platform improvements are assessed and introduced where appropriate.
• 9 Customers and internal teams benefit from improved data engineering capabilities and solution quality.