Test Engineer - Data Platforms

UBDS Group; Manchester; On-site; GBP 100,000 - 125,000; Full time

Job summary

A dynamic technology firm in Manchester is seeking an experienced Lead Test Engineer to take ownership of testing for data pipelines. This role requires expertise in Azure services, test automation, and a strong problem-solving ability. You'll collaborate with data engineers to ensure high-quality, reliable solutions while implementing robust testing frameworks. The company promotes continuous improvement and offers extensive employee benefits including training and private medical cover.

Benefits

Training options for personal development

Private medical cover

Discretionary bonus

25 days holiday plus extras

Electric Vehicle leasing

Contributed Pension Scheme

Death in service cover

Qualifications

• Strong track record as a Test Engineer.
• Expertise in testing Azure data services.
• Hands-on experience with test automation frameworks.

Responsibilities

• Define and own the testing strategy for data pipelines.
• Design and execute test cases across data layers.
• Set up data quality checks and compliance monitoring.
• Work closely with data engineers for embedded testing.

Skills

Test Engineer experience in data engineering or analytics

Testing Azure data services

Proficiency in SQL

Test automation frameworks experience

CI/CD integration knowledge

Tools

Azure Databricks

Azure Data Factory

Power BI

Python/PySpark

Azure DevOps

Job description

Overview

We are seeking an experienced Lead Test Engineer to take full ownership of the testing approach for data pipelines and data products within a modern Azure data platform. This role is hands-on: you will design, implement, and execute test strategies across the stack, working alongside data engineers, BI developers, and architects to ensure robust, high-quality, and reliable solutions. The platform leverages Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. As the sole test specialist, you will embed quality engineering into every stage of delivery, acting as the authority on data testing practices.

Key Responsibilities

• Test Ownership & Strategy: Define and own the overall testing strategy for data pipelines, models, and reporting solutions. Establish automated testing frameworks and ensure they are embedded in delivery processes. Act as the subject matter expert for data testing, advising engineers and stakeholders.
• Hands-on Testing: Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Implement automated validation for data pipelines (Databricks notebooks, ADF workflows, ADLS layers). Validate Power BI dashboards and reports for data accuracy, performance, and usability. Perform exploratory, regression, and performance testing as required.
• Quality Assurance: Set up data quality checks, reconciliation processes, and monitoring. Ensure compliance with data security and governance requirements. Integrate test execution into CI/CD pipelines to enforce quality gates.
• Collaboration: Work closely with data engineers to embed testing at source. Partner with architects and product owners to define acceptance criteria. Represent testing considerations in sprint planning and delivery reviews.

Qualifications

• Strong track record as a Test Engineer in data engineering or analytics projects.
• Expertise in testing Azure data services: Databricks, ADF, ADLS, and Power BI.
• Proficiency in SQL and data profiling for test design and validation.
• Hands-on experience with test automation frameworks for data (e.g., Python/PySpark, Great Expectations, Pytest, dbt tests, or equivalent).
• Practical knowledge of CI/CD integration (Azure DevOps, GitHub Actions, or similar).
• Excellent problem-solving skills and the ability to work independently as the sole testing specialist on a delivery team.

Desirable Skills

• Familiarity with public sector delivery frameworks and regulated data environments.
• Experience of data performance testing and monitoring.
• Knowledge of Agile delivery methods and DevOps practices.
• Exposure to Test-Driven Development (TDD) and Behaviour-Driven Development (BDD) practices.
• ISTQB or similar testing certification.

Why UBDS Group

UBDS Group is a dynamic and forward-thinking organisation committed to innovation and employee development. Employees work on cutting-edge projects across diverse industries, with a culture that emphasises continuous improvement, mentorship, and opportunities to gain certifications that enhance skills and marketability.

Employee Benefits

• Training — Options for personal development across technical, business, and methodological areas.
• Private medical cover for you and your spouse/partner, offered via Vitality.
• Discretionary bonus based on a blend of personal and company performance.
• Holiday — 25 days holiday, plus 1 birthday and 1 work anniversary day, in addition to UK bank holidays.
• Electric Vehicle leasing with salary sacrifice.
• Contributed Pension Scheme.
• Death in service cover.