Lead QA for Data & Analytics Pipelines

UST; Leeds; Hybrid; GBP 45,000 - 65,000; Full time

Job summary

UST is seeking a Data & Analytics Test Engineer to validate data pipelines and ensure data quality across Azure-based platforms. You will design and execute automated tests, work with data engineers and product teams, and support CI/CD practices in a DataOps context.

The role requires strong SQL, Python/PySpark skills and experience with Azure Databricks, ADF and ADLS Gen2, in a hybrid setup with several Leeds-area locations.

Qualifications

• Experience testing data solutions built on Azure Databricks, ADF, ADLS Gen2, and related Azure services.
• Proficiency in SQL for data validation and complex data analysis.
• Experience with Python/PySpark for test automation and large-scale data testing.

Responsibilities

• Analyse requirements to create test scenarios, cases and plans for Data & Analytics solutions.
• Validate ingestion, transformation, aggregation, and reporting processes across Azure services.
• Perform end-to-end functional testing of data pipelines for accuracy and completeness.

Skills

Data warehouse testing

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

SQL

Python/PySpark

ETL/ELT testing

Data governance

CI/CD testing

Agile/Scrum

Data modeling concepts

GIT/Azure DevOps

Tools

Azure Databricks

ADF

ADLS Gen2

GitHub

Azure DevOps

Job description

UST is seeking a Data & Analytics Test Engineer to validate data pipelines and ensure data quality across Azure-based platforms. You will design and execute automated tests, work with data engineers and product teams, and support CI/CD practices in a DataOps context.

The role requires strong SQL, Python/PySpark skills and experience with Azure Databricks, ADF and ADLS Gen2, in a hybrid setup with several Leeds-area locations.