Cloud Data Test Automation Engineer (Python, PySpark)

Lorien; Glasgow; Hybrid; GBP 56,000 - 78,000; Full time

Job summary

Lorien in Glasgow is seeking a Test Automation Engineer on a hybrid 6-month contract to build and maintain automated test frameworks for cloud data pipelines and applications. The role emphasizes Python, SQL, PySpark, and Databricks, with strong emphasis on CI/CD integration and defect management.

You will design and implement test suites across unit to end-to-end levels, validate data, and contribute to a robust testing culture within the team.

Qualifications

• Proficient in Python and SQL with PySpark experience.
• Experience with Databricks or similar cloud data platform.
• Strong Pytest experience for unit/integration testing.
• Experience designing automated test frameworks and data validation.
• Familiar with Git and CI/CD workflows, preferably Azure DevOps.

Responsibilities

• Design and maintain automated test suites covering unit, integration, end-to-end and regression testing.
• Write Pytest unit tests and reusable Python test frameworks.
• Carry out functional testing and validate data across pipelines using SQL and PySpark.
• Integrate automated testing into CI/CD pipelines.
• Raise and track defects through to resolution.

Skills

Python

SQL

PySpark

Databricks

Pytest

CI/CD

Azure DevOps

Git

Data validation

QA testing

Tools

Azure DevOps

GitHub

CI pipelines

Job description

Lorien in Glasgow is seeking a Test Automation Engineer on a hybrid 6-month contract to build and maintain automated test frameworks for cloud data pipelines and applications. The role emphasizes Python, SQL, PySpark, and Databricks, with strong emphasis on CI/CD integration and defect management.

You will design and implement test suites across unit to end-to-end levels, validate data, and contribute to a robust testing culture within the team.