Test Engineer – Data & ETL Automation (Cloud)

iO Associates; Greater London; On-site; GBP 55,000 - 75,000; Full time

Job summary

iO Associates is seeking a skilled Test Engineer to strengthen data and cloud transformation programmes. The role emphasizes test automation for data and ETL processes and requires experience with SQL and Python-based testing approaches.

You'll design and implement automated test solutions, validate data accuracy, and collaborate with cross-functional teams across AWS/Azure environments. Familiarity with PySpark, Kafka, and CI/CD will help drive reusable testing frameworks and shift-left testing

Qualifications

• Experience in test automation for data and ETL processes.
• Understanding of data validation techniques across datasets.
• Proficiency in SQL and relational databases (e.g. Oracle or similar).
• Hands-on experience with Python and pytest.
• Exposure to BDD (Behave) and/or TDD approaches.
• Knowledge of ETL processes, data warehousing concepts, and PySpark.
• Experience working with cloud platforms such as AWS and/or Azure.
• Familiarity with event-driven or data streaming technologies (Kafka).
• Understanding of CI/CD pipelines, version control, and modern development practices.
• Experience contributing to test automation frameworks.
• Active SC clearance is required for this role, or candidates must be eligible to obtain it.
• Experience working in government or regulated environments.
• Awareness of aligning engineering work to organisational strategies.
• Knowledge of data architecture patterns and testing approaches.

Responsibilities

• Design and implement automated tests for data pipelines, ETL processes, and cloud-based platforms
• Perform data validation activities, ensuring accuracy, completeness, and integrity across datasets
• Develop and maintain test automation using Python and pytest, with exposure to TDD and BDD (Behave) approaches
• Create and manage test data to support ETL and data warehousing validation
• Contribute to improving automation frameworks to enhance efficiency and reusability
• Collaborate with engineering teams to support shift-left testing practices
• Participate in peer reviews, code reviews, and CI/CD processes
• Support cloud-based solutions, working with platforms such as AWS and Azure, and technologies like Kafka
• Identify opportunities for reuse and standardisation within testing approaches
• Help ensure testing aligns with client objectives and delivery goals
• Contribute to knowledge sharing within teams to support ongoing capability development

Skills

Test automation

Data validation

SQL

Python

BDD

TDD

CI/CD

Cloud platforms

Data warehousing

GOV/regulatory familiarity

SC clearance eligible

Kafka

ETL testing

Tools

PyTest

PySpark

Kafka

AWS

Azure

Python

Job description

iO Associates is seeking a skilled Test Engineer to strengthen data and cloud transformation programmes. The role emphasizes test automation for data and ETL processes and requires experience with SQL and Python-based testing approaches.

You'll design and implement automated test solutions, validate data accuracy, and collaborate with cross-functional teams across AWS/Azure environments. Familiarity with PySpark, Kafka, and CI/CD will help drive reusable testing frameworks and shift-left testing