Senior Test & Evaluation Lead: Systems Validation & Evidence

OB Collective; Greater London; Remote; GBP 60.000 - 100.000; Vollzeit

Zusammenfassung

OB Collective, a UK technology business, is seeking a Senior Test, Evaluation & Measurement Lead for a six-month software-intensive programme. You will own the system's test strategy, define conditions, reference data, metrics and evaluation methods, and maintain independence to challenge assumptions behind the system.

You will work with engineers to instrument the test environment, design fault and failure scenarios, analyse results, and ensure evidence supports conclusions.

Qualifikationen

• Strong systems Test & Evaluation, V&V or experimental engineering background.
• Experience designing test programmes, rather than only executing pre-written scripts.
• Quantitative measurement and analysis.
• Ground-truth, reference-condition or test-oracle design.
• Performance, resilience, reliability or fault testing.

Aufgaben

• Own the programme's test and evaluation approach.
• Turn technical and operational questions into measurable test conditions.
• Define reference conditions, test oracles and valid measurement denominators.
• Establish metrics for detection, false positives, timing, performance and resilience.
• Design and control selected fault and challenge scenarios.
• Define repeatability, uncertainty and appropriate limits on inference.
• Work with engineers to ensure the test environment is sufficiently instrumented.
• Analyse test results and identify where the evidence does or does not support a conclusion.
• Ensure negative and inconclusive results are retained and reported properly.
• Support formal technical reviews and final evidence synthesis.
• Maintain independence from the engineer principally responsible for the verification implementation.

Kenntnisse

Test & Evaluation

V&V

Experimental engineering

Quantitative analysis

Test programme design

Uncertainty assessment

Challenge engineers

Jobbeschreibung

OB Collective, a UK technology business, is seeking a Senior Test, Evaluation & Measurement Lead for a six-month software-intensive programme. You will own the system's test strategy, define conditions, reference data, metrics and evaluation methods, and maintain independence to challenge assumptions behind the system.

You will work with engineers to instrument the test environment, design fault and failure scenarios, analyse results, and ensure evidence supports conclusions.