Clinical AI Quality & Validation Lead

Tonic App; Porto; Hybrid; EUR 55,000 - 75,000; Full time

Job summary

Tonic App in Porto, Portugal is seeking an AI Quality & Validation Specialist to own how we evaluate our AI products before production. You will define quality criteria, run evaluations, and sign off on releases as a gatekeeper, ensuring safety and regulatory alignment across markets.

You will design validation systems, create KPIs, maintain audit-ready documentation, and coordinate with product, data, engineering, clinicians, and compliance to scale validation as new features and markets expand.

Qualifications

• 2-4 years or more in a role where evaluating quality was the job itself: model or LLM evaluation, applied AI quality, validation, or an equivalent function.
• You have built an evaluation framework from scratch or have managed and evolved one.
• Clear technical writing for a regulatory or audit audience. Validation reports and records are a primary deliverable of this role.
• Comfortable working with data and interpreting quality and performance metrics.

Responsibilities

• Own the release gate. Define the quality criteria a version must meet to reach production and run the evaluation against them.
• Build and maintain the validation system. Design test sets, define KPIs and evaluators, link them to the state-of-the-art evaluation practices and keep them current as the product and its clinical scope evolve.
• Make validation reproducible. Maintain a traceable chain from requirement to test case to dataset version to result to release decision, so the same conclusion can be reached again months later by someone else.
• Monitor products in production. Track quality and perform post-market surveillance to inform internal stakeholders on key findings.
• Stand behind the process in audits. Work with our compliance lead, who owns the quality management system, to keep validation documentation audit-ready and to represent the evaluation process during internal and external audits.
• Scale evaluation without scaling costs linearly. Validation coverage grows with every new feature, model and market, and adding reviewers is not a viable answer. You will coordinate the human review work that sits with our clinical team and find ways to reduce the human load.

Skills

Strong communication

Cross-functional collaboration

Regulatory writing

Tools

Python

SQL

Job description

Tonic App in Porto, Portugal is seeking an AI Quality & Validation Specialist to own how we evaluate our AI products before production. You will define quality criteria, run evaluations, and sign off on releases as a gatekeeper, ensuring safety and regulatory alignment across markets.

You will design validation systems, create KPIs, maintain audit-ready documentation, and coordinate with product, data, engineering, clinicians, and compliance to scale validation as new features and markets expand.