AI Testing & Quality Lead

Newcode.ai; Stockholms kommun; On-site; SEK 900,000 - 1,300,000; Full time

Benefits offered by this job

Growth opportunities

Collaborative environment

Ownership over role

Job summary

Newcode.ai in Stockholm is seeking a Head of Testing to own the vision, strategy, and execution for testing AI-powered products. You will develop frameworks, processes, and standards to ensure reliable, high-quality solutions for customers.

You will collaborate with Engineering and Legal Engineering to establish a world-class testing function, designing strategies for functionality, usability, accuracy, and edge cases while enabling scalable growth.

Qualifications

• 5+ years of experience in software testing, quality assurance, product quality, or a related technical role.
• Proven experience testing AI-powered products, ML systems, or LLM-based applications.
• Strong understanding of AI evaluation methodologies and how to measure AI system performance.
• Experience designing testing frameworks and quality processes from the ground up.
• Ability to translate complex technical issues into clear insights and recommendations.

Responsibilities

• Develop and execute Newcode's overall testing strategy across AI-powered products
• Create testing frameworks and methodologies for evaluating product functionality, usability, accuracy, reliability, and performance
• Design and implement processes for testing AI outputs, including quality benchmarks, evaluation criteria, and success metrics
• Build structured test plans, test cases, and documentation to support product releases
• Identify gaps, risks, and improvement opportunities through rigorous product testing
• Partner with Engineering team to improve product quality and development processes
• Establish repeatable workflows for regression testing, user acceptance testing, and release validation
• Analyze testing results and provide actionable insights to improve product performance
• Develop best practices for AI evaluation, including assessing accuracy, consistency, hallucination risks, and edge cases
• Help define quality standards as Newcode scales its products and customer base
• Build and evolve the testing function, including future team growth and processes

Skills

Software testing

AI testing

Test frameworks

Quality assurance

Cross-functional collaboration

Documentation

Communication

Automation tooling

Startup mindset

Tools

Automation frameworks

Job description

Newcode.ai in Stockholm is seeking a Head of Testing to own the vision, strategy, and execution for testing AI-powered products. You will develop frameworks, processes, and standards to ensure reliable, high-quality solutions for customers.

You will collaborate with Engineering and Legal Engineering to establish a world-class testing function, designing strategies for functionality, usability, accuracy, and edge cases while enabling scalable growth.