Senior QA Tester - AI Solutions

MCS Group | Your Specialist Recruitment Consultancy; Belfast; Hybrid; GBP 45,000 - 60,000; Full time

Benefits offered by this job

Private healthcare

Share options

Flexible hybrid working

Additional company days off

Job summary

MCS Group is supporting a leading Belfast-based technology company in hiring a Senior QA Engineer for their AI Solutions team. This role involves designing testing strategies, building automated frameworks, and validating complex integrations.

The ideal candidate will have over 5 years of experience in QA Engineering, a strong background in automation testing, and familiarity with AI technologies. Competitive salary and benefits, along with flexible hybrid working, are offered.

Qualifications

• 5+ years' experience in QA Engineering.
• Strong automation testing experience.
• Experience testing complex software platforms and APIs.
• Excellent communication skills.

Responsibilities

• Design testing strategies for AI and LLM-powered applications.
• Build automated evaluation frameworks and test suites.
• Validate complex integrations, APIs, and data pipelines.
• Work closely with AI Solutions Engineers.
• Integrate testing into CI/CD pipelines.

Skills

Automation testing

Python or other scripting/programming experience

Performance testing

Understanding of CI/CD pipelines

Experience with AI, LLMs

Tools

LangSmith

Docker

AWS

Azure

GCP

Job description

MCS Group is delighted to be supporting an innovative Belfast-based technology company as they look to hire a Senior QA Engineer to join their growing AI Solutions team.

This is an opportunity to work on cutting-edge AI and LLM-powered applications used within highly regulated environments. You'll play a key role in ensuring quality across intelligent workflows, agent-based systems, integrations, and AI-driven solutions where reliability and robustness are critical.

The Role

• Design testing strategies for AI and LLM-powered applications
• Build automated evaluation frameworks and test suites
• Validate complex integrations, APIs and data pipelines
• Work closely with AI Solutions Engineers throughout the delivery lifecycle
• Integrate testing into CI/CD pipelines and development workflows
• Define QA standards and best practices for AI applications
• Help shape the future QA function within a rapidly growing organisation

What We're Looking For

• 5+ years' experience in QA Engineering
• Strong automation testing experience
• Experience testing complex software platforms and APIs
• Python or other scripting/programming experience
• Understanding of CI/CD pipelines and modern engineering practices
• Experience with AI, LLMs, prompt testing, evaluation frameworks, or a strong interest in this area
• Excellent communication skills and the ability to work closely with technical teams
• LangSmith, DeepEval, Ragas, Promptfoo or similar tools
• Agentic workflows, RAG applications or AI evaluation pipelines
• Performance testing
• Cloud platforms such as AWS, Azure or GCP
• Docker and containerised environments
• Experience within regulated industries

What's On Offer

• Competitive salary and benefits package
• Private healthcare
• Share options
• Flexible hybrid working
• Exposure to cutting-edge AI technologies
• Significant influence over QA strategy and standards
• A genuinely unique working pattern with additional company days off throughout the year

Unfortunately, sponsorship cannot be provided for this position.

To find out more, apply now or contact Djay Erskine at MCS Group for a confidential discussion.