Agent Force Tester

Anson McCade Pty; Greater London; Remote; GBP 40,000 - 60,000; Full time

Benefits offered by this job

Remote-first model with minimal travel

Potential for contract extension

Exposure to AI transformation work

Job summary

A leading technology recruitment firm is seeking an experienced QA professional for an AI Testing role within the public sector. The position focuses on validating AI behavior and conversational accuracy on the Salesforce AgentForce platform. Ideal candidates should possess a background in software testing, familiarity with AI systems, and a structured approach to testing. The role offers a remote-first model with minimal London travel, and an initial six-month contract with strong extension potential.

Qualifications

• Proven experience in software testing, QA, or conversational AI testing.
• Exposure to functional, regression, exploratory, and UAT methodologies.
• Understanding of AI or LLM-based systems, chatbot testing, or NLP concepts.

Responsibilities

• Designing and executing structured test plans for AI agents.
• Testing conversational flows, APIs, and multi-channel deployments.
• Logging defects and validating fixes with engineers.

Skills

Software testing

QA methodologies

Conversational AI testing

Attention to detail

Tools

JSON

APIs

Automation frameworks

Job description

Location: London, Remote First (1–2 days per month onsite max)

Function: AI Testing / Quality Assurance

Industry: Public Sector

Contract: 6 Months (High Extension Potential)

About the Role

Our client is delivering AI-powered digital capabilities within a secure public sector environment. They are building and scaling intelligent agents on the Salesforce AgentForce platform and need a dedicated Tester to ensure these agents are accurate, reliable, safe, and production-ready.

This is not traditional UI testing. You will be validating AI behaviour, conversational accuracy, workflow logic, integrations, and compliance standards. You will sit between Product, Engineering, and business stakeholders to ensure agents perform as intended across real-world use cases.

What You’ll Be Doing

• Designing and executing structured test plans for AI agents within the AgentForce environment.
• Testing conversational flows, APIs, integrations, CRM interfaces, and multi-channel deployments.
• Validating intent recognition, response quality, business rule adherence, and safety guardrails.
• Conducting regression testing after retraining, fine-tuning, or configuration updates.
• Logging reproducible defects and working closely with engineers to validate fixes.
• Analysing conversation logs to identify misclassifications, edge cases, and optimisation opportunities.
• Monitoring metrics such as accuracy, latency, escalation rates, and user satisfaction.
• Supporting compliance, audit readiness, and responsible AI standards in a regulated setting.

Ideal Background

You will demonstrate:

• Proven experience in software testing, QA, or conversational AI testing.
• Exposure to functional, regression, exploratory, and UAT methodologies.
• Understanding of AI or LLM-based systems, chatbot testing, or NLP concepts.
• Working knowledge of JSON, APIs, and automation frameworks.
• Strong analytical capability with attention to detail.

Highly desirable:

• Experience with Salesforce AgentForce, Agent Builder, or AgentForce Testing Centre.
• Experience in secure or regulated environments.

Keywords that will stand out: AgentForce, Agent Builder, Testing Centre, AI Agent QA.

What You’ll Receive

• Remote-first model with minimal London travel.
• 6-month initial contract with strong likelihood of extension.
• Exposure to AI transformation work within a high-impact government department.

Who Should Apply

This role suits a technically strong QA professional who understands AI systems beyond surface-level testing. You are structured, detail-driven, comfortable working with ambiguity, and capable of challenging agent outputs where logic or safety is compromised.

You must be SC clearable and a sole British national. Non-cleared profiles may be considered if technically strong.

If your background includes AgentForce Builder or Testing Centre experience, flag this clearly when applying.

Interested candidates should respond with availability and confirmation of clearance status.