AI Ops Engineer

Berry Bros. & Rudd Ltd; Basingstoke, Greater London; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Private medical cover

Life Insurance

Pension

Employee Assistance Programme

Employee discount

Job summary

Berry Bros. & Rudd Ltd seeks an IT Monitoring Engineer to oversee Orchestrators and Monitoring agents across multiple processes. You will monitor performance, generate reports, and refine routing logic while collaborating with AI Engineering leads and external vendors.

The role includes maintaining in-house .NET applications and supporting Azure services, with hybrid working options and a focus on cost optimization through model testing.

Qualifications

• Proven QA and output monitoring experience.
• Escalation management and pattern recognition.
• Ability to translate data into actionable insights for AI agents.

Responsibilities

• Owns Orchestrators and Monitoring agents across processes.
• Monitors agent performance and flags issues.
• Tunes routing and logic and tests cost-optimized models.
• Supports internal dotNet platforms and Azure services.

Skills

Quality assurance

Analytical thinking

AI agent development

API integration

Azure services

.NET maintenance

Tools

.NET

Azure

Dashboard tools

Job description

Requisition ID2433-Posted09/08/2026-IT-IT- External Location (2) -IT

Hybrid working available (a minimum of 3 days working from the office, 2 days working from home)

The job in a nutshell

Monitors agent performance across the BB&R estate - reporting and flagging on performance, whilst tuning the routing and logic. Works with AI Engineering Lead on delivery tasks. Owns the Orchestrators and Monitoring agents shared across all process areas. Also provides support on internal dotnet platforms.

Who you will work with

Internal: AI Lead Engineer (reports to); process area leads and agent-owning roles across Buying, Offer Admin and Customer Contact processes whose agents this role monitors. Application Support team for 3rd party app integrations

External: Agentic plaform vendors; Suppliers & SaaS Providers

3rd party business application partners

What you will do

• Owns Orchestrators and Monitoring agents (shared/central, cross-process)
• Monitors agent performance across the estate
• Reports and flags on performance issues
• Tunes routing and logic
• Optimise agent costs by testing and validating model performance using optimised lower cost models and progressing these into production
• Define new AI agent capabilities and interfaces to replace legacy processes
• Maintain and Enhance in house dotNet applications as directed

Experience / Achievements

• Demonstrable experience in quality assurance and output monitoring
• Proven experience in escalation management and pattern recognition
• Experience of analytical thinking applied to high-volume outputs
• Experience producing clear written communication for exception reports
• Demonstrable experience in AI agent development and optimisation
• Deep experience with API and MCP integration and agentic platform system architecture
• Understanding of Microsoft dotnet development platform and Azure+ services

Your Skills, Knowledge and Behaviours

• Strong attention to detail across high-volume agent outputs
• [Desirable] Experience in Lyzr and/or Microsoft Foundry platform
• [Desirable] Dashboard and alerting tools
• [Desirable] Process improvement methodology and data visualisation

We support our colleagues with a wide range of benefits:

• you will start with 24 days' holiday
• and 3 additional days over the Christmas period and 1 Personal Day
• Private Medical cover & Health plan
• Life Insurance
• Pension
• Employee Assistance Programme (EAP)
• generous Employee discount (up to 40% off products)
• and many more.

N.B. We reserve the right to close a vacancy before the closing date in the event of an overwhelming response or a change in business priorities.