Lead AI Engineer

scrumconnect ltd; Walbottle; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

Scrumconnect Consulting is seeking a Lead AI Engineer to drive hands-on development of AI components within a large-scale government AI Operating Model programme. You will design, implement, and ship production-grade AI capabilities—RAG pipelines, semantic search, and LLM orchestration—integrated into multi-cloud, secure data environments across the UK.

You will lead the squad's engineering practice, set standards, review designs, mentor engineers, and enforce Responsible AI, security, and

Qualifications

• Writing production-grade, well-tested code across AI components.
• Designing components that integrate into larger architectures.
• Building reliable data pipelines for AI consumption.
• Implementing CI/CD, IaC, and automated deployment for AI workloads.
• Creating evaluation harnesses for AI quality, bias checks and guardrails.
• Diagnosing complex issues under production pressure.
• Delivering iteratively within a blended government-facing team.

Responsibilities

• Hands-on build and delivery of AI components (RAG pipelines, embedding infrastructure, orchestration).
• Lead engineering practice within the squad: coding standards, PR reviews, mentoring.
• Implement guardrails for Responsible AI (bias checks, evaluation harnesses, human-in-the-loop).
• Ensure security, observability, and reliable production deployments for sensitive data.
• Transfer knowledge to civil servants via Docs-as-Code and cohort activities.
• Promote sustainable, low-modality designs aligned to Green IT commitments.

Skills

Coding and Scripting

Systems Design

Data Engineering

DevOps/CD

Testing & Evaluation

Problem Solving

Agile Working

Python

Tools

LangChain

LlamaIndex

Job description

About Scrumconnect Consulting

Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. We are passionate about user-centred design, agile delivery, and building digital services that make a real difference - and we're now scaling that expertise into large, high-stakes AI adoption programmes across the public sector.

Overview

We're looking for a Lead AI Engineer to be the hands‑on technical builder at the core of a large‑scale AI Operating Model programme for a central government department. Where the Lead Technical Architect sets direction, you turn it into working, production‑grade systems - semantic search, RAG pipelines, and broader generative AI capability - integrated into complex Legacy and multi‑cloud environments handling high‑volume, sensitive public sector data.

Key Responsibilities

• Hands‑On Build & Delivery Design, build, and ship production AI components – RAG pipelines, retrieval and embedding infrastructure, orchestration logic, and integration layers – writing high‑quality, tested, maintainable code and staying close to implementation rather than delegating it away.
• Technical Leadership Within the Squad Lead the engineering practice within your delivery team: set coding standards, review designs and pull requests, unblock technically complex problems, and mentor other engineers day to day.
• Responsible AI in Practice Implement the guardrails the Architect designs – bias mitigation checks, evaluation harnesses, human‑in‑the‑loop review points – so that Responsible AI principles (ATRS alignment, NCSC “Secure by Design”, meaningful human control) are enforced in the running system, not just on paper.
• Reliability, Security & Observability Build AI services to be secure‑by‑default and observable in production: logging, monitoring, alerting, and rollback paths appropriate for sensitive public‑sector data and high‑availability requirements.
• Knowledge Transfer & Capability Uplift Work within the OKUA (Ownership, Knowledge, Understanding, Awareness) framework and “Docs‑as‑Code” practices to pair with and upskill internal government engineers, so capability genuinely transfers rather than staying locked in the consultancy team.
• Efficient, Sustainable Engineering Favour low‑modality, resource‑efficient designs where they meet the need – right‑sizing models and infrastructure rather than defaulting to the largest/most expensive option – in line with the programme's Green AI and Net Zero commitments.

Required Skills & Experience

Loosely mapped to the Government Digital and Data (DDaT) framework, at Lead Engineer level:

• Coding and Scripting (Expert) – writing production‑grade, well‑tested code; setting standards for others; comfortable owning components end‑to‑end.
• Systems Design (Practitioner) – designing components that integrate cleanly into a wider, architect‑defined system; understanding trade‑offs across the stack.
• Data Engineering (Practitioner) – building reliable pipelines to ingest, clean, and prepare data (including unstructured/Legacy sources) for AI consumption.
• DevOps/Continuous Delivery (Practitioner) – CI/CD pipelines, infrastructure‑as‑code, and automated deployment for AI workloads specifically (not just conventional web services).
• Testing & Evaluation (Practitioner) – beyond conventional unit/integration testing, building evaluation harnesses for AI system quality: retrieval accuracy, hallucination rate, bias/fairness checks.
• Problem Solving (Practitioner) – diagnosing and resolving complex, ambiguous technical issues under production pressure.
• Agile Working (Practitioner) – delivering iteratively within a blended, multidisciplinary team including civil servants.

Given the scale of this programme, direct hands‑on depth across the AI engineering stack is essential:

• Strong general‑purpose programming (most commonly Python) applied to AI/ML systems
• Semantic search, vector/embedding infrastructure, and RAG pipeline construction
• LLM orchestration and agentic frameworks (e.g., LangChain/LlamaIndex‑style tooling, multi‑agent patterns)
• Prompt engineering and systematic evaluation/guardrail tooling (hallucination detection, safety testing)
• LLMOps/MLOps – model versioning, deployment, monitoring, and rollback for AI services in production
• Cloud‑native engineering across major providers (AWS, Azure, or GCP), including their AI/ML tooling
• Containerisation and infrastructure‑as‑code for repeatable, auditable deployments
• Secure‑by‑design engineering appropriate to sensitive public‑sector data

Desirable Experience

• AWS/Azure/GCP certifications (associate or professional level)
• Prior delivery of AI or digital services within UK central government or wider public sector
• Experience fine‑tuning or adapting open‑source/foundation models for a specific domain
• Open‑source contributions or active engagement in AI/ML engineering communities
• Experience designing for sustainability/Green IT commitments
• The technological capabilities can span a wide range of AI and automation tools, including Virtual Assistants, Robotic Process Automation (RPA), Computer Vision, Natural Language Processing (NLP), Machine Learning, Deep Learning, Generative AI, Frontier LLMs, and Predictive AI. A strong candidate would have experience/exposure to nuances of these tools/technologies.

Location and Working Pattern

Hybrid, based from Newcastle upon Tyne, with on‑site attendance required for workshops, knowledge‑transfer sessions, and onboarding. All production system and data access must be performed solely from within the UK.

How We Work

Our values:

• Collaboration – we are stronger as a team than as individuals; we tackle problems and celebrate wins together.
• Create Value Early – we find the quickest route from idea to product, because our clients rely on us to do what's best.
• Integrity – teamwork requires trust; we can always be relied upon to uphold the highest standards.
• Commitment – no matter what, no matter how, we give our 100% to keeping our promises and achieving our goals.
• Diversity and Inclusion – we believe diversity drives innovation and better outcomes, and we're committed to an inclusive environment where every individual is valued, respected, and supported. We welcome applications from candidates of all backgrounds, including women, people with disabilities, and diverse communities, as well as those seeking flexible working arrangements.

Additional Requirements

BPSS (Baseline Personnel Security Standard) clearance is required.

EEO Statement

As a Disability Confident Level 1 employer, we provide reasonable adjustments throughout recruitment and employment to ensure equal opportunity for all.