AI Engineer: LLM Apps & RAG Pipelines for Government

CyberNorth; United Kingdom; Remote; GBP 70,000 - 110,000; Full time

Job summary

Scrumconnect Consulting is seeking an AI Engineer to implement the application-level AI capability within a large-scale AI adoption programme for a central government department. You will work on turning LLMs, retrieval systems, and agentic workflows into usable features that integrate with the department’s services.

You will collaborate in a Rainbow Team with civil servants, implementing the guardrails and standards set by the Lead AI Engineer and Lead Technical Architect.

Qualifications

• Experience building applications using LLMs or foundation models via API or self-hosted.
• Experience with RAG architectures, vector databases, and embedding-based retrieval.
• Strong Python programming and API design/integration skills.
• Prompt engineering with an evaluation-driven approach.
• Familiarity with agentic/orchestration frameworks and multi-step AI workflows.
• Ability to work in secure, regulated environments and handle sensitive data.
• Experience delivering digital services within UK central government or the wider public sector.
• Familiarity with GOV.UK Service Standard expectations.
• Exposure to open-source LLM tooling or communities.
• Familiarity with AI/ML tooling on AWS, Azure, or GCP.

Responsibilities

• Build & Integrate Implement RAG pipelines, prompt templates, and agentic workflows, and wire them into application logic that connects with legacy and multi-cloud systems.
• Prompt Engineering & Evaluation Design, test, and iterate on prompts and retrieval strategies; run structured evaluations to track answer quality and retrieval accuracy.
• Responsible AI in Practice Implement the guardrails and human-in-the-loop checkpoints defined by leads — execution role, not policy setting.
• Documentation & Handover Contribute to Docs-as-Code artifacts supporting the OKUA knowledge-transfer framework for maintainability.

Skills

LLMs / Foundation Models

RAG architectures

Vector databases

Python

API design / integration

Prompt engineering

Agent orchestration / workflows

Secure gov/public sector experience

GOV.UK Service Standard familiarity

Open-source LLM tooling

AWS

Azure

GCP

Tools

AWS

Azure

GCP

Self-hosted deployment

Job description

Scrumconnect Consulting is seeking an AI Engineer to implement the application-level AI capability within a large-scale AI adoption programme for a central government department. You will work on turning LLMs, retrieval systems, and agentic workflows into usable features that integrate with the department’s services.

You will collaborate in a Rainbow Team with civil servants, implementing the guardrails and standards set by the Lead AI Engineer and Lead Technical Architect.