AI Engineer | Public Sector Consulting

IBM; Hursley; On-site; GBP 90,000 - 120,000; Full time

Job summary

IBM Consulting FutureNow's Hybrid Cloud & Data practice is seeking an experienced Senior AI Engineer to design, build, and deploy enterprise AI solutions across client environments. You’ll work with Architects, Data Scientists, Engineers and stakeholders to translate business needs into scalable, secure, and production-ready AI applications focused on LLMs, RAG, and agent-based workflows.

This role emphasizes responsible AI, governance, and collaboration across delivery teams in a fast-paced,

Qualifications

• Hands-on experience with LLMs and LLM APIs in production.
• Experience implementing production RAG solutions and agent-based AI.
• Strong Python development skills and API integration.
• Experience deploying AI-enabled applications in production.
• Understanding AI evaluation, hallucination mitigation, and responsible AI.
• Experience with embeddings, vector search, or semantic retrieval.

Responsibilities

• Design, build, and deploy AI-powered applications using LLMs and modern frameworks.
• Deliver enterprise AI solutions including RAG, agent-based workflows, and semantic search.
• Integrate AI capabilities into existing platforms via APIs and modern patterns.
• Collaborate with Architects, Data Scientists, Engineers and stakeholders.
• Evaluate performance, reliability, and user experience of AI systems.
• Mitigate hallucinations and improve retrieval quality across solutions.
• Support AI governance, security controls, and responsible AI practices.
• Translate business requirements into production-ready solutions.
• Mentor teams and share AI engineering best practices.

Skills

LLMs (large language models)

RAG

Python

API development

Production deployment

Vector search

Stakeholder comms

End-to-end delivery

Prompt engineering

Tools

LangChain

LangGraph

DSPy

Semantic Kernel

LlamaIndex

Qdrant

Pinecone

Weaviate

FAISS

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

Join IBM Consulting FutureNow's Hybrid Cloud & Data practice and help clients unlock the value of Artificial Intelligence at scale.

We're looking for an experienced AI Engineer to design, build, and deploy enterprise AI solutions across a range of client environments. Working alongside Architects, Data Scientists, Engineers, and client stakeholders, you'll help translate emerging AI capabilities into practical, secure, and production-ready solutions.

This role is particularly well suited to individuals who enjoy solving complex technical challenges through Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), agentic AI systems, and modern integration patterns.

You’ll work across a variety of high-profile programmes, helping organisations operationalise AI responsibly while balancing scalability, governance, security, and business outcomes.

Role & Responsibilities

As a Senior AI Engineer, you will play a key role in the design, development, and deployment of AI-powered solutions across client engagements.

Core Responsibilities

• Design, build, and deploy AI-powered applications and services using Large Language Models and modern AI frameworks.
• Deliver enterprise AI solutions including Retrieval-Augmented Generation (RAG), agentic workflows, semantic search, and knowledge retrieval systems.
• Integrate AI capabilities into existing business platforms, products, and services through APIs and modern integration patterns.
• Collaborate with Architects, Data Scientists, Engineers, and stakeholders to shape scalable and secure AI solutions.
• Evaluate and optimise AI system performance, reliability, and user experience.
• Develop approaches to mitigate hallucinations, improve retrieval quality, and enhance overall model outcomes.
• Contribute to AI governance, evaluation frameworks, security controls, and responsible AI practices.
• Translate business requirements into production-ready technical solutions.
• Support mentoring, knowledge sharing, and AI engineering best practice across delivery teams.

Required Technical And Professional Expertise

• Hands-on experience working with Large Language Models (LLMs) and LLM APIs.
• Experience implementing production RAG (Retrieval-Augmented Generation) solutions and/or agent-based AI systems.
• Strong Python development skills.
• Strong API development and systems integration experience.
• Experience designing and deploying AI-enabled applications in production environments.
• Understanding of AI evaluation techniques, hallucination mitigation, prompt engineering, and responsible AI principles.
• Experience working with unstructured data, embeddings, vector search, or semantic retrieval approaches.
• Strong stakeholder engagement and communication skills.
• Experience delivering solutions from concept through to deployment and adoption.

This role is subject to pre-employment screening in line with the UK Government's Baseline Personnel Security Standard (BPSS). Additional National Security Vetting (NSV) requirements may apply, including eligibility for Security Check (SC) or Developed Vetting (DV).

Preferred Technical And Professional Experience

• Experience with frameworks such as LangChain, LangGraph, DSPy, Semantic Kernel, LlamaIndex, or similar.
• Experience with vector databases such as Qdrant, Pinecone, Weaviate, FAISS, or equivalent.
• Familiarity with agent orchestration, tool calling, and multi-agent architectures.
• Experience deploying AI solutions within cloud environments (AWS, Azure, or GCP).
• Exposure to AI governance, model assurance, or regulated industries.
• Experience operating within Public Sector, Defence, Financial Services, or other high-assurance environments.
• Familiarity with CI/CD, containerisation, and modern software engineering practices.