Public Sector AI Engineer: Hybrid Cloud & RAG Solutions

International Business Machines Corporation; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Private medical, dental & optical

25 days holiday + public holidays

Employee Assistance Program

Group pension plan (salary sacrifice)

Life assurance

Job summary

IBM Consulting UK FutureNow is seeking a Consulting AI Engineer to turn emerging AI capabilities into practical, production-ready solutions. You will design, build, and deploy AI-powered applications within IBM's Hybrid Cloud & Data practice, collaborating with Data Scientists, Architects, and client stakeholders to deliver scalable, secure, and trusted AI-powered services.

The role emphasizes building AI systems into existing processes and platforms across public sector and regulated

Qualifications

• Commercial experience developing solutions using Large Language Models (LLMs) and LLM APIs.
• Hands-on experience implementing production RAG solutions and/or agent-based AI systems.
• Strong Python development skills.
• Experience developing APIs and integrating systems using modern integration patterns.
• Understanding of prompt engineering, retrieval strategies, and AI evaluation approaches.
• Experience mitigating hallucinations and improving response quality through grounding, retrieval, or evaluation techniques.
• Understanding of Responsible AI principles, governance, and secure AI adoption.
• Strong communication skills and ability to work directly with technical and non-technical stakeholders.
• Experience delivering solutions within Agile development environments

Responsibilities

• Design, develop, and deploy AI-powered applications and services using Large Language Models (LLMs).
• Build Retrieval-Augmented Generation (RAG) solutions and agent-based workflows for real-world business use cases.
• Integrate AI capabilities into existing enterprise applications, services, and operational processes.
• Develop APIs, services, and integration patterns that enable secure adoption of AI technologies.
• Work with Data Engineers, Architects, and client stakeholders to translate business requirements into production-ready solutions.
• Support the evaluation, testing, and optimisation of AI systems, balancing performance, cost, reliability, and risk.
• Contribute to responsible AI adoption through appropriate governance, security, and evaluation practices.
• Participate in Agile delivery teams and contribute throughout the full delivery lifecycle.

Skills

LLMs development

Python

APIs

Integration patterns

Prompt engineering

RAG solutions

Responsible AI

Agile development

Stakeholder communication

Security & governance

Education

Bachelor's Degree

Tools

LangChain

LangGraph

Semantic Kernel

LlamaIndex

CI/CD

Containerisation

Job description

IBM Consulting UK FutureNow is seeking a Consulting AI Engineer to turn emerging AI capabilities into practical, production-ready solutions. You will design, build, and deploy AI-powered applications within IBM's Hybrid Cloud & Data practice, collaborating with Data Scientists, Architects, and client stakeholders to deliver scalable, secure, and trusted AI-powered services.

The role emphasizes building AI systems into existing processes and platforms across public sector and regulated