Public Sector AI Engineer — Hybrid Cloud

IBM; Leicester; On-site; GBP 90,000 - 140,000; Full time

Job summary

IBM Consulting is seeking an experienced AI Engineer to design, build, and deploy enterprise AI solutions at scale. You will work with Architects, Data Scientists, Engineers, and client stakeholders to translate AI capabilities into secure, production-ready systems.

The role focuses on LLMs, RAG, agentic AI, and modern integration patterns, balancing governance, security, and business outcomes across high-profile programs.

Qualifications

• Hands-on experience with LLMs and LLM APIs.
• Proven ability to design production RAG and agent-based AI systems.
• Strong Python development and API integration skills.
• Experience deploying AI-enabled applications in production.
• Knowledge of evaluation, hallucination mitigation, and responsible AI.

Responsibilities

• Design, build, and deploy AI-powered apps and services with LLMs.
• Implement RAG, agentic workflows, and semantic retrieval.
• Integrate AI capabilities into existing platforms via APIs.
• Collaborate with architects, data scientists, and engineers.
• Ensure scalable, secure, and governance-aligned solutions.
• Mentor teams and promote AI engineering best practices.

Skills

LLMs

Python

API design

Data integration

Stakeholder comms

Production deployment

Evaluation & governance

Vector search

LangChain/related tools

Tools

LangChain

LangGraph

DSPy

Semantic Kernel

LlamaIndex

Qdrant

Pinecone

Weaviate

FAISS

CI/CD

Containerisation

Job description

IBM Consulting is seeking an experienced AI Engineer to design, build, and deploy enterprise AI solutions at scale. You will work with Architects, Data Scientists, Engineers, and client stakeholders to translate AI capabilities into secure, production-ready systems.

The role focuses on LLMs, RAG, agentic AI, and modern integration patterns, balancing governance, security, and business outcomes across high-profile programs.