AI Engineer — Public Sector & Hybrid Cloud Expert

IBM; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

IBM Consulting is seeking an experienced AI Engineer to design, build, and deploy enterprise AI solutions at scale across client environments. You will work with Architects, Data Scientists, Engineers, and stakeholders to translate emerging AI capabilities into practical, secure production-ready systems.

This role focuses on LLMs, RAG, agent-based AI, and modern integration patterns, with emphasis on governance, security, and responsible AI practices while delivering measurable business outcomes.

Qualifications

• Hands-on experience with Large Language Models (LLMs) and LLM APIs.
• Experience implementing production RAG (Retrieval-Augmented Generation) solutions and/or agent-based AI systems.
• Strong Python development skills.
• Strong API development and systems integration experience.
• Experience designing and deploying AI-enabled applications in production environments.
• Understanding of AI evaluation techniques, hallucination mitigation, prompt engineering, and responsible AI principles.
• Experience working with unstructured data, embeddings, vector search, or semantic retrieval approaches.
• Strong stakeholder engagement and communication skills.
• Experience delivering solutions from concept through to deployment and adoption.

Responsibilities

• Design, build, and deploy AI-powered applications and services using Large Language Models and modern AI frameworks.
• Deliver enterprise AI solutions including Retrieval-Augmented Generation (RAG), agentic workflows, semantic search, and knowledge retrieval systems.
• Integrate AI capabilities into existing business platforms, products, and services through APIs and modern integration patterns.
• Collaborate with Architects, Data Scientists, Engineers, and stakeholders to shape scalable and secure AI solutions.
• Evaluate and optimise AI system performance, reliability, and user experience.
• Develop approaches to mitigate hallucinations, improve retrieval quality, and enhance overall model outcomes.
• Contribute to AI governance, evaluation frameworks, security controls, and responsible AI practices.
• Translate business requirements into production-ready technical solutions.
• Support mentoring, knowledge sharing, and AI engineering best practice across delivery teams.

Skills

LLMs

RAG

Python

APIs

Production AI

AI governance

Vector search

Stakeholder engagement

Tools

LangChain

Qdrant

Pinecone

Weaviate

FAISS

CI/CD

Job description

IBM Consulting is seeking an experienced AI Engineer to design, build, and deploy enterprise AI solutions at scale across client environments. You will work with Architects, Data Scientists, Engineers, and stakeholders to translate emerging AI capabilities into practical, secure production-ready systems.

This role focuses on LLMs, RAG, agent-based AI, and modern integration patterns, with emphasis on governance, security, and responsible AI practices while delivering measurable business outcomes.