Senior AI Engineer — Hybrid Cloud & Public Sector

IBM; Boston (MA); Hybrid; USD 106,000 - 159,000; Full time

Job summary

IBM Consulting FutureNow Center is seeking an experienced Senior AI Engineer to design, build, and deploy enterprise AI solutions across client environments, leveraging LLMs and RAG. You will collaborate with Architects, Data Scientists, Engineers, and stakeholders to create secure, production‑ready AI systems and to mitigate hallucinations while improving retrieval quality.

This hybrid role offers mentorship, continuous learning, and opportunities to drive governance and responsible AI

Qualifications

• Hands-on experience with LLMs and LLM APIs.
• Production RAG solutions and/or agent-based AI systems.
• Strong API development and systems integration experience.
• Experience deploying AI-enabled applications in production.
• Knowledge of AI evaluation, hallucination mitigation, and responsible AI.

Responsibilities

• Design, build, and deploy AI-powered applications using LLMs and modern frameworks.
• Deliver enterprise AI solutions including RAG, agentic workflows, and semantic search.
• Integrate AI capabilities into existing platforms via APIs and integration patterns.
• Collaborate with Architects, Data Scientists, Engineers, and stakeholders.
• Evaluate and optimize AI system performance and user experience.
• Mitigate hallucinations and improve retrieval quality.
• Contribute to AI governance, security controls, and responsible AI practices.
• Translate business requirements into production-ready technical solutions.
• Mentor and share AI engineering best practices across teams.

Skills

LLMs

RAG

Agent-based AI

API development

AI governance

Embeddings

Vector search

Stakeholder engagement

Production deployment

Tools

LangChain

LangGraph

DSPy

Semantic Kernel

LlamaIndex

Qdrant

Pinecone

Weaviate

FAISS

CI/CD

Containerisation

Job description

IBM Consulting FutureNow Center is seeking an experienced Senior AI Engineer to design, build, and deploy enterprise AI solutions across client environments, leveraging LLMs and RAG. You will collaborate with Architects, Data Scientists, Engineers, and stakeholders to create secure, production‑ready AI systems and to mitigate hallucinations while improving retrieval quality.

This hybrid role offers mentorship, continuous learning, and opportunities to drive governance and responsible AI