Enterprise AI Architect - LLMs, RAG & Cloud

IBM; New York (NY); Remote; USD 150,000 - 230,000; Full time

Job summary

IBM Consulting in the United States seeks a Senior AI Architect to lead enterprise AI initiatives, translating client challenges into scalable architectures and production-ready implementations. You will work with business stakeholders, data scientists, and engineers to deploy AI solutions that deliver measurable outcomes.

You will apply state-of-the-art models including OpenAI GPT, Anthropic Claude, Google Gemini, Meta Llama, Mistral, and IBM Granite, shaping governance, security, and

Qualifications

• 5+ years of experience leading AI solutions.
• Experience in regulated industries such as Financial Services, Insurance, Healthcare, or Public Sector.
• Hands-on with LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, MCP, vector databases, and cloud-native AI services.
• Prior customer-facing consulting, solution architecture, or forward-deployed engineering experience.

Responsibilities

• Architect, design, and deliver enterprise-scale AI solutions for clients.
• Demonstrate hands-on experience with leading LLMs and model optimization.
• Lead design of modern AI architectures: RAG, agents, knowledge graphs, vector databases, MLOps.
• Collaborate with stakeholders to prototype, deploy, and scale AI solutions delivering measurable outcomes.
• Provide technical leadership on emerging AI technologies, cloud platforms, APIs, data platforms, and integration patterns, with security and governance best practices.

Skills

AI solution leadership

Client-facing consulting

Enterprise AI delivery

Team leadership

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

Mistral

IBM Granite

Job description

IBM Consulting in the United States seeks a Senior AI Architect to lead enterprise AI initiatives, translating client challenges into scalable architectures and production-ready implementations. You will work with business stakeholders, data scientists, and engineers to deploy AI solutions that deliver measurable outcomes.

You will apply state-of-the-art models including OpenAI GPT, Anthropic Claude, Google Gemini, Meta Llama, Mistral, and IBM Granite, shaping governance, security, and