Forward Deployed Architect

IBM; New York (NY); Remote; USD 150,000 - 230,000; Full time

Job summary

IBM Consulting in the United States seeks a Senior AI Architect to lead enterprise AI initiatives, translating client challenges into scalable architectures and production-ready implementations. You will work with business stakeholders, data scientists, and engineers to deploy AI solutions that deliver measurable outcomes.

You will apply state-of-the-art models including OpenAI GPT, Anthropic Claude, Google Gemini, Meta Llama, Mistral, and IBM Granite, shaping governance, security, and

Qualifications

• 5+ years of experience leading AI solutions.
• Experience in regulated industries such as Financial Services, Insurance, Healthcare, or Public Sector.
• Hands-on with LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, MCP, vector databases, and cloud-native AI services.
• Prior customer-facing consulting, solution architecture, or forward-deployed engineering experience.

Responsibilities

• Architect, design, and deliver enterprise-scale AI solutions for clients.
• Demonstrate hands-on experience with leading LLMs and model optimization.
• Lead design of modern AI architectures: RAG, agents, knowledge graphs, vector databases, MLOps.
• Collaborate with stakeholders to prototype, deploy, and scale AI solutions delivering measurable outcomes.
• Provide technical leadership on emerging AI technologies, cloud platforms, APIs, data platforms, and integration patterns, with security and governance best practices.

Skills

AI solution leadership

Client-facing consulting

Enterprise AI delivery

Team leadership

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

Mistral

IBM Granite

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

• Architect, design, and deliver enterprise-scale AI and agentic solutions by working directly with clients to translate complex business challenges into scalable technical architectures and production-ready implementations.
• Demonstrate deep hands-on experience with leading Large Language Models (LLMs), including OpenAI GPT, Anthropic Claude, Google Gemini, Meta Llama, Mistral, and IBM Granite, with the ability to evaluate, fine-tune, orchestrate, and optimize models for client use cases.
• Lead the design and implementation of modern AI architectures, including Retrieval-Augmented Generation (RAG), AI agents, multi-agent systems, knowledge graphs, vector databases, model routing, and LLMOps/MLOps frameworks.
• Collaborate closely with business stakeholders, data scientists, engineers, and executive leadership to rapidly prototype, deploy, and scale AI solutions that deliver measurable business outcomes across operations, customer experience, risk, and compliance functions
• Provide technical leadership and thought leadership on emerging AI technologies, cloud platforms (AWS, Azure, GCP), APIs, data platforms, and integration patterns, while establishing best practices for security, governance, responsible AI, and enterprise adoption.

This job can be performed from anywhere in the U.S.

Required Technical And Professional Expertise

• +5 years of experience leading AI solutions
• Experience deploying AI solutions in highly regulated industries such as Financial Services, Insurance, Healthcare, or Public Sector.
• Experience with LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, MCP, vector databases, and cloud-native AI services.
• Prior customer-facing consulting, solution architecture, or forward-deployed engineering experience.

Preferred Technical And Professional Experience

• Cloud Security Expertise: Deep expertise in cloud security and compliance, with experience in designing and implementing secure cloud architectures that meet regulatory requirements.
• Multi-Cloud Experience: Experience working with multiple cloud providers, including private and public clouds, and providing orchestration, management, and application portability between them.
• Technical Leadership: Experience leading highly technical teams and collaborating with stakeholders to define and execute technical adoption and migration strategies.