Senior AI Architect for Enterprise Integrations

IBM Computing; Jersey City (NJ); Remote; USD 160,000 - 230,000; Full time

Job summary

IBM Consulting is seeking a Senior AI Architect - Enterprise Integrations to lead AI integration engagements for large enterprise clients across the US. You will shape architecture, mentor teams, and deliver production-grade AI-powered solutions.

You will design MCP servers, implement agent orchestration, and work with multiple LLM providers to optimize cost and performance. This is a remote role with nationwide reach.

Qualifications

• 8+ years in application or solution architecture with AI/ML focus.
• Hands-on MCP server design and implementation.
• Proven experience integrating AI agents with enterprise systems.
• Deep knowledge of agentic AI frameworks (LangChain, LangGraph, AutoGen, CrewAI).
• Strong API design and enterprise integration patterns.
• Experience with major LLM providers and their APIs (OpenAI, Azure, IBM, AWS, Google).

Responsibilities

• Serve as an internal champion for AI integration architecture strategy and reference assets.
• Mentor architects and consultants on AI integration patterns.
• Lead discovery and design sessions to define AI integration strategies.
• Translate business requirements into scalable, secure AI-powered solutions.
• Architect and implement integrations between AI agents and enterprise systems.
• Establish a semantic data layer to contextualize enterprise data.
• Define patterns for agent orchestration, memory management, and human-in-the-loop workflows.
• Design MCP gateway/servers exposing data, tools, and APIs.
• Ensure security, observability, and reliability; deliver production-grade solutions.
• Role can be performed from anywhere in the US.

Skills

AI/ML architecture

MCP (Model Context Protocol)

AI integration patterns

API design (REST/GraphQL)

Python/TypeScript

Tools

LangChain

LangGraph

AutoGen

CrewAI

Job description

IBM Consulting is seeking a Senior AI Architect - Enterprise Integrations to lead AI integration engagements for large enterprise clients across the US. You will shape architecture, mentor teams, and deliver production-grade AI-powered solutions.

You will design MCP servers, implement agent orchestration, and work with multiple LLM providers to optimize cost and performance. This is a remote role with nationwide reach.