Senior AI Architect - Enterprise Integrations

IBM; Connecticut; Remote; USD 140,000 - 190,000; Full time

Job summary

IBM Consulting is seeking a Senior AI Architect - Enterprise Integrations to lead AI integration strategy and delivery for enterprise systems. You will design, implement, and oversee AI-powered solutions, including MCP servers, API integration, and cost-optimized cloud deployments, working with clients across industries.

This is a remote US-based role with senior leadership responsibilities. You will mentor architects, shape practice offerings, and ensure alignment to enterprise standards while

Qualifications

• 8+ years in application/solution architecture with AI/ML focus.
• Hands-on MCP server design and building experience.
• Proven ability to integrate AI agents with enterprise systems.
• Strong API design and enterprise integration patterns.

Responsibilities

• Lead discovery and architecture sessions with clients to define AI integration strategies.
• Translate business requirements into scalable AI-powered solutions.
• Provide cloud and LLM cost estimates and optimize architecture.
• Lead cross-functional teams to deliver production-ready AI solutions.

Skills

AI/ML systems

MCP servers

AI agents integration

API design (REST, GraphQL)

Python/TypeScript

Consulting / client relations

Tools

LangChain

LangGraph

AutoGen

CrewAI

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your role and responsibilities

We are seeking a Senior AI Architect - Enterprise Integrations to join our growing AI practice. As demand for intelligent, connected enterprise solutions accelerates, we are building out a specialized capability in AI-native architecture and agentic system design. This is a senior, client-facing role where you will provide thought leadership, shape practice offerings, and lead delivery on high-impact AI integration engagements.

You will be the subject matter expert at the intersection of AI agents and enterprise systems - designing and building the connective tissue that makes AI solutions work in the real world.

What You’ll Do

Thought Leadership & Practice Development

• Serve as an internal champion for AI integration architecture strategy, helping to define and grow this capability within the firm * Develop points of view, reference architectures, and reusable assets that accelerate client delivery

• Mentor and upskill other architects and consultants on AI integration patterns and emerging standards

Client Engagement & Solution Architecture

• Lead discovery, design, and architecture sessions with clients to define AI integration strategies

• Translate complex business requirements into scalable, secure, and maintainable AI-powered solutions

• Provide cloud and LLM consumption cost estimates, optimizing for cost-effective architecture through fit-for-purpose model selection, efficient prompting & caching, and scalable infrastructure design

• Present architectural recommendations to executive and technical stakeholders with clarity and confidence

• Lead cross-functional development teams to deliver enterprise-grade, production-ready AI solutions, ensuring alignment to architecture standards, scalability, and operational excellence

Technical Delivery

• Architect and implement integrations between AI agents and enterprise systems including CRMs, ERPs, data platforms, and third-party APIs

• Establish a semantic data layer that standardizes and contextualizes enterprise data, enabling AI agents to reliably discover, interpret, and interact with systems & data

• Define patterns for agent orchestration, tool calling, memory management, and human-in-the-loop workflows

• Design and build Model Context Protocol (MCP) gateway & servers that expose enterprise data, tools, and APIs as structured context for AI agents

• Ensure solutions meet enterprise standards for security, observability, and reliability

• This role can be performed from anywhere in the US.

Required technical and professional expertise

• 8+ years of experience in application or solution architecture, with at least 2+ years focused on AI/ML systems

• Hands-on experience designing and building MCP (Model Context Protocol) servers

• Proven experience integrating AI agents with enterprise systems and workflows

• Deep understanding of agentic AI frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI, or similar)

• Strong knowledge of API design (REST, GraphQL), event-driven architecture, and enterprise integration patterns

• Experience working with LLM providers (OpenAI, Anthropic, Azure, IBM, AWS, Google, etc.) and their APIs * Proficiency in Python and/or TypeScript/JavaScript for building AI integration solutions

• Consulting or professional services experience - comfortable owning client relationships and leading engagements

Preferred technical and professional experience

• Familiarity with cloud platforms (Azure, AWS, or GCP) and cloud-native deployment patterns

• Experience with RAG (Retrieval-Augmented Generation) architectures and vector databases

• Background in enterprise middleware or iPaaS platforms (MuleSoft, Boomi, Azure Integration Services)

• Knowledge of AI security considerations including prompt injection, data governance, and access controls

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.