AI Architect – Generative & Agentic AI

International Business Machines Corporation

Boston (MA)

Hybrid

USD 170,000 - 210,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

IBM Consulting is seeking an AI Architect to lead enterprise agentic AI initiatives across Google Gemini, Vertex AI, SAP, Salesforce, and Databricks. You will drive scalable, governed AI solutions while coordinating across client teams and engineering colleagues in a hybrid delivery model.

The role combines hands-on architecture leadership with governance, tooling orchestration, and cross-platform integration, requiring senior technical depth and strong collaboration across enterprise teams.

Qualifications

  • Strong hands-on experience with Google Cloud Platform AI services including Vertex AI, Gemini API, Agent Builder, AI Studio, and related GCP AI capabilities.
  • Experience designing and implementing agentic AI systems including multi-agent coordination, tool-calling patterns, planning workflows, memory/state management, and autonomous orchestration.
  • Experience integrating enterprise AI ecosystems across SAP AI (BTP/Joule), Salesforce Einstein and Databricks.

Responsibilities

  • Design and architect enterprise agentic AI solutions using Google Gemini, Vertex AI, Agent Builder, and IBM Enterprise Advantage platform services.
  • Define multi-agent and agent-to-agent orchestration patterns across SAP AI (BTP/Joule), Salesforce Einstein, Databricks, and enterprise systems.
  • Lead architecture and implementation of long-running AI workflows including task coordination, state management, memory handling, tool use orchestration, and workflow resiliency.
  • Build enterprise AI integration patterns leveraging APIs, event-driven architecture, microservices, and cloud-native services on GCP.
  • Develop Retrieval-Augmented Generation (RAG) and enterprise knowledge solutions using Databricks data products and enterprise data platforms.
  • Implement AI governance, guardrails, safety filters, access controls, auditability, and compliance mechanisms aligned to regulated utility industry requirements.
  • Define AI solution standards, reusable architecture patterns, observability controls, and operational governance for production AI systems.
  • Collaborate with client stakeholders, business teams, AI engineers, platform teams, and enterprise architects to align AI architectures with business objectives.
  • Provide technical leadership and architecture governance for the Romania-based AI engineering team, including design reviews, implementation guidance, and engineering standards.
  • Support AI solution estimation, roadmap definition, technical risk management, and production readiness reviews.

Skills

Python development
Google Cloud Platform AI
Agent orchestration
Multi-agent coordination
AI governance
Cross-team leadership

Education

Bachelor's Degree
Master's Degree

Tools

Google Gemini
Vertex AI
Agent Builder
AI Studio
IBM Enterprise Advantage
Databricks
SAP AI (BTP/Joule)
Salesforce Einstein

Job description

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

The AI Architect will lead the architecture and technical direction of enterprise agentic AI initiatives for our client, driving scalable and governed AI solutions across Google Gemini, IBM Enterprise Advantage, SAP AI, Salesforce Einstein, and Databricks platforms. This role combines hands‑on architecture leadership with enterprise AI governance and cross‑platform orchestration expertise in a highly strategic client environment.

Your primary responsibilities will include:

  • Design and architect enterprise agentic AI solutions using Google Gemini, Vertex AI, Agent Builder, and IBM Enterprise Advantage platform services.
  • Define multi‑agent and agent‑to‑agent orchestration patterns across SAP AI (BTP/Joule), Salesforce Einstein, Databricks, and enterprise systems.
  • Lead architecture and implementation of long‑running AI workflows including task coordination, state management, memory handling, tool use orchestration, and workflow resiliency.
  • Build enterprise AI integration patterns leveraging APIs, event‑driven architecture, microservices, and cloud‑native services on GCP.
  • Develop Retrieval‑Augmented Generation (RAG) and enterprise knowledge solutions using Databricks data products and enterprise data platforms.
  • Implement AI governance, guardrails, safety filters, access controls, auditability, and compliance mechanisms aligned to regulated utility industry requirements.
  • Define AI solution standards, reusable architecture patterns, observability controls, and operational governance for production AI systems.
  • Collaborate with client stakeholders, business teams, AI engineers, platform teams, and enterprise architects to align AI architectures with business objectives.
  • Provide technical leadership and architecture governance for the Romania‑based AI engineering team, including design reviews, implementation guidance, and engineering standards.
  • Support AI solution estimation, roadmap definition, technical risk management, and production readiness reviews.
Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise
  • Strong hands‑on experience with Google Cloud Platform AI services including Vertex AI, Gemini API, Agent Builder, AI Studio, and related GCP AI capabilities.
  • Experience designing and implementing agentic AI systems including multi‑agent coordination, tool‑calling patterns, planning workflows, memory/state management, and autonomous orchestration.
  • Experience integrating enterprise AI ecosystems across SAP AI (BTP/Joule), Salesforce Einstein and Databricks.
  • Deep understanding of enterprise AI architecture patterns, cloud‑native design, APIs, event‑driven systems, and scalable distributed architectures.
  • Experience implementing AI governance controls including content safety, prompt filtering, model guardrails, governance policies, secure access patterns, and auditability.
  • Strong Python development experience and familiarity with enterprise integration frameworks and AI orchestration tooling.
  • Experience working within regulated environments such as utilities, energy, financial services, or healthcare preferred.
  • Strong stakeholder communication and technical leadership skills with experience guiding distributed engineering teams.
Preferred technical and professional experience
  • Google Cloud Professional certifications and AI/ML certifications preferred.
  • Experience with enterprise AI platform modernization and production AI operations.
  • Familiarity with MLOps / LLMOps practices including monitoring, evaluation, observability, and lifecycle management.
ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on‑going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can‑do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal‑opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

Job Title

AI Architect – Generative & Agentic AI

Job ID

137160

City / Township / Village

State / Province

Country

Work arrangement

Hybrid

Area of work

Software Engineering

Employment type

Regular

Position type

Professional

Some travel may be required based on business demand

Company

Shift

General (daytime)

Is this role a commissionable/sales incentive based position?

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Enterprise AI Architect — LLM & Hybrid Cloud Lead
Enterprise AI Architect — LLM & Hybrid Cloud Lead

HITEC • Charlotte (NC)

Hybrid
USD 150,000 - 190,000
Healthcare benefits
401(k) and pension plan
Paid time off
Forward Deployed Architect
Forward Deployed Architect

HITEC • Charlotte (NC)

Hybrid
USD 150,000 - 190,000
Healthcare benefits
401(k) and pension plan
Paid time off
Sr. Consultant, Data Architect
Sr. Consultant, Data Architect

International Business Machines Corporation • United States

Hybrid
USD 117,000 - 219,000
Healthcare benefits
401(k) plan
Employee stock purchase plan
Managing Consultant, Data Architect
Managing Consultant, Data Architect

HITEC • Burlingame (CA)

Remote
USD 150,000 - 210,000
Senior Consultant, AI & Automation (Energy, Mining & Utilities)
Senior Consultant, AI & Automation (Energy, Mining & Utilities)

International Business Machines Corporation • Boston (MA)

Hybrid
USD 71,000 - 91,000
AI Engineer with French
AI Engineer with French

IBM • United States

Remote
USD 140,000 - 210,000
Hybrid Solution Architect | Public Sector Consulting
Hybrid Solution Architect | Public Sector Consulting

International Business Machines Corporation • Boston (MA)

Hybrid
USD 93,000 - 160,000
25 days holiday
Private medical cover
Dental & optical cover
+3
Application Architect-Hybrid Cloud Manage
Application Architect-Hybrid Cloud Manage

HITEC • San Jose (CA)

Hybrid
USD 120,000 - 180,000
AI-First Transformation – Strategy Consultant Intern
AI-First Transformation – Strategy Consultant Intern

International Business Machines Corporation • New York (NY)

Hybrid
USD 92,000 - 151,000
Sr. Consultant, Data Architect
Sr. Consultant, Data Architect

HITEC • United States

Remote
USD 140,000 - 190,000
Healthcare benefits
401(k) retirement plan
Paid time off