AI Architect - Generative & Agentic AI

International Business Machines Corporation

United States

On-site

USD 140,000 - 200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IBM Consulting is seeking an AI Architect to lead architecture and governance for enterprise AI initiatives across Google Gemini, IBM Enterprise Advantage, SAP AI, Salesforce Einstein, and Databricks. You will drive scalable, governed AI solutions with cross-platform orchestration and hands-on leadership in a client-centric environment.

Responsibilities include defining agentic AI patterns, designing long-running workflows, and ensuring security and compliance within regulated industries.

Qualifications

  • Strong hands-on experience with Google Cloud Platform AI services including Vertex AI, Gemini API, Agent Builder, AI Studio, and related GCP AI capabilities.
  • Experience designing and implementing agentic AI systems including multi-agent coordination, tool-calling patterns, planning workflows, memory/state management, and autonomous orchestration.
  • Experience integrating enterprise AI ecosystems across SAP AI (BTP/Joule), Salesforce Einstein and Databricks.
  • Deep understanding of enterprise AI architecture patterns, cloud-native design, APIs, event-driven systems, and scalable distributed architectures.
  • Experience implementing AI governance controls including content safety, prompt filtering, model guardrails, governance policies, secure access patterns, and auditability.
  • Strong Python development experience and familiarity with enterprise integration frameworks and AI orchestration tooling.
  • Experience working within regulated environments such as utilities, energy, financial services, or healthcare preferred.
  • Strong stakeholder communication and technical leadership skills with experience guiding distributed engineering teams.

Responsibilities

  • Lead architecture and technical direction of enterprise AI initiatives for client projects across multiple platforms.
  • Define orchestration patterns across SAP AI, Salesforce Einstein, Databricks, and enterprise systems.
  • Oversee long-running AI workflows including task coordination, state management, and tooling orchestration.
  • Build enterprise AI integration patterns leveraging APIs, event-driven architecture, microservices, and cloud-native services on GCP.
  • Develop retrieval-augmented generation and enterprise knowledge solutions.
  • Implement AI governance, guardrails, safety filters, access controls, and auditability.

Skills

Vertex AI
Agent Builder
Multi-agent orchestration
Python
Databricks
Salesforce Einstein
APIs
MLOps
Governance

Education

Bachelor's Degree
Master's Degree

Tools

SAP AI (BTP/Joule)
Databricks Platform
Kubernetes

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

The AI Architect will lead the architecture and technical direction of enterprise agentic AI initiatives for our client, driving scalable and governed AI solutions across Google Gemini, IBM Enterprise Advantage, SAP AI, Salesforce Einstein, and Databricks platforms. This role combines hands-on architecture leadership with enterprise AI governance and cross-platform orchestration expertise in a highly strategic client environment.

Your primary responsibilities will include:

  • Design and architect enterprise agentic AI solutions using Google Gemini, Vertex AI, Agent Builder, and IBM Enterprise Advantage platform services.
  • Define multi-agent and agent-to-agent orchestration patterns across SAP AI (BTP/Joule), Salesforce Einstein, Databricks, and enterprise systems.
  • Lead architecture and implementation of long-running AI workflows including task coordination, state management, memory handling, tool use orchestration, and workflow resiliency.
  • Build enterprise AI integration patterns leveraging APIs, event-driven architecture, microservices, and cloud-native services on GCP.
  • Develop Retrieval-Augmented Generation (RAG) and enterprise knowledge solutions using Databricks data products and enterprise data platforms.
  • Implement AI governance, guardrails, safety filters, access controls, auditability, and compliance mechanisms aligned to regulated utility industry requirements.
  • Define AI solution standards, reusable architecture patterns, observability controls, and operational governance for production AI systems.
  • Collaborate with client stakeholders, business teams, AI engineers, platform teams, and enterprise architects to align AI architectures with business objectives.
  • Provide technical leadership and architecture governance for the Romania-based AI engineering team, including design reviews, implementation guidance, and engineering standards.
  • Support AI solution estimation, roadmap definition, technical risk management, and production readiness reviews.
Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise
  • Strong hands-on experience with Google Cloud Platform AI services including Vertex AI, Gemini API, Agent Builder, AI Studio, and related GCP AI capabilities.
  • Experience designing and implementing agentic AI systems including multi-agent coordination, tool-calling patterns, planning workflows, memory/state management, and autonomous orchestration.
  • Experience integrating enterprise AI ecosystems across SAP AI (BTP/Joule), Salesforce Einstein and Databricks.
  • Deep understanding of enterprise AI architecture patterns, cloud-native design, APIs, event-driven systems, and scalable distributed architectures.
  • Experience implementing AI governance controls including content safety, prompt filtering, model guardrails, governance policies, secure access patterns, and auditability.
  • Strong Python development experience and familiarity with enterprise integration frameworks and AI orchestration tooling.
  • Experience working within regulated environments such as utilities, energy, financial services, or healthcare preferred.
  • Strong stakeholder communication and technical leadership skills with experience guiding distributed engineering teams.
Preferred technical and professional experience
  • Google Cloud Professional certifications and AI/ML certifications preferred.
  • Experience with enterprise AI platform modernization and production AI operations.
  • Familiarity with MLOps / LLMOps practices including monitoring, evaluation, observability, and lifecycle management.
ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Forward Deployed Architect
Forward Deployed Architect

HITEC • Charlotte (NC)

Hybrid
USD 150,000 - 190,000
Healthcare benefits
401(k) and pension plan
Paid time off
AI Engineer with French
AI Engineer with French

International Business Machines Corporation • United States

Remote
USD 140,000 - 210,000
Enterprise AI Architect — LLM & Hybrid Cloud Lead
Enterprise AI Architect — LLM & Hybrid Cloud Lead

HITEC • Charlotte (NC)

Hybrid
USD 150,000 - 190,000
Healthcare benefits
401(k) and pension plan
Paid time off
Senior Forward Deployed Engineer – AI
Senior Forward Deployed Engineer – AI

HITEC • Paramus (NJ)

Remote
USD 180,000 - 240,000
Healthcare benefits
401(k)
Paid time off
Senior GenAI Architekt (m/w/d) für den Defense-Sektor
Senior GenAI Architekt (m/w/d) für den Defense-Sektor

International Business Machines Corporation • United States

Hybrid
USD 180,000 - 240,000
Contact Center Forward Deployed Engineer - AI
Contact Center Forward Deployed Engineer - AI

International Business Machines Corporation • United States

Remote
USD 150,000 - 210,000
Healthcare benefits
401(k) and retirement plans
Generous paid time off
+2
Senior Forward Deployed Engineer - AI
Senior Forward Deployed Engineer - AI

International Business Machines Corporation • United States

Remote
USD 150,000 - 210,000
Forward Deploy Engineer
Forward Deploy Engineer

International Business Machines Corporation • United States

Remote
USD 140,000 - 210,000
Healthcare benefits
401(k) & financial planning
Paid time off
Managing Consultant, Data Architect
Managing Consultant, Data Architect

HITEC • Burlingame (CA)

Remote
USD 150,000 - 210,000
Sr. Consultant, Data Architect
Sr. Consultant, Data Architect

HITEC • United States

Remote
USD 140,000 - 190,000
Healthcare benefits
401(k) retirement plan
Paid time off