AI Program Manager

International Business Machines Corporation; Raleigh (NC); Remote; USD 140,000 - 190,000; Full time

Job summary

IBM Consulting seeks a Complex Program Manager for Hybrid Cloud, Data & AI to lead large-scale technology and business transformation programs. You will connect business strategy with technical delivery, ensuring secure, scalable, cost-effective solutions that deliver measurable value.

You will manage cross-functional teams across cloud, data, AI/ML, MLOps/LLMOps, security, and governance while coordinating executives and partners to accelerate enterprise-wide adoption and ROI.

Qualifications

• 12+ years of program or project management experience.
• 5+ years leading complex transformation programs in an enterprise setting.
• Experience leading AI/ML and GenAI solutions from pilot to production (MLOps/LLMOps).
• Knowledge of data architecture, data lakes/lakehouses, data governance and data quality.
• Understanding of GenAI concepts including LLMs, RAG, prompt engineering, AI agents.
• Strong program governance, budgeting, forecasting, FinOps, and executive reporting.
• Proficiency in Agile and traditional delivery methods (Jira).
• Exceptional executive communication and stakeholder management.

Responsibilities

• Lead complex, multi-workstream programs across hybrid cloud, data, and AI.
• Drive AI initiatives from ideation to production and enterprise adoption.
• Coordinate teams across cloud infrastructure, data engineering, AI/ML, MLOps/LLMOps, security, and governance.
• Define business cases, KPIs, and value-tracking frameworks to measure ROI.
• Establish program governance and ensure responsible AI, data privacy, security, and regulatory compliance.
• Manage executive stakeholders, technology partners, and distributed teams to align priorities.
• Oversee financial performance, cloud and AI costs, contracts, and resource planning.
• Drive change management and business adoption to ensure lasting impact.

Skills

Program management

Stakeholder management

Executive communication

Agile delivery

Jira

Budgeting

MLOps

GenAI

Data governance

Security compliance

Education

Master's Degree

Bachelor's Degree

MBA

Tools

Jira

Databricks

Snowflake

Vertex AI

Azure AI Foundry

Bedrock

AWS

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

As a Complex Program Manager for Hybrid Cloud, Data & AI, you will lead large-scale technology & business transformation programs that modernize enterprise data platforms and bring AI, GenAI, and agentic AI solutions into production. You’ll connect business strategy with technical delivery, ensuring solutions are secure, scalable, cost-effective, and deliver measurable business value.

Key Responsibilities

• Lead complex, multi-workstream programs across hybrid cloud, data, and AI, managing scope, budget, timelines, risks, and quality.
• Drive AI initiatives from ideation and proof of value through production and enterprise-wide adoption.
• Coordinate teams across cloud infrastructure, data engineering, AI/ML, MLOps/LLMOps, security, and governance.
• Define business cases, KPIs, and value-tracking frameworks to measure outcomes and ROI.
• Establish program governance and ensure responsible AI, data privacy, security, and regulatory compliance.
• Manage executive stakeholders, technology partners, and distributed teams to align priorities and accelerate delivery.
• Oversee financial performance, cloud and AI costs, contracts, and resource planning.
• Drive change management and business adoption to ensure lasting impact.

This job can be performed from anywhere in the US.

Preferred Education

Master's Degree

Required Technical And Professional Expertise

• 12+ years of program/project management experience, including 5+ years leading complex, multi-workstream technology transformation programs in enterprise setting.
• Experience leading AI/ML and GenAI solutions from pilot to production, with knowledge of MLOps/LLMOps, LLMs, RAG, and agentic AI.
• Understanding of modern data architecture, including data lakes/lakehouses, data pipelines, data governance, and data quality.
• Understanding of GenAI and agentic AI concepts, including LLMs, retrieval-augmented generation (RAG), prompt engineering, AI agents and orchestration, and evaluation of model performance and accuracy.
• Strong program governance, financial management, and risk management skills, including budgeting, forecasting, FinOps, and executive reporting.
• Knowledge of responsible AI, data privacy, security, and regulatory compliance.
• Proven ability to lead distributed, cross-functional teams, manage senior stakeholders, and connect technology delivery to measurable business outcomes.
• Proficiency in Agile and traditional delivery methods, with tools such as Jira, and a bachelor’s degree in a related field.
• Exceptional executive communication and stakeholder management skills, with the ability to translate technical complexity into clear business narratives for C-suite audiences.

Preferred Technical And Professional Experience

• PMP, PgMP, SAFe, or equivalent program management certification.
• Cloud or AI certifications from AWS, Microsoft Azure, or Google Cloud.
• Proven experience delivering hybrid/multi-cloud and data platform modernization across AWS, Azure, or Google Cloud.
• Experience with enterprise AI and data platforms such as Databricks, Snowflake, Google Vertex AI, Azure AI Foundry, or Amazon Bedrock.
• Experience managing hyperscaler/technology partners, driving enterprise AI adoption, or delivering programs in regulated industries.
• Master’s degree or MBA.