AI Program Manager

IBM; Paramus (NJ); Remote; USD 140,000 - 180,000; Full time

Job summary

IBM Consulting in the United States seeks a Highly experienced Complex Program Manager for Hybrid Cloud, Data & AI. You will lead large-scale transformations that modernize data platforms and deploy GenAI across enterprise environments.

You will coordinate multi-disciplinary teams, manage budgets, and drive ROI while ensuring security, privacy, and regulatory compliance. This role is remote and requires strong executive communication and governance capabilities.

Qualifications

• Extensive program/project management experience in enterprise settings.
• Experience leading AI/ML and GenAI solutions from pilot to production.
• Strong understanding of data architecture and governance.
• Knowledge of responsible AI, privacy, security and compliance.
• Ability to manage distributed, cross-functional teams and executives.

Responsibilities

• Lead large-scale, multi-workstream programs across hybrid cloud, data and AI.
• Drive AI initiatives from ideation to production and enterprise adoption.
• Coordinate teams across cloud infrastructure, data engineering, and security.
• Define business cases, KPIs, and value-tracking frameworks.
• Establish governance and ensure regulatory compliance.
• Manage executive stakeholders, partners, and remote teams.
• Oversee financial performance, contracts, and resource planning.
• Drive change management and business adoption across the organization.

Skills

Program management

Executive communication

Stakeholder management

AI/ML leadership

GenAI & LLM concepts

MLOps/LLMOps

Data architecture

Agile & traditional delivery

Financial management

Risk management

Cloud & data platforms

Education

Master's Degree

Bachelor's degree in a related field

Tools

Jira

Databricks

Snowflake

Google Vertex AI

Azure AI Foundry

Amazon Bedrock

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

As a Complex Program Manager for Hybrid Cloud, Data & AI, you will lead large-scale technology & business transformation programs that modernize enterprise data platforms and bring AI, GenAI, and agentic AI solutions into production. You'll connect business strategy with technical delivery, ensuring solutions are secure, scalable, cost-effective, and deliver measurable business value.

Key Responsibilities

• Lead complex, multi-workstream programs across hybrid cloud, data, and AI, managing scope, budget, timelines, risks, and quality.
• Drive AI initiatives from ideation and proof of value through production and enterprise-wide adoption.
• Coordinate teams across cloud infrastructure, data engineering, AI/ML, MLOps/LLMOps, security, and governance.
• Define business cases, KPIs, and value-tracking frameworks to measure outcomes and ROI.
• Establish program governance and ensure responsible AI, data privacy, security, and regulatory compliance.
• Manage executive stakeholders, technology partners, and distributed teams to align priorities and accelerate delivery.
• Oversee financial performance, cloud and AI costs, contracts, and resource planning.
• Drive change management and business adoption to ensure lasting impact.

This job can be performed from anywhere in the US.

Preferred Education

Master's Degree

Required Technical And Professional Expertise

• 12+ years of program/project management experience, including 5+ years leading complex, multi-workstream technology transformation programs in enterprise setting.
• Experience leading AI/ML and GenAI solutions from pilot to production, with knowledge of MLOps/LLMOps, LLMs, RAG, and agentic AI.
• Understanding of modern data architecture, including data lakes/lakehouses, data pipelines, data governance, and data quality.
• Understanding of GenAI and agentic AI concepts, including LLMs, retrieval-augmented generation (RAG), prompt engineering, AI agents and orchestration, and evaluation of model performance and accuracy.
• Strong program governance, financial management, and risk management skills, including budgeting, forecasting, FinOps, and executive reporting.
• Knowledge of responsible AI, data privacy, security, and regulatory compliance.
• Proven ability to lead distributed, cross-functional teams, manage senior stakeholders, and connect technology delivery to measurable business outcomes.
• Proficiency in Agile and traditional delivery methods, with tools such as Jira, and a bachelor's degree in a related field.
• Exceptional executive communication and stakeholder management skills, with the ability to translate technical complexity into clear business narratives for C-suite audiences.

Preferred Technical And Professional Experience

• PMP, PgMP, SAFe, or equivalent program management certification.
• Cloud or AI certifications from AWS, Microsoft Azure, or Google Cloud.
• Proven experience delivering hybrid/multi-cloud and data platform modernization across AWS, Azure, or Google Cloud.
• Experience with enterprise AI and data platforms such as Databricks, Snowflake, Google Vertex AI, Azure AI Foundry, or Amazon Bedrock.
• Experience managing hyperscaler/technology partners, driving enterprise AI adoption, or delivering programs in regulated industries.
• Master's degree or MBA.