Senior AI Platform Architect — Enterprise-Scale

McKesson; Columbus (OH); On-site; USD 195,000 - 325,000; Full time

Job summary

McKesson is seeking a Principal AI Engineer to lead the multi-year AI platform strategy, spanning model strategy, RAG architectures, and governance. You will act as the primary technical voice to executive leadership on AI risk and investment decisions.

You will personally drive architecture and prototyping for the highest-ambiguity AI initiatives while mentoring other engineers and shaping enterprise-wide AI governance with Legal and Compliance partners.

Qualifications

• Bachelor's degree or equivalent experience; 12+ years software engineering, 6+ years AI/ML in production.
• Senior IC technical leadership experience across multiple teams and platforms.
• Deep hands-on expertise building production LLM applications at scale using prompt engineering, RAG, and tool use.

Responsibilities

• Define and own multi-year technical strategy and roadmap for the AI platform across teams.
• Act as final technical escalation point for architecture and reliability across systems.
• Set architecture, security, and evaluation standards adopted by multiple teams.
• Advise VP/exec leadership on AI platform strategy, model risk, and investments.
• Lead architecture and prototyping for high-ambiguity AI initiatives.
• Mentor Lead/Senior AI Engineers through coaching and knowledge-sharing.
• Shape enterprise-wide AI governance with Legal/Compliance/Privacy.
• Own evaluation strategy for foundation models and AI infrastructure vendors.
• Represent the company’s AI engineering externally to forums and partners.
• Influence AI platform direction across the enterprise.

Skills

AI leadership

Technical strategy

Production LLMs

LLM APIs

Python/Java

MLOps

Stakeholder influence

Trusted governance

Education

Bachelor's degree or equivalent

Master's or PhD preferred

Tools

Azure

AWS

GCP

Model Context Protocol

Vector retrieval

Job description

McKesson is seeking a Principal AI Engineer to lead the multi-year AI platform strategy, spanning model strategy, RAG architectures, and governance. You will act as the primary technical voice to executive leadership on AI risk and investment decisions.

You will personally drive architecture and prototyping for the highest-ambiguity AI initiatives while mentoring other engineers and shaping enterprise-wide AI governance with Legal and Compliance partners.