Senior AI Platform Architect

McKesson Corporation; Atlanta (GA); On-site; USD 195,000 - 325,000; Full time

Job summary

McKesson Corporation is seeking a Principal AI Engineer to drive the multi-year strategy for our AI platform, spanning model strategy, RAG, tool ecosystems, and governance. You will lead architecture, risk assessment, and executive alignment across multiple teams in a regulated healthcare setting.

The role requires deep hands-on experience with production-scale LLMs, strong software fundamentals, and the ability to influence senior stakeholders without direct authority.

Qualifications

• Bachelor's degree or equivalent experience; typically 12+ years software engineering with 6+ years AI/ML/NLP in production.
• One level of technical leadership above a Lead AI Engineer and setting direction across multiple teams.
• Deep, hands-on expertise building production LLM applications at scale: prompts, RAG, agentic workflows and evaluation harnesses.

Responsibilities

• Own the multi-year technical strategy and roadmap for the AI platform across all teams.
• Serve as the final technical escalation point for architecture and reliability problems on the AI platform.
• Set architecture, security, and evaluation standards across teams and evolve them with the threat landscape.
• Advise VP-level leadership on AI platform strategy, model risk, and investment trade-offs.
• Lead architecture/prototyping for high-ambiguity AI initiatives and mentor engineers at scale.
• Shape enterprise-wide AI governance policies in partnership with Legal/Compliance/Privacy.

Skills

Python

Java

REST APIs

Microservices

Azure

AWS/GCP

LLMOps

MLOps

Embeddings

RAG

Prompt engineering

Education

Bachelor's degree or equivalent experience

MS or PhD in CS/AI or related field

Tools

Model Context Protocol (MCP)

Vector databases

Knowledge-base architectures

Job description

McKesson Corporation is seeking a Principal AI Engineer to drive the multi-year strategy for our AI platform, spanning model strategy, RAG, tool ecosystems, and governance. You will lead architecture, risk assessment, and executive alignment across multiple teams in a regulated healthcare setting.

The role requires deep hands-on experience with production-scale LLMs, strong software fundamentals, and the ability to influence senior stakeholders without direct authority.