Lead AI Platform Architect — LLM, RAG & Governance

McKesson Corporation; United States; On-site; USD 155,000 - 259,000; Full time

Benefits offered by this job

Competitive compensation

Annual bonus potential

Long-term incentive opportunities

Job summary

McKesson is seeking a Lead AI Engineer to own the architecture of our AI platform and embedded delivery initiatives. You will design agentic and LLM-powered systems, including RAG pipelines and tool integrations, within a regulated healthcare environment.

You will mentor Senior and Associate AI Engineers, enforce architectural standards, and drive secure, observable, and cost-attributed AI operations while collaborating with Legal and Compliance to meet enterprise governance requirements.

Qualifications

• 8+ years of software engineering with 3+ years in AI/ML, LLM, or NLP in production.
• Demonstrated architecture ownership beyond a single feature.
• Experience with commercial LLM APIs (e.g., OpenAI, Anthropic).
• Strong fundamentals in Python/Java, REST, and cloud-native design.

Responsibilities

• Define technical architecture and roadmap for LLM/agentic systems.
• Lead architecture reviews ensuring security, privacy, and data provenance.

Skills

Technical leadership

LLM development

Python/Java

REST/microservices

Azure/AWS

RAG/Knowledge retrieval

PHI governance

Education

Bachelor's degree or equivalent

Master's/PhD preferred

Tools

Azure

AWS

Confluence/Jira

Job description

McKesson is seeking a Lead AI Engineer to own the architecture of our AI platform and embedded delivery initiatives. You will design agentic and LLM-powered systems, including RAG pipelines and tool integrations, within a regulated healthcare environment.

You will mentor Senior and Associate AI Engineers, enforce architectural standards, and drive secure, observable, and cost-attributed AI operations while collaborating with Legal and Compliance to meet enterprise governance requirements.