AI Platform Architect & Engineering Lead

Mckesson Corporation; Columbus (OH); On-site; USD 155,000 - 259,000; Full time

Job summary

McKesson is seeking a Lead AI Engineer to provide technical leadership and ownership of the AI platform and embedded delivery initiatives. You will design agentic and LLM-powered systems, including RAG pipelines, tool integrations, and governance tooling, within a highly regulated healthcare setting.

You will mentor Senior/Associate AI Engineers, set architectural standards, and collaborate with Legal/Compliance to ensure enterprise governance.

Qualifications

• Bachelor's degree or equivalent experience; typically 8+ years of software engineering experience, including 3+ years focused on AI/ML, LLM, or NLP systems in production.

Responsibilities

• Define the technical architecture and roadmap for LLM/agentic systems across cloud AI platforms.
• Lead architecture reviews for new AI capabilities ensuring security, privacy, and data provenance.
• Drive the design of shared AI platform capabilities including retrieval systems and data access controls.
• Architect and build high-complexity components for priority AI delivery initiatives.
• Mentor Senior and Associate AI Engineers; conduct design reviews and pair programming.
• Establish secure, observable, and cost-attributed AI operations for production LLM systems.
• Partner with product, legal/compliance, and engineering managers to align architecture with timelines.
• Evaluate foundation model providers and tooling; advise build-vs-buy and model selection.
• Ensure PHI handling and governance in regulated environments.
• Represent AI architecture in cross-company forums and influence platform direction.

Skills

AI architecture leadership

LLM applications

Prompt engineering

RAG pipelines

Tool integration

Cloud platforms

Python/Java

LLMOps

PHI handling

Mentorship

Education

Bachelor's degree or equivalent

MS or higher in CS/AI

Tools

Azure

Confluence/Jira

OpenAI/Anthropic APIs

Job description

McKesson is seeking a Lead AI Engineer to provide technical leadership and ownership of the AI platform and embedded delivery initiatives. You will design agentic and LLM-powered systems, including RAG pipelines, tool integrations, and governance tooling, within a highly regulated healthcare setting.

You will mentor Senior/Associate AI Engineers, set architectural standards, and collaborate with Legal/Compliance to ensure enterprise governance.