Principal AI Engineer: Enterprise AI Strategy & Governance

CoverMyMeds LLC; Columbus (OH); On-site; USD 195,000 - 325,000; Full time

Job summary

McKesson is seeking a Principal AI Engineer to drive the multi-year architecture and governance of our AI platform across teams. You will shape model strategy, RAG, tools, and evaluation frameworks while guiding risk management and executive decisions.

You will mentor senior engineers, set cross-team standards, and collaborate with Legal/Compliance to ensure responsible AI adoption in healthcare, balancing innovation with regulatory requirements in a fast-paced environment.

Qualifications

• Bachelor's degree or equivalent; typically 12+ years software engineering experience, 6+ years AI/ML in production, 3+ years as a senior IC.
• Ability to influence senior stakeholders without direct authority.
• Experience with regulated healthcare data environments and AI governance frameworks.

Responsibilities

• Own multi-year AI platform strategy and roadmap.
• Set architecture, security, and evaluation standards.
• Advise executives on AI strategy and risk.
• Lead architecture and prototyping for high-risk AI initiatives.
• Mentor Lead/Senior AI Engineers.

Skills

Technical leadership

AI strategy

Python/Java

LLM/RAG knowledge

MLOps/LLMOps

OpenAI/Anthropic APIs

Cloud platforms (Azure)

Regulated healthcare data

Education

Bachelor's degree or equivalent

Master's or PhD preferred

Tools

Azure

OpenAI API

Anthropic API

Model Context Protocol

Job description

McKesson is seeking a Principal AI Engineer to drive the multi-year architecture and governance of our AI platform across teams. You will shape model strategy, RAG, tools, and evaluation frameworks while guiding risk management and executive decisions.

You will mentor senior engineers, set cross-team standards, and collaborate with Legal/Compliance to ensure responsible AI adoption in healthcare, balancing innovation with regulatory requirements in a fast-paced environment.