AI Platform Architect - LLM/Agentic Systems

CoverMyMeds LLC; Columbus (OH); On-site; USD 155,000 - 259,000; Full time

Job summary

McKesson is actively seeking a Lead AI Engineer to drive architecture ownership for the AI platform, embedding delivery initiatives and ensuring compliance in a highly regulated healthcare environment.

The role emphasizes hands-on delivery, mentoring, and cross-functional collaboration with Legal/Compliance, Product, and Engineering to align AI architecture with business goals in Columbus, OH.

Qualifications

• Bachelor's degree or equivalent; typically 8+ years of software engineering with 3+ years AI/ML in production.
• Hands-on production LLM experience: prompt engineering, RAG, agentic workflows, tool use, evaluation harnesses.
• Experience with commercial LLM APIs (Anthropic, OpenAI) and MCP protocols.
• Strong software fundamentals: Python and/or Java, REST APIs, microservices, and cloud-native design (Azure preferred).
• Experience with vector/graph retrieval systems and knowledge-base architectures at scale.
• MLOps: usage attribution, cost monitoring, abuse detection, model evaluation.
• Ability to set architectural standards and mentor engineers.

Responsibilities

• Define technical architecture for LLM/agentic systems — model routing, connectors, RAG pipelines, prompts/evaluation.
• Lead architecture reviews for new AI capabilities with security, privacy, and data provenance in mind.
• Own shared AI platform capabilities like knowledge retrieval and data access controls.
• Architect and build high-complexity components for priority AI delivery projects.
• Mentor engineers through design reviews and pairing on complex agentic workflows.
• Establish secure, observable AI operations with cost attribution and monitoring.
• Collaborate with managers, product, platform, and Legal/Compliance to align architecture with timelines.
• Evaluate foundation model providers and tooling; advise make/buy decisions.

Skills

Technical leadership

LLM applications

Python/Java

REST APIs

Cloud-native design

Azure

MLOps

Mentoring engineers

PHI handling

Education

Bachelor's degree or equivalent

Tools

Confluence/Jira

LLM APIs (OpenAI, Anthropic)

RAG pipelines

Job description

McKesson is actively seeking a Lead AI Engineer to drive architecture ownership for the AI platform, embedding delivery initiatives and ensuring compliance in a highly regulated healthcare environment.

The role emphasizes hands-on delivery, mentoring, and cross-functional collaboration with Legal/Compliance, Product, and Engineering to align AI architecture with business goals in Columbus, OH.