AI Engineer

TaskVerse

United States

On-site

USD 155,000 - 259,000

Full time

2 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

McKesson's AI Enablement team is hiring a Lead AI Engineer to set architectural direction for LLM systems and driving the delivery of AI-powered products in a highly regulated healthcare environment. This hands-on leadership role requires guiding senior engineers while designing complex components and coordinating with Legal, Compliance, Privacy, and product teams.

Priority consideration will be given to candidates in the Columbus, Ohio metropolitan area.

Qualifications

  • Bachelor’s degree or equivalent experience with 8+ years software engineering, incl. 3+ years production AI/ML/LLM/NLP.
  • Experience building production LLM apps using prompt engineering, RAG/GraphRAG, agentic workflows.
  • Strong Python and/or Java, REST APIs, event-driven architecture, microservices, cloud-native design.
  • Experience with OpenAI/Anthropic APIs and MCP integration protocol.

Responsibilities

  • Define the architecture and roadmap for LLM and agentic systems, incl. model routing and RAG pipelines.
  • Lead architecture reviews; ensure security, privacy, governance, and data-provenance compliance.
  • Design shared platform capabilities for knowledge retrieval, citations, and data access control.
  • Build high-complexity components and mentor engineers on priority delivery initiatives.
  • Develop secure AI operations: usage, cost attribution, abuse monitoring, evaluation, rollback.
  • Partner across teams; assess tooling/providers; advise build-vs-buy; ensure PHI regulatory compliance.

Skills

AI/ML leadership
Production LLM apps
Python/Java
REST APIs
Cloud-native design
Prompt engineering
Agentic workflows
RAG pipelines

Education

Bachelor's degree or equivalent
Master's/PhD preferred

Tools

OpenAI API
Anthropic API
MCP
Azure
AWS/GCP

Job description

About The Company

McKesson is an impact-driven Fortune 10 company that supports nearly every aspect of healthcare. We deliver insights, products, and services that help make quality care more accessible and affordable. Our work is grounded in a commitment to the health, happiness, and well-being of the people and communities we serve. At McKesson, employees are encouraged to grow, contribute new ideas, and make a meaningful impact as we help shape the future of health.

About The Company

McKesson is an impact-driven Fortune 10 company that supports nearly every aspect of healthcare. We deliver insights, products, and services that help make quality care more accessible and affordable. Our work is grounded in a commitment to the health, happiness, and well-being of the people and communities we serve. At McKesson, employees are encouraged to grow, contribute new ideas, and make a meaningful impact as we help shape the future of health.

About The Role

McKesson's AI Enablement team advances the safe, enterprise-wide adoption of generative AI through platform engineering, governance, and delivery of AI-powered products and internal tools. As Lead AI Engineer, you will serve as a senior technical authority for the AI platform and embedded delivery initiatives. You will set architectural direction for Senior and Associate AI Engineers and own the design of agentic and large language model (LLM) systems, including retrieval-augmented generation (RAG), integrations, and evaluation capabilities.

This is a hands-on leadership role. You will guide architecture while personally designing and building complex components for priority initiatives. You will partner with engineering, product, platform, Legal, Compliance, and Privacy teams to deliver reliable, secure, scalable systems in a highly regulated healthcare environment. Success means shipping dependable AI systems, establishing standards that other engineers adopt, and influencing AI platform decisions across McKesson. Priority consideration will be given to candidates in the Columbus, Ohio metropolitan area.

Qualifications

A bachelor’s degree or equivalent experience and typically at least eight years of software engineering experience are required, including three or more years focused on production AI/ML, LLM, or NLP systems. Fewer years may be required with a relevant master’s or doctoral degree. Candidates must demonstrate technical leadership beyond senior-level feature ownership, such as setting architecture for a team or platform area.

Required expertise includes building production LLM applications using prompt engineering, RAG or GraphRAG, agentic workflows, tool use, and evaluation harnesses. You should have experience with commercial LLM APIs, such as Anthropic or OpenAI, and integration protocols such as Model Context Protocol (MCP). Strong software engineering skills in Python and/or Java, REST APIs, event-driven architecture, microservices, and cloud-native design are essential; Azure experience is preferred, while AWS or GCP experience is also relevant. Experience with vector or graph retrieval, embeddings, production knowledge bases, and LLMOps/MLOps practices is expected.

Preferred qualifications include an advanced degree, experience leading applied AI or platform teams in healthcare or another regulated industry, familiarity with PHI and AI governance, and experience evaluating vendors or modernizing legacy systems. Clear communication, sound judgment, continuous learning, and the ability to mentor through design reviews and pairing are important. McKesson is unable to provide sponsorship for this role, now or in the future.

Responsibilities

Define the architecture and roadmap for LLM and agentic systems, including model routing, connector patterns, RAG pipelines, and prompt and evaluation frameworks. Lead architecture reviews and ensure solutions meet enterprise security, privacy, governance, and data-provenance requirements. Design shared platform capabilities for knowledge retrieval, citations and traceability, and permission-aware data access. Build high-complexity components for priority delivery initiatives, and establish coding, architecture, and evaluation standards while mentoring engineers.

Develop secure and observable AI operations, including usage and cost attribution, abuse monitoring, model evaluation, and rollback strategies. Partner across engineering, product, platform, Legal, and Compliance; assess model providers and tooling; recommend build-versus-buy approaches; and represent AI architecture in enterprise forums. Ensure systems that handle protected health information meet applicable regulatory and organizational requirements.

Benefits

McKesson offers a competitive total rewards package. Compensation reflects factors such as skills, experience, performance, equity, and geographic market, and may include annual bonus or long-term incentive opportunities in addition to base pay. The base pay range for this position is $155,300-$258,800. Benefits are designed to support employees’ health and well-being.

Equal Opportunity

McKesson is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. McKesson is committed to providing opportunities to all job seekers, including individuals with disabilities. Reasonable accommodations are available to assist with the job search or application process.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Engineer
Lead AI Engineer

Mckesson Corporation • Columbus (OH)

On-site
USD 155,000 - 259,000
Lead AI Engineer
Lead AI Engineer

CoverMyMeds • Columbus (OH)

On-site
USD 155,000 - 259,000
Lead AI Engineer
Lead AI Engineer

Mckesson Corporation • United States

On-site
USD 155,000 - 259,000
Competitive compensation
Annual bonus potential
Long-term incentive opportunities
Lead AI Engineer
Lead AI Engineer

Mckesson Corporation • Atlanta (GA)

On-site
USD 155,000 - 259,000
Competitive compensation
Lead AI Engineer
Lead AI Engineer

Mckesson Corporation • Alpharetta (GA)

On-site
USD 155,000 - 259,000
Lead AI Engineer
Lead AI Engineer

CoverMyMeds LLC • Columbus (OH)

On-site
USD 155,000 - 259,000
Principal AI Engineer
Principal AI Engineer

Mckesson Corporation • Columbus (OH)

On-site
USD 195,000 - 325,000
Sr Associate AI Full stack Software Engineer
Sr Associate AI Full stack Software Engineer

CoverMyMeds LLC • Atlanta (GA)

On-site
USD 140,000 - 190,000
Senior AI Full stack Software Engineer
Senior AI Full stack Software Engineer

Mckesson Corporation • Alpharetta (GA)

On-site
USD 131,000 - 218,300
Sr Associate AI Full stack Software Engineer
Sr Associate AI Full stack Software Engineer

Mckesson Corporation • Atlanta (GA)

On-site
USD 120,000 - 160,000