AI Architect/AI Engineer – Generative & Agentic AI

MWI Buying Group; Town of Texas, Northern (WI, KY); Hybrid; USD 160,000 - 230,000; Full time

Benefits offered by this job

Medical, dental, and vision care

Backup dependent care

Adoption assistance

Infertility coverage

Family building support

Behavioral health solutions

Paid parental leave

Paid caregiver leave

Job summary

Cencora seeks an experienced AI Architect to lead enterprise Generative and Agentic AI solutions from concept to production. You will drive rapid POC/MVP delivery, design API-first architectures, and govern AI systems while mentoring engineering teams across LangGraph, AutoGen, and vector databases.

The role requires deep expertise in LLMs, RAG, and MLOps, with strong Python skills and cloud experience. Healthcare domain familiarity is a plus, and the team emphasizes responsible AI and

Qualifications

• Bachelor’s or Master’s degree in CS/AI/Data Science or related field.
• 6+ years IT experience in software engineering/cloud architecture/AI/ML.
• 3+ years hands-on architecture in Generative AI/Agentic AI systems.
• Strong Python and modern AI development frameworks.
• Proven experience with LLMs (OpenAI, Claude, Gemini, Llama).
• Deep understanding of RAG architectures, vector databases (Pinecone/FAISS/Databricks/pvect), embeddings.
• Experience with one major cloud platform (Azure/AWS/GCP) including native AI services.
• MLOps/LLMOps: CI/CD, Docker/Kubernetes, observability, evaluation frameworks.
• AI governance, security, compliance, Responsible AI.
• Excellent communication to present to execs and engineers.

Responsibilities

• Own end-to-end architecture for enterprise Generative AI/Agentic AI solutions.
• Lead rapid POC and MVP development to validate AI use cases.
• Architect scalable AI platforms using LLMs, RAG pipelines, vectors, multi-agent orchestration.
• Design API-first architectures (REST/GraphQL) for enterprise apps.
• Define tech standards and best practices for prompt engineering and governance.
• Guide MLOps/LLMOps for deployment, monitoring, lifecycle management.
• Lead architecture reviews and align with executive sponsors.
• Mentor AI engineers and set coding/architecture standards.
• Evaluate cloud AI services (Azure AI Foundry, Vertex AI) for scalability/cost.

Skills

Generative AI

Agentic AI

Python

LLMs

MLOps

Cloud architecture

REST/GraphQL

Education

Bachelor's or Master's in CS/AI/Data Science

Tools

LangGraph

AutoGen

Semantic Kernel

Pinecone

FAISS

Databricks Vector Databases

pgvector

Azure OpenAI

Azure AI Foundry

LangSmith

Ragas

Langfuse

Docker

Kubernetes

Job description

Job Details

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join our innovative company and help us improve the lives of people and animals everywhere.

About the Role

We are seeking an experienced hands‑on AI Architect to lead the architecture, design, and delivery of enterprise‑scale Generative and Agentic AI solutions. This is a hands‑on architectural leadership role spanning system design, rapid proof‑of‑concept (POC) and MVP delivery, API‑first solution architecture, and technical governance across our AI platform. The ideal candidate combines deep technical depth in LLMs, multi‑agent orchestration, and RAG architecture with the ability to translate business needs into scalable, production‑grade AI systems and to mentor engineering teams along the way.

Key Responsibilities

• Own end‑to‑end architecture for enterprise Generative AI and Agentic AI solutions, from concept through production.
• Lead rapid POC and MVP development to validate AI use cases and de‑risk technical approaches before full build‑out.
• Architect scalable AI platforms leveraging LLMs, RAG pipelines, vector databases, and multi‑agent orchestration frameworks (LangGraph, AutoGen, Semantic Kernel).
• Design API‑first architectures (REST/GraphQL) that expose AI capabilities to downstream applications and enterprise systems.
• Define technology selection, architecture standards, and best practices for prompt engineering, model evaluation, and AI governance / Responsible AI.
• Architect and guide MLOps/LLMOps practices for deployment, monitoring, and model/agent lifecycle management.
• Lead architecture reviews and present designs to executive sponsors and engineering teams; drive stakeholder alignment.
• Mentor AI engineers, set coding and architecture standards, and raise the technical bar across the team.
• Evaluate and select cloud‑native AI services (Azure AI Foundry, Google Vertex AI), balancing scalability, cost, security, and performance.

Our Tech Stack

Databricks platform, Unity Catalog for governance, Delta Lake for data storage, Databricks Apps for hosting, and Databricks AI Gateway for model routing and governance. Microsoft Azure, including Azure AI Foundry for model deployment and orchestration. Multi‑LLM provider access. Anthropic Claude, OpenAI (GPT & Codex), and other foundation models.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, AI, Data Science, or a related field.
• 6+ years of overall IT experience spanning software engineering, cloud architecture, and/or AI/ML.
• 3+ years of hands‑on architecture experience specifically in Generative AI / Agentic AI systems.
• Strong expertise in Python and modern AI development frameworks.
• Demonstrated experience architecting solutions with LLMs (OpenAI, Claude, Gemini, Llama, or open‑weight models).
• Deep understanding of RAG architectures, vector databases (Pinecone, FAISS, Databricks Vector Databases, pgvector), and embedding models.
• Experience architecting on at least one major cloud platform (Azure, AWS, or GCP), including native AI services (Azure AI Foundry / Azure OpenAI, AWS Bedrock, Google Vertex AI).
• Proven experience with MLOps/LLMOps: CI/CD, containerization (Docker/Kubernetes), observability, and evaluation frameworks.
• Strong grounding in AI governance, security, compliance, and Responsible AI practices.
• Excellent communication skills, with the ability to present architecture to both executives and engineers.

Preferred Qualifications

• Experience designing state management and persistent memory for long‑running autonomous agents.
• Familiarity with Model Context Protocol (MCP) and emerging AI agent ecosystems.
• Experience with AI observability / evaluation tooling (LangSmith, Ragas, Langfuse, or custom eval harnesses).
• Prior consulting, client‑facing, or forward‑deployed architecture experience.
• Relevant cloud certifications (Azure AI Engineer/Architect, AWS ML Specialty, Google Professional ML Engineer).
• Experience with NL‑to‑SQL, knowledge graphs, or GraphRAG‑style architecture.

HEALTHCARE DOMAIN PREFERENCE

We strongly prefer candidates who bring healthcare knowledge alongside their AI expertise. Our AI platforms are architected on healthcare distribution and specialty pharmacy data — experience with healthcare distribution, specialty pharma data, or healthcare EMR/EHR systems (HL7, FHIR, claims, NDC‑level data) is a significant advantage.

What Cencora offers

We provide compensation, benefits, and resources that enable a highly inclusive culture and support our team members’ ability to live with purpose every day.

In addition to traditional offerings like medical, dental, and vision care, we also provide a comprehensive suite of benefits that focus on the physical, emotional, financial, and social aspects of wellness.

• medical, dental, and vision care
• backup dependent care
• adoption assistance
• infertility coverage
• family building support
• behavioral health solutions
• paid parental leave
• paid caregiver leave

To encourage your personal growth, we also offer a variety of training programs, professional development resources, and opportunities to participate in mentorship programs, employee resource groups, volunteer activities, and much more.

• training programs
• professional development resources
• opportunities to participate in mentorship programs
• employee resource groups
• volunteer activities

For details, visit https://www.virtualfairhub.com/cencora

Temps Plein Equal Employment Opportunity

Cencora is committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, age, disability, veteran status or membership in any other class protected by federal, state or local law. The company’s continued success depends on the full and effective utilization of qualified individuals. Therefore, harassment is prohibited and all matters related to recruiting, training, compensation, benefits, promotions and transfers comply with equal opportunity principles and are non‑discriminatory.

Cencora is committed to providing reasonable accommodations to individuals with disabilities during the employment process which are consistent with legal requirements. If you wish to request an accommodation while seeking employment, please call 888.692.2272 or email [e-mail]. We will make accommodation determinations on a request‑by‑request basis. Messages and emails regarding anything other than accommodations requests will not be returned.

Affiliated Companies

Affiliated Companies: International Oncology Network Solutions Inc

Cencora is a leading global pharmaceutical solutions company that is committed to improving the lives of people and animals everywhere. We connect manufacturers, providers, and patients to ensure that anyone can get the therapies they need, where and when they need them. We’re a purpose‑driven organization, where all of our team members around the world are united in our responsibility to create healthier futures. We work together every day to help our partners bring their innovations to patients worldwide, creating unparalleled access and impact at the center of health.