Lead AI Systems Architect — LLM, RAG & Responsible AI

Humana; Boston (MA); On-site; USD 129,000 - 178,000; Full time

Benefits offered by this job

Medical, dental and vision benefits

401(k) retirement savings plan

Paid time off and holidays

Parental and caregiver leave

Disability and life insurance

Job summary

Humana is seeking a Lead Software Engineer to own the end-to-end AI architecture for CenterWell's AI systems, including LLM-powered features and RAG pipelines. You will work with product, clinicians, and data teams to deliver high-impact AI capabilities while maintaining HIPAA compliance and responsible AI standards.

You will guide model development, fine-tuning, evaluation, and multi-agent orchestration, ensuring scalable, secure, and clinically relevant solutions across cloud platforms.

Qualifications

• B.S. or M.S. in computer science, engineering, or related field (or equivalent experience).
• 8+ years of software engineering, with 4+ years in production AI/ML systems.
• Deep hands-on experience building with large language models and orchestration frameworks (LangChain, LlamaIndex, or equivalent).
• Strong proficiency in Python, Typescript and modern ML tooling (Hugging Face, PyTorch, or similar).
• Proven experience designing and deploying RAG pipelines and vector search systems in production.
• Knowledge of model fine-tuning approaches (LoRA, RLHF, instruction tuning, or equivalent).
• Experience designing and implementing custom LLM and agent evaluation frameworks, including automated eval pipelines, benchmark construction, and output quality assessment at scale.
• Experience building multi-agent AI systems, including agent orchestration, tool use, and sandboxed execution environments.
• Demonstrated ownership of complex AI systems end-to-end, from architecture through production operation.
• Understanding of HIPAA requirements and secure handling of PHI.
• Strong written and verbal communication skills across technical and non-technical audiences.
• Hands-on experience with AI-assisted development tools and LLM coding harnesses (Claude Code, Pi Agent, Cursor, Codex, or similar).

Responsibilities

• Technical Architecture and Ownership: design and own end-to-end AI system architecture, including LLM-powered tools and pipelines.
• Model Development and Fine-Tuning: evaluate and guide fine-tuning of foundation models and establish evaluation frameworks.
• Clinical and Product Partnership: collaborate with product managers, clinicians, and data stakeholders to translate workflows into AI features.
• HIPAA Compliance and Responsible AI: ensure systems comply with HIPAA and Humana's Responsible AI standards and review processes.
• Identify and drive improvements in AI reliability, safety, and clinical relevance.
• Communicate technical decisions effectively to executives and cross-functional teams.

Skills

LLM development

Python

Typescript

RAG pipelines

Multi-agent AI

HIPAA awareness

AI tooling

Education

Bachelor's/Master's in CS or Eng

Tools

LangChain

LlamaIndex

PyTorch

Hugging Face

Agent frameworks

Job description

Humana is seeking a Lead Software Engineer to own the end-to-end AI architecture for CenterWell's AI systems, including LLM-powered features and RAG pipelines. You will work with product, clinicians, and data teams to deliver high-impact AI capabilities while maintaining HIPAA compliance and responsible AI standards.

You will guide model development, fine-tuning, evaluation, and multi-agent orchestration, ensuring scalable, secure, and clinically relevant solutions across cloud platforms.