Senior AI Engineer — HIPAA‑Compliant LLM Systems

Humana; Charlotte (NC); On-site; USD 107,000 - 147,000; Full time

Job summary

Humana is seeking a Senior Software Engineer to build and maintain LLM-powered features, including retrieval-augmented generation, and to contribute to AI infrastructure and HIPAA-compliant development in a fast-growing team.

You will work on architecture discussions, code reviews, and cross-functional collaboration to uphold engineering standards while delivering scalable AI solutions for clinical use cases.

Qualifications

• B.S. or M.S. in Computer Science, Engineering, or a related field (or equivalent experience).
• 5+ years of software engineering experience, with 2+ years building production AI/ML systems.
• Hands-on experience with large language models and orchestration frameworks (LangChain, LlamaIndex, or equivalent).
• Proficiency in Python, Typescript and ML libraries (Hugging Face, PyTorch, scikit-learn, or similar).
• Experience building REST or GraphQL APIs that serve AI/ML model outputs.
• Solid understanding of RAG pipeline design and vector databases (Pinecone, Weaviate, pgvector, or similar).
• Experience building custom LLM and agent evals, including automated testing of model outputs, agent trajectories, and failure modes
• Awareness of HIPAA requirements and secure handling of sensitive health data
• Ability to work with autonomy and strong judgment in a greenfield, ambiguous environment
• Hands-on experience with AI-assisted development tools and LLM coding harnesses (Claude Code, Pi Agent, Cursor, Codex, or similar)

Responsibilities

• System Development: Build and maintain LLM-powered features including retrieval-augmented generation systems, structured prompt pipelines, and intelligent workflow automation deployed in clinical settings.
• Model Evaluation: Implement and iterate on evaluation frameworks to measure accuracy, safety, and reliability of AI outputs in production. Contribute to ongoing monitoring and quality improvement of deployed models.
• Backend Service Development: Build Python or Typescript based backend services that expose AI capabilities to product and clinical applications via REST, GraphQL APIs and Websockets.
• Infrastructure and MLOps: Contribute to AI infrastructure design, deployment automation, and operational tooling as the team scales.
• HIPAA-Compliant Development: Ensure all systems meet HIPAA standards and that protected health information is handled appropriately throughout the stack.
• Technical Collaboration: Participate actively in architecture discussions, code reviews, and technical design sessions. Help set and uphold team engineering standards in a new, growing team.

Skills

Large language models

LangChain

LlamaIndex

Python

TypeScript

REST APIs

GraphQL

HIPAA compliance

MLOps

LLM evaluation

Education

B.S./M.S. in CS or related field

Tools

LangChain

LlamaIndex

Hugging Face

PyTorch

scikit-learn

Pinecone

Weaviate

pgvector

GraphQL

Job description

Humana is seeking a Senior Software Engineer to build and maintain LLM-powered features, including retrieval-augmented generation, and to contribute to AI infrastructure and HIPAA-compliant development in a fast-growing team.

You will work on architecture discussions, code reviews, and cross-functional collaboration to uphold engineering standards while delivering scalable AI solutions for clinical use cases.