Senior AI Platform Engineer - Production LLM Systems

Relha LLC; New York (NY); Hybrid; USD 141,000 - 194,000; Full time

Benefits offered by this job

Hybrid work schedule

Bonus incentive plan

Healthcare benefits

Job summary

Humana is seeking a Senior AI Applied Engineer to design, build, deploy, and operate production AI systems at scale within a major U.S. health insurer.

You will own end-to-end solutions from user interfaces and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations. You will work on extraction, retrieval, agentic workflows, and human-review systems handling real healthcare data with emphasis on accuracy, reliability, and auditability in a regulated setting.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 5+ years of experience building and operating production software systems.
• Experience developing backend services, APIs, distributed systems, or data-intensive applications.
• Hands-on experience integrating LLMs into production applications beyond simple chat interfaces, including structured outputs, tool calling, retrieval-augmented generation, agents, or multi-step workflows.
• Experience with major AI platforms such as OpenAI, Anthropic, Google, Azure AI, or AWS Bedrock.
• Experience debugging, monitoring, and supporting production applications used by real customers.
• Ability to work independently, navigate ambiguity, and take ownership.

Responsibilities

• Design, develop, and deploy full-stack AI-powered applications, including frontend experiences, APIs, backend services, and data pipelines.
• Build and optimize LLM-based workflows for information extraction, classification, retrieval, summarization, and agentic processes.
• Develop robust prompt strategies, structured output frameworks, tool-calling capabilities, and fallback mechanisms to improve reliability.
• Design and implement retrieval-augmented generation (RAG) systems using embeddings, vector databases, and semantic search technologies.
• Build evaluation frameworks, including benchmark datasets, regression testing, quality metrics, and human review workflows.
• Develop human-in-the-loop processes that enable clinicians and domain experts to validate AI outputs and provide feedback for continuous improvement.
• Build and maintain document-processing pipelines, including OCR, document ingestion, metadata extraction, indexing, and search capabilities.
• Optimize AI systems for accuracy, latency, reliability, scalability, and cost efficiency.
• Implement observability, monitoring, logging, alerting, and incident response processes for production systems.
• Deploy and operate services in cloud-native environments using Kubernetes, Docker, CI/CD pipelines, and modern infrastructure tooling.
• Collaborate with product, engineering, clinical, and operational stakeholders to translate complex business requirements into scalable solutions.
• Ensure solutions meet privacy, security, compliance, and auditability requirements within a regulated healthcare environment.

Skills

TypeScript

React / Next.js

Python

Gemini on Vertex AI

OCR and Document AI

Docker

Kubernetes

CI/CD tooling

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

Docker

Kubernetes

CI/CD tooling

Job description

Humana is seeking a Senior AI Applied Engineer to design, build, deploy, and operate production AI systems at scale within a major U.S. health insurer.

You will own end-to-end solutions from user interfaces and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations. You will work on extraction, retrieval, agentic workflows, and human-review systems handling real healthcare data with emphasis on accuracy, reliability, and auditability in a regulated setting.