Senior AI Engineer II — GenAI Platform & RAG Lead

iHerb Inc.; California, Northern (MO, KY); Hybrid; USD 187,000 - 235,000; Full time

Job summary

iHerb Inc. is seeking a Sr. Software Engineer II - AI to lead GenAI-powered product experiences and the AI platform that powers them. You will own RAG pipelines, personalization, and agentic workflows, building production-grade AI capabilities across marketing, BI, and internal surfaces.

You will collaborate with the Personalization team, document decisions, and ensure observability, reliability, and cost efficiency in a fast-paced, global e-commerce environment.

Qualifications

• Hands-on experience shipping production AI features using AI-assisted development tools.
• End-to-end feature ownership from spec through deployment, observability and on-call.
• Strong knowledge of software design, testing, CI/CD, and code reviews.
• Proficiency in Python and building production LLM apps.
• Experience with RAG, retrieval, and evaluation frameworks.

Responsibilities

• Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation.
• Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability.
• Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing surfaces.
• Evaluate model and feature quality using structured eval frameworks; iterate on prompts and retrieval strategies.
• Use AI-driven SDLC tooling daily for AI and non-AI code.
• Coordinate with Personalization team to align GenAI features with ML signals.
• Document AI design decisions, eval results, and operational lessons.
• Own observability of AI systems, latency, cost, quality drift, and on-call responses.

Skills

AI SDLC

Full-stack

Production ownership

Code quality

Python

LangChain

LlamaIndex

Prompt engineering

Vector databases

Observability

Education

Bachelor's degree in CS

Tools

Claude Code

GitHub Copilot

Cursor

LangChain

LlamaIndex

Job description

iHerb Inc. is seeking a Sr. Software Engineer II - AI to lead GenAI-powered product experiences and the AI platform that powers them. You will own RAG pipelines, personalization, and agentic workflows, building production-grade AI capabilities across marketing, BI, and internal surfaces.

You will collaborate with the Personalization team, document decisions, and ensure observability, reliability, and cost efficiency in a fast-paced, global e-commerce environment.