Senior GenAI Platform Engineer

iHerb; California; Hybrid; USD 187,000 - 235,000; Full time

Job summary

iHerb is seeking a Senior Software Engineer II - AI to design and build GenAI-powered product experiences and the shared AI platform infrastructure. You will own RAG pipelines over the catalog and reviews, plus LLM-driven personalization and agentic workflow systems.

You will implement AI SDLC tooling, collaborate across teams, monitor latency and costs, and contribute to RFCs and wikis while working in a globally distributed environment.

Qualifications

• AI-driven SDLC: hands-on experience shipping production code with AI-assisted development tools.
• Full-stack awareness across layers of the stack.
• Production ownership from spec to deployment, observability, and on-call.
• Code quality fundamentals: testing, reviews, CI/CD.
• Autonomy in technical decisions and mentorship of juniors.
• Proficiency in Python and production LLM apps.
• Hands-on with at least one specialization: RAG/retrieval, LLM eval, agentic frameworks, or AI automation.
• Understanding prompt engineering, context window management, and LLM tradeoffs.
• Familiarity with vector databases, embedding models, or semantic search.
• Attention to detail, high accuracy, strong organization.
• Preferred: MLOps tooling or deployment pipelines.
• Experience with e-commerce platforms or high-traffic apps.
• Distributed teams experience.
• Documenting architectural decisions and RFCs.

Responsibilities

• Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or workflow automation.
• Build the shared AI platform layer: retrieval infra, eval frameworks, model monitoring, guardrails, observability.
• Write LLM applications and integrations with marketing platforms, BI tools, or product surfaces.
• Evaluate model quality using structured evals; iterate prompts and retrieval strategies.
• Use AI-driven SDLC tooling daily for AI and non-AI code.
• Coordinate with personalization team to align GenAI features with signals.
• Document AI system designs, eval results, and operational learnings.
• Own observability and on-call handling for AI systems.

Skills

AI SDLC tooling

Python

LangChain

LLM evaluation

MLOps familiarity

Production ownership

Full-stack awareness

Code quality

GC observability

Education

Bachelor's Degree in Computer Science

Tools

Claude Code

GitHub Copilot

Cursor

Vector databases

Job description

iHerb is seeking a Senior Software Engineer II - AI to design and build GenAI-powered product experiences and the shared AI platform infrastructure. You will own RAG pipelines over the catalog and reviews, plus LLM-driven personalization and agentic workflow systems.

You will implement AI SDLC tooling, collaborate across teams, monitor latency and costs, and contribute to RFCs and wikis while working in a globally distributed environment.