Senior AI Platform Architect

iHerb, LLC; United States; Remote; USD 204,000 - 260,000; Full time

Job summary

iHerb, LLC seeks a Principal Engineer to shape the AI Platform and GenAI experiences across its AI initiatives. You will own end‑to‑end technical strategy, collaborating with peer Principals, Engineering Managers, and VP‑level leadership to drive scalable AI systems.

You will lead multi‑team architecture, establish guardrails and SDLC patterns, and contribute hands‑on expertise to production AI pipelines while mentoring engineers and aligning with product goals.

Qualifications

• AI‑driven SDLC demonstrated use of AI‑assisted development tools to ship production systems and guardrail strategies.
• Architecture at scale: design and evolve large‑scale distributed systems across multiple teams and domains.
• Cross‑org technical leadership: drive architectural standards and platform initiatives spanning teams.
• Engineering quality mindset: strong views on code quality, observability, CI/CD, test automation, and velocity.
• Communication and influence: write architecture docs, present to diverse audiences, build consensus.
• Experience working in distributed teams across the US, China, and Latin America.
• Production experience designing and operating AI platform systems: RAG pipelines, embedding infrastructure, etc.
• Hands‑on experience with LLM evaluation: building eval frameworks and metrics.
• MLOps experience: deployment, monitoring, lifecycle management, cost governance.
• Experience building and operating agentic systems (LangChain, LlamaIndex, etc).
• GenAI in production is required; prototype only not sufficient.
• High degree of accuracy and attention to detail
• Excellent organization and multi‑tasking skills.

Responsibilities

• Define and own the AI platform architecture: retrieval infrastructure, model lifecycle, evals framework, guardrails, and GenAI product design.
• Lead the shared AI platform layer consumed by all AI product features and internal teams.
• Hands‑on contributor: build production AI systems and validate architecture with working software.
• Set and enforce technical standards for the AI Platform team; drive reviews of architecture and model quality.
• Coordinate with the Personalization team to define boundaries between GenAI layer and existing ML infrastructure.
• Contribute patterns and lessons to iHerb’s AI‑driven SDLC golden path.
• Drive cross‑team architectural decisions across platform services.
• Establish and evolve iHerb’s AI‑driven SDLC golden path: standards, guardrails, automation.
• Lead multi‑team technical efforts by coordinating reviews and aligning Principals/EMs.
• Mentor and raise technical bar through code reviews and coaching of senior engineers.
• Represent engineering in cross‑functional conversations with product, data science, security, and infrastructure.
• Feed architectural decisions into the shared knowledge base to compound institutional knowledge.

Skills

AI SDLC

Architecture at scale

Cross-org leadership

Code quality

Communication

Distributed teams

MLOps

LLM eval

Agent systems

GenAI in prod

LangChain/LlamaIndex

Production AI

Observability

Education

Bachelor's Degree in Computer Science or related field

Tools

Claude Code

GitHub Copilot

Cursor

LangChain

LlamaIndex

Job description

iHerb, LLC seeks a Principal Engineer to shape the AI Platform and GenAI experiences across its AI initiatives. You will own end‑to‑end technical strategy, collaborating with peer Principals, Engineering Managers, and VP‑level leadership to drive scalable AI systems.

You will lead multi‑team architecture, establish guardrails and SDLC patterns, and contribute hands‑on expertise to production AI pipelines while mentoring engineers and aligning with product goals.