Production AI Engineer: LLM, RAG & Multi-Agent Systems

Zof AI; San Francisco, Northern (CA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Zof AI in San Francisco, CA is seeking an Applied AI Engineer to build product features on top of frontier model APIs. This role owns the model-facing layer of our products, including retrieval and RAG pipelines, agent planning and orchestration, multi-agent frameworks, and the context engineering that makes AI systems reliable in production.

You have shipped LLM-powered features to real users and treat quality, cost, and latency as engineering constraints.

Qualifications

• Shipping LLM-powered features to production.
• Strong software engineering foundation.
• Knowledge of retrieval, RAG, and agent patterns.
• Fluency with modern model APIs.
• Ability to balance quality, cost, and latency.

Responsibilities

• Design and build product features on top of frontier model APIs.
• Build and tune retrieval and RAG pipelines end to end.
• Design agent planning, tool use, and multi-agent orchestration.
• Own prompt and context engineering as a disciplined, tested practice.
• Wire evals into the development loop so quality is measured, not assumed.
• Optimize the cost, quality, and latency of AI features in production.
• Collaborate with product and engineering to ship reliably and fast.
• Own model-layer systems from design through production.

Skills

LLM features

Software engineering

Model APIs

Retrieval & RAG

Tools

TypeScript

Python

Node.js

Postgres

Job description

Zof AI in San Francisco, CA is seeking an Applied AI Engineer to build product features on top of frontier model APIs. This role owns the model-facing layer of our products, including retrieval and RAG pipelines, agent planning and orchestration, multi-agent frameworks, and the context engineering that makes AI systems reliable in production.

You have shipped LLM-powered features to real users and treat quality, cost, and latency as engineering constraints.