Senior GenAI Engineer — Production-Grade LLM & RAG

Zof AI; San Francisco, Northern (CA, KY); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Zof AI in San Francisco, CA seeks a Generative AI Engineer to design and ship features on frontier model APIs, owning the model-facing layer and end-to-end retrieval and RAG pipelines. You will drive agent planning, tool use, and multi-agent orchestration, while hardening context engineering for production reliability.

The role emphasizes cost, quality, and latency trade-offs with a strong software foundation, aiming to deliver high-quality, scalable AI features in a fast-moving environment.

Qualifications

• Shipping LLM-powered features to production.
• Strong software engineering foundation.
• Knowledge of retrieval, RAG, and agent patterns.
• Fluency with modern model APIs and tooling.
• Judgment on quality, cost, and latency trade-offs.
• Clear written and verbal communication.
• Comfort in fast-moving environments.
• Evidence of high-quality technical work.

Responsibilities

• Design and build features on frontier model APIs.
• Build and tune retrieval and RAG pipelines end-to-end.
• Design agent planning, tool use, and multi-agent orchestration.
• Own prompt and context engineering as a disciplined practice.
• Wire evals into the development loop to measure quality.
• Optimize cost, quality, and latency of AI features in production.
• Collaborate with product and engineering to ship reliably and fast.
• Own model-layer systems from design through production.

Skills

LLM production experience

Software engineering

Retrieval/RAG

Model API tooling

Quality vs cost vs latency

Communication

Adaptability

High-quality code

Tools

TypeScript

Python

Node.js

Postgres

Job description

Zof AI in San Francisco, CA seeks a Generative AI Engineer to design and ship features on frontier model APIs, owning the model-facing layer and end-to-end retrieval and RAG pipelines. You will drive agent planning, tool use, and multi-agent orchestration, while hardening context engineering for production reliability.

The role emphasizes cost, quality, and latency trade-offs with a strong software foundation, aiming to deliver high-quality, scalable AI features in a fast-moving environment.