Staff AI/LLM Engineer: Retrieval, Tool Calls & Production

Beacon AI; San Carlos (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Health Insurance

Paid Time Off

Paid Company Holidays

401(k)

Job summary

engineeringjobs.net, Inc. seeks a senior leader to design and deliver user-facing LLM features, including retrieval and tool-calling workflows, production services, evaluations, and safety controls.

You will own reliability and performance in production while collaborating across product, infrastructure, ML, and security teams on retrieval, data preparation, monitoring, and technical direction. The role requires eight+ years of experience, a track record of setting technical direction, and deep

Qualifications

• At least eight years of experience and track record of setting technical direction or standards across systems or teams.
• Shipped LLM applications and production-grade software development experience.
• Deep expertise in RAG, embeddings, vector search, tool calling, evaluation, observability, and cost and latency optimization.

Responsibilities

• Lead the design and delivery of user-facing LLM features and workflows.
• Own reliability and performance in production across systems and services.
• Collaborate with product, infrastructure, ML, and security teams on retrieval, data prep, monitoring, and technical direction.

Skills

LLM features

Retrieval-Augmented Generation

Python

TypeScript

Vector Search

Function Calling

Prompt Engineering

Model Evaluation

API Development

Observability

Technical Leadership

Cost and Latency Optimization

Data Privacy

Tools

AWS

Job description

engineeringjobs.net, Inc. seeks a senior leader to design and deliver user-facing LLM features, including retrieval and tool-calling workflows, production services, evaluations, and safety controls.

You will own reliability and performance in production while collaborating across product, infrastructure, ML, and security teams on retrieval, data preparation, monitoring, and technical direction. The role requires eight+ years of experience, a track record of setting technical direction, and deep