Staff Software Engineer, Artificial Intelligence/LLM

engineeringjobs.net, Inc.; San Carlos (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Health Insurance

Paid Time Off

Paid Company Holidays

401(k)

Job summary

engineeringjobs.net, Inc. seeks a senior leader to design and deliver user-facing LLM features, including retrieval and tool-calling workflows, production services, evaluations, and safety controls.

You will own reliability and performance in production while collaborating across product, infrastructure, ML, and security teams on retrieval, data preparation, monitoring, and technical direction. The role requires eight+ years of experience, a track record of setting technical direction, and deep

Qualifications

• At least eight years of experience and track record of setting technical direction or standards across systems or teams.
• Shipped LLM applications and production-grade software development experience.
• Deep expertise in RAG, embeddings, vector search, tool calling, evaluation, observability, and cost and latency optimization.

Responsibilities

• Lead the design and delivery of user-facing LLM features and workflows.
• Own reliability and performance in production across systems and services.
• Collaborate with product, infrastructure, ML, and security teams on retrieval, data prep, monitoring, and technical direction.

Skills

LLM features

Retrieval-Augmented Generation

Python

TypeScript

Vector Search

Function Calling

Prompt Engineering

Model Evaluation

API Development

Observability

Technical Leadership

Cost and Latency Optimization

Data Privacy

Tools

AWS

Job description

Lead the design and delivery of user-facing LLM features, including retrieval and tool-calling workflows, production services, evaluations, and safety controls. Own reliability and performance in production while collaborating across product, infrastructure, ML, and security teams on retrieval, data preparation, monitoring, and technical direction.

Requirements:

Candidates should have at least eight years of experience and a record of setting technical direction or standards across systems or teams. They should have shipped LLM applications, be proficient in production software development, and demonstrate depth in RAG, embeddings, vector search, tool calling, evaluation, observability, and cost and latency optimization.

Key Skills:

Large Language Models, Retrieval-Augmented Generation, Python, TypeScript, Vector Search, Function Calling, Prompt Engineering, Model Evaluation, API Development, AWS, Observability, Data Privacy, Technical Leadership, Cost and Latency Optimization

Benefits:

• Health Insurance
• Paid Time Off
• Paid Company Holidays
• 401(k)