ML Engineer, AI Assistant Quality — Production Systems

FDE Times; San Francisco (CA); Hybrid; USD 180,000 - 205,000; Full time

Benefits offered by this job

Home office stipend

Education stipend

Wellness stipend

Daily lunches

Job summary

Glean is seeking a Machine Learning Engineer to improve the quality of our AI Assistant and autonomous agents. This role sits at the intersection of production machine learning, LLM-powered systems, and product engineering, focusing on building, evaluating, and iterating on assistant experiences grounded in real enterprise workflows.

You will work on applied problems across agent quality, evaluation, personalization, retrieval, and orchestration.

Qualifications

• 2+ years of industry experience in machine learning, applied AI, or software engineering with ML ownership.
• Strong hands-on coding ability and a track record of shipping production systems.
• Experience in one or more of: LLM applications, NLP, search, retrieval, recommendations, evaluation frameworks, agent systems, or personalization.

Responsibilities

• Build and improve ML and LLM-powered systems that raise the quality of Glean’s AI Assistant and autonomous agents.
• Design evaluation, benchmarking, and monitoring loops to measure assistant quality, model quality, and end-to-end system performance.
• Develop and iterate on signals, prompts, workflows, and model-driven logic that improve reasoning, planning, personalization, and task completion quality.
• Work across areas such as RAG, semantic search, recommendation-style systems, post-training or reinforcement learning, and agent orchestration to improve product outcomes.
• Partner with product, design, and engineering teams to understand customer pain points and ship production systems quickly.
• Contribute to data and ML infrastructure to support experimentation, offline and online evaluation, and continuous model improvement.

Skills

ML engineering

Python

Go

Java

C++

LLM applications

NLP

Search systems

Experimentation

Tools

LLM tooling

Evaluation frameworks

Job description

Glean is seeking a Machine Learning Engineer to improve the quality of our AI Assistant and autonomous agents. This role sits at the intersection of production machine learning, LLM-powered systems, and product engineering, focusing on building, evaluating, and iterating on assistant experiences grounded in real enterprise workflows.

You will work on applied problems across agent quality, evaluation, personalization, retrieval, and orchestration.