Staff Software Engineer — AI Agents for Legal Tech

Harvey, Inc.

San Francisco, Northern (CA, KY)

Hybrid

USD 231,000 - 340,000

Full time

8 days ago

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Harvey is transforming how legal and professional services operate by building AI agents that empower lawyers and professionals. We are scaling quickly with strong investor support and a clear view of the future of knowledge work.

As a Software Engineer, Agents, you will design environments for agentic work, make model decisions, manage context windows, and develop evals to accelerate iteration and capabilities. This role spans mid to staff levels with a focus on impact and delivery.

Qualifications

8+ years (post-BS/MS) of software engineering experience.
Proficiency in Python and experience working with LLM APIs and agent frameworks.
Experience with shipping user-facing products, either on the backend or full-stack.

Responsibilities

Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
Stay current on new developments in agentic systems and bring those learnings back to the products we build.