Staff Software Engineer — AI Agents for Legal Tech

Harvey

New York (NY)

On-site

USD 231,000 - 340,000

Full time

23 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Harvey is hiring a Software Engineer, Agents, to build systems that make AI agents indispensable to legal professionals. You will design environments and actions for agentic work, decide on models, manage context windows, build tools, and create evals to accelerate iteration and unlock new capabilities.

We’re seeking engineers and researchers who ship impactful products, use practical evaluations to drive quality, and push for excellence.

Qualifications

10+ years (post-BS/MS) of software engineering experience.
Proficiency in Python and experience working with LLM APIs and agent frameworks.
Experience with shipping user-facing products, either on the backend or full-stack.

Responsibilities

Partner with customers and PMs to understand legal workflows and ship agents that get the job done.
Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
Work with model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies and parallel tool calls.
Improve observability and instrumentation to profile agent behavior and drive optimization decisions.
Stay current on new developments in agentic systems and apply learnings to product development.