Staff Software Engineer - AI Agents & Systems

Harvey; New York (NY); On-site; USD 231,000 - 340,000; Full time

Benefits offered by this job

Accommodations for disabilities

Job summary

Harvey is hiring a Software Engineer, Agents, in New York to build systems that make AI agents indispensable to legal professionals. You design environments and actions for agentic work, decide on model choices, manage context, and develop tools and evals to accelerate iteration and capability growth.

We seek engineers and researchers with a passion for practical, impactful product work and a track record of shipping user-facing solutions using Python and LLM APIs.

Qualifications

• 5-8 years of software engineering experience.
• Proficiency in Python and LLM APIs.
• Experience shipping user-facing products.

Responsibilities

• Partner with customers and PMs to understand workflows and ship agents that perform tasks.
• Optimize agent performance through prompt engineering, model selection, tool design, and eval harnesses.
• Collaborate with the model infra team to design low-latency agent execution infrastructure.
• Improve observability to profile agent behavior and drive optimization decisions.
• Stay current with developments in agentic systems and bring learnings to product.

Skills

Python

LLM APIs

Agent frameworks

Software engineering

Job description

Harvey is hiring a Software Engineer, Agents, in New York to build systems that make AI agents indispensable to legal professionals. You design environments and actions for agentic work, decide on model choices, manage context, and develop tools and evals to accelerate iteration and capability growth.

We seek engineers and researchers with a passion for practical, impactful product work and a track record of shipping user-facing solutions using Python and LLM APIs.