4372 - AI Software Engineer, Legal Prompting & LLM Dev.

Nixon Peabody LLP; Boston (MA); Remote; USD 118,000 - 175,000; Full time

Job summary

A leading law firm is seeking an AI Software Engineer specializing in Legal Prompting and LLM Development. This role involves creating applications that leverage advanced language models to enhance legal workflows. The ideal candidate will have a strong programming background, particularly in Python, and experience in the legal field is highly preferred. This position offers a dynamic work environment and opportunities for growth, with a remote work arrangement available.

Qualifications

• 4-6 years of production-level software engineering experience.
• Legal background highly preferred.
• Experience with LLM APIs or open-source models is a plus.

Responsibilities

• Design and develop LLM-integrated applications.
• Write and refine persona-based prompts.
• Collaborate with legal professionals to translate needs into technical solutions.

Skills

Python

Written Communication

Analytical Skills

Problem Solving

Education

Bachelor's degree in Computer Science

Tools

RESTful APIs

SQL

Job description

Job ID:
4372

Position:
Engineer

Location:
Multiple Offices

Practice Area:

Open Date:
Friday, May 9, 2025

Job Function:
Professional Staff

Job Description:

The AI Software Engineer, Legal Prompting & LLM Development is responsible for building applications that interact with state-of-the-art Large Language Models (LLMs) that deliver cutting-edge and time-saving solutions to attorneys throughout our firm and in support of our clients. This position will develop Python code as well as English prose, persona-based prompts to LLMs to help expand our early success. This mix of writing instructions for an interpreter and an LLM is well-suited for someone who can produce reliable backend code, and can also write creative, lucid, and effective prose instructions. A remote work arrangement is available for this position.

A career at Nixon Peabody is the opportunity to do work that matters. It's the chance to use your knowledge to shape what's ahead. To share, to innovate, to learn at a firm that taps the power of collective thinking.

We've created a dynamic, energizing environment that promotes success for our clients and each other. We offer fast growth, connectedness and training in business as well as law. And our rigorous standards assure you are part of a diverse team of top talent at every turn.

If you're someone who's looking toward the future, we'd love to hear from you.

Location: Boston, MA; Chicago, IL; Los Angeles, CA; New York City, NY; Rochester, NY; San Francisco, CA; Washington, DC

• Design and develop LLM-integrated applications that enhance legal workflows.
• Write and refine persona-based prompts to guide LLMs in delivering accurate and legally appropriate responses.
• Develop backend code, primarily in Python, to interact with LLM services and external data sources (APIs, SQL databases, etc.).
• Collaborate with attorneys, legal professionals, and product teams to understand domain-specific needs and translate them into technical solutions.
• Continuously test and iterate on prompt and code solutions to optimize model performance and user experience.
• Assess the integration of LLMs into existing legal workflow systems and recommend improvements. Perform other duties as assigned.

To perform this job successfully, you must be able to perform each essential job responsibility listed above, satisfactorily, with or without reasonable accommodation. Nixon Peabody retains the right to change or assign other duties to this position. The requirements listed below are representative of the skills and abilities required.

Job Requirements:

• 4-6 years of production-level software engineering experience on a commercial or internal product team.
• Legal background highly preferred (e.g., J.D., paralegal, legal tech industry experience, or work with legal software vendors).
• Demonstrated experience in legal practice or support roles is a plus.
• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• Strong programming skills in Python or comparable languages.
• Experience with RESTful APIs and SQL database interaction.
• Excellent written communication skills-especially in crafting clear and effective LLM prompts.
• Ability to translate legal context and goals into prompt instructions and system requirements.
• Strong analytical and problem-solving capabilities.
• Ability to thrive both independently and as part of a collaborative team.
• Experience with or enthusiasm for working with LLM APIs (OpenAI, Anthropic, Cohere, etc.) or open-source models (e.g., LLaMA, Mistral).

In accordance with applicable Federal and State laws, the anticipated annual salary range for this position, depending on location, is as follows:

• Rochester, NY: $107,00 to $158,950
• Boston, MA: $118,000 to $174,900
• Chicago, IL: $118,000 to $174,900
• Los Angeles, CA: $118,000 to $174,900
• Washington, DC: $118,000 to $174,900
• New York, NY: $129,500 to $192,500
• San Francisco, CA: $129,500 to $192,500

In addition to a standard benefits package, this role may be eligible for additional contingent compensation based on an array of factors, including but not limited to: work performance, geographic location, work experience, education, and qualifications. Because such contingent compensation is not yet calculable or may be zero ($0) in some circumstances, the above-listed salary range(s) are Nixon Peabody's good faith estimate of the annual salary(ies) it reasonably expects to pay for the position at the time of this posting.

Nixon Peabody LLP is an Equal Opportunity / Affirmative Action Employer. Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative, we will consider for employment qualified applicants with arrest and conviction records.

To comply with Federal law, Nixon Peabody participates in E-Verify. All newly hired employees are verified through this electronic system established by the Department of Homeland Security (DHS) and the Social Security Administration (SSA) to confirm their identity and employment eligibility. Please refer to the Notice of E-Verify Participation and the Right to Work posters on the Nixon Peabody Careers page for more information.

#LI-Remote