AI Developer Experience Engineer: Tooling for Faster AI Iteration

Crosby Legal, Inc.; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

Crosby Legal, Inc. is seeking an AI Developer Experience Engineer to play a critical role in building internal systems for developing and shipping AI features. You will focus on improving developer experience around LLMs and create tools and infrastructure to enhance productivity.

The ideal candidate has 3+ years in software engineering, strong Python skills, and hands-on experience with LLMs and APIs. This position emphasizes building foundational systems to streamline workflows and increase developer velocity.

Qualifications

• 3+ years of software engineering experience, ideally working on developer tools, infrastructure, or platform teams.
• Strong proficiency in Python and experience building backend systems and internal tooling.
• Hands-on experience working with LLMs, APIs, and modern AI workflows.

Responsibilities

• Build AI developer tooling: Design and implement internal tools for prompt management.
• Improve iteration speed: Create systems for rapid testing and debugging of model outputs.
• Own evaluation infrastructure: Develop frameworks for benchmarking and monitoring AI system performance.

Skills

Software engineering experience

Python proficiency

LLMs and APIs experience

Systems thinking

Strong communication skills

Job description

Crosby Legal, Inc. is seeking an AI Developer Experience Engineer to play a critical role in building internal systems for developing and shipping AI features. You will focus on improving developer experience around LLMs and create tools and infrastructure to enhance productivity.

The ideal candidate has 3+ years in software engineering, strong Python skills, and hands-on experience with LLMs and APIs. This position emphasizes building foundational systems to streamline workflows and increase developer velocity.