Senior AI Product Engineer - Production LLM Systems

Doist; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

Sunset is seeking a Senior AI Product Engineer to evolve our dissolution support agent into a trustworthy, production-ready product. You will move between customer experience, application code, retrieval, tool contracts, model behavior, evaluation, permissions, observability, rollout, and production learning.

You will design retrieval, context, structured outputs, tool orchestration, and deterministic boundaries for grounded, inspectable behavior, and ship with permissions and privacy controls.

Qualifications

• Experience shipping and operating LLM-backed software.
• Strong product engineering background spanning customer experience, code, and production ops.

Responsibilities

• Own AI-assisted dissolution support from problem to production behavior and iteration.
• Design retrieval, context, outputs, tool contracts, and deterministic boundaries.
• Build clear answer/status/handoff experiences for evidence-limited cases.
• Create evaluative sessions for routing, grounding, safety and customer outcomes.
• Ship with permissions, privacy controls, auditability, rollback, and recovery.
• Instrument runtime latency, cost, and support effort; handle failures constructively.
• Turn production failures into durable product improvements.
• Decide when to automate, assist, or keep human ownership with clear authority.

Skills

LLM-backed product

Production software

Python

Tools

LangGraph

LangChain

Job description

Sunset is seeking a Senior AI Product Engineer to evolve our dissolution support agent into a trustworthy, production-ready product. You will move between customer experience, application code, retrieval, tool contracts, model behavior, evaluation, permissions, observability, rollout, and production learning.

You will design retrieval, context, structured outputs, tool orchestration, and deterministic boundaries for grounded, inspectable behavior, and ship with permissions and privacy controls.