LLM Agent Engineer: Reliability, Adoption & Production

Mercor; Miami (FL); On-site; USD 120,000 - 190,000; Full time

Job summary

Obsidian is seeking engineers to build and operate LLM agents in production, with real visibility into how agents are used inside a company.

You have shipped an agent used by real users, and you know how to tell whether changes improved it. You will work on long-running agents, internal monoagents, and reusable skills that connect data and playbooks, while tracking costs and performance across systems.

Qualifications

• Experience shipping an agent that real users relied on.
• Ability to measure agent performance after changes.
• Experience running agents beyond a single request with schedules or long-running tasks.

Responsibilities

• Build and operate LLM agents in production with real visibility into usage.
• Design and discuss how teams evaluate agent reliability and adoption.
• Share concrete war stories about tradeoffs and failures in real systems.

Skills

LLM agent development

Production-grade systems

A/B testing & evaluation

Long-running workflows

Observability & cost tracking

Job description

Obsidian is seeking engineers to build and operate LLM agents in production, with real visibility into how agents are used inside a company.

You have shipped an agent used by real users, and you know how to tell whether changes improved it. You will work on long-running agents, internal monoagents, and reusable skills that connect data and playbooks, while tracking costs and performance across systems.