Senior AI Agent Engineer — Remote, Equity & Unlimited PTO

Relay (Uneven Labs, Inc.); United States; Remote; USD 180,000 - 230,000; Full time

Benefits offered by this job

Equity package

Health benefits

Unlimited PTO

Remote-first culture

Job summary

Relay (Uneven Labs, Inc.) is seeking a Senior AI Agent Engineer for the Developer Experience team to own Relay’s internal AI agent—Slack-native and integrated across our tools. You will investigate issues, answer questions, and complete operational work while shipping reliable AI capabilities that scale across teams.

This hands-on role focuses on building deterministic, testable agent behavior, improving workflows, and ensuring safe handling of permissions and side effects.

Qualifications

• 5+ years in software engineering, developer tooling, or platform engineering.
• Production experience with LLM agents: tool use, retrieval, structured outputs, orchestration
• Experience building search, retrieval, or knowledge systems across structured and unstructured information
• Strong TypeScript or Python and experience building API integrations
• Experience designing evals or automated tests for nondeterministic software
• Familiarity with permissions, secrets, auditability, and safe handling of side effects
• Strong written communication; you can turn an expert’s workflow into a precise spec

Responsibilities

• Cover US business hours and collaborate with remote teams.
• Own and improve the agent backlog; prioritize by impact, frequency, and risk.
• Turn expert workflows into agent skills, decision logic, and escalation paths.
• Build knowledge systems that connect and reason over Relay’s information with provenance.
• Improve retrieval, orchestration, and verification; track regressions to resolution.
• Measure task success, correction rate, latency, and cost, and report them.
• Integrate agents with internal systems via APIs and MCP tools.

Skills

5+ years in software engineering

Production experience with LLM agents

Knowledge retrieval/search systems

TypeScript or Python

Eval design for nondeterministic软件

Permissions, secrets, auditability

Strong written communication

Job description

Relay (Uneven Labs, Inc.) is seeking a Senior AI Agent Engineer for the Developer Experience team to own Relay’s internal AI agent—Slack-native and integrated across our tools. You will investigate issues, answer questions, and complete operational work while shipping reliable AI capabilities that scale across teams.

This hands-on role focuses on building deterministic, testable agent behavior, improving workflows, and ensuring safe handling of permissions and side effects.