Senior AI Agent Engineer - Remote, Equity, Unlimited PTO

Delphiventures; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Competitive base salary

Equity package

Comprehensive health benefits

Unlimited PTO policy with encouraged |

Remote-first culture

Job summary

Relay is hiring a Senior AI Agent Engineer on the Developer Experience team to own Relay's internal AI agent—a Slack-native assistant that teams use to investigate issues, answer questions, and perform operational work.

This hands-on builder role is measured by what the agent gets done, with emphasis on correctness, provenance, safety, and practical impact across Relay's workflows. You will turn expert workflows into repeatable agent skills and tests.

Qualifications

• 5+ years in software engineering, developer tooling, or platform engineering.
• Production experience with LLM agents: tool use, retrieval, structured outputs, orchestration.
• Experience building search, retrieval, or knowledge systems across structured and unstructured information.
• Strong TypeScript or Python and experience building API integrations.
• Experience designing evals or automated tests for nondeterministic software.
• Familiarity with permissions, secrets, auditability, and safe handling of side effects.
• Strong written communication; you can turn an expert's workflow into a precise spec.

Responsibilities

• Own the agent backlog; prioritize by impact, frequency, and risk.
• Review real misses and convert them into regression evals, fixed tools, or better guidance.
• Turn expert workflows into agent skills, decision logic, and escalation paths.
• Build knowledge systems with provenance and freshness for Relay's information.
• Improve retrieval, orchestration, and verification; own regressions through resolution.
• Measure task success, correction rate, latency, and cost, and report them.

Skills

Software engineering

LLM agents

Search/knowledge systems

TypeScript/Python

API integrations

Eval design

Permissions/safe handling

Written communication

MCP tooling

Slack apps

Knowledge graphs

Crypto/payments domain

Tools

N/A

Job description

Relay is hiring a Senior AI Agent Engineer on the Developer Experience team to own Relay's internal AI agent—a Slack-native assistant that teams use to investigate issues, answer questions, and perform operational work.

This hands-on builder role is measured by what the agent gets done, with emphasis on correctness, provenance, safety, and practical impact across Relay's workflows. You will turn expert workflows into repeatable agent skills and tests.