Agent Experience Architect

AgentMail, Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 110,000 - 175,000; Full time

Benefits offered by this job

Equity

Job summary

AgentMail, Inc. is building the identity layer for AI agents, starting with email. We seek an Agent Experience Engineer to own how AI models and agents discover and use AgentMail, including AEO content, docs, and traces. You’ll publish candid analyses and lead cross-functional collaboration to improve agent usability.

You’ll measure impact through evals, benchmarks, and real-world agent traces, ensuring the surface and docs stay accurate and helpful for agents 3am without human oversight.

Qualifications

• You’ve built with agents daily and can judge product usability for agents.
• You work cross-functionally by default.
• You publish honest writeups even when results are inconvenient.
• You dive deep into messy technical problems and read agent traces.
• You understand retrieval: models pull chunks, not pages.

Responsibilities

• Own how agents discover and use AgentMail in workflows.
• Measure share of voice on prompts and improve visibility.
• Conduct evals and benchmarks on frontier/open-source models and agent harnesses.
• Analyze agent traces, read reasoning, and fix confusions.
• Develop the agent-facing surface: llms.txt, MCP descriptions, docs.
• Steer the AEO content engine and brief freelancers.
• Manage the weekly AEO briefing's action queue.

Skills

Agent experience

Cross-functional collaboration

Technical writing

Problem solving

Retrieval systems

Job description

AgentMail, Inc. is building the identity layer for AI agents, starting with email. We seek an Agent Experience Engineer to own how AI models and agents discover and use AgentMail, including AEO content, docs, and traces. You’ll publish candid analyses and lead cross-functional collaboration to improve agent usability.

You’ll measure impact through evals, benchmarks, and real-world agent traces, ensuring the surface and docs stay accurate and helpful for agents 3am without human oversight.