AI Operations Engineer - Ship Autonomous Agents

Coast; New York (NY); On-site; USD 150,000 - 180,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Flexible PTO

Finance tools access

Parental Leave

Accessories allowance

Education stipend

Free Friday lunch

Job summary

Coast is seeking an AI Operations Engineer to help build an AI-native company. You’ll own end-to-end initiatives across Sales, Customer Success, Marketing, Support, Finance, Risk, Product, and Operations, shipping autonomous agents and tools that save time and improve efficiency.

In six months you’ll deliver three or more agents, each backed by evals showing month-over-month improvements in Coast’s operating efficiency.

Qualifications

• 2–5 years in operations, product, solutions or forward-deployed engineering, internal tools, or a similar role at a fast-moving company.
• A track record of shipping AI workflows or automations that people use every day.
• Hands-on fluency with Claude Code, Cursor or similar coding agents, plus LLM tooling such as prompt design, tool use and MCP.
• You've built at least one agent with persistent memory or a feedback loop that made it better over time.
• Experience with evals: building test sets, scoring outputs and using the results to improve an agent.
• Comfort writing and reading code: SQL, plus Python or TypeScript scripting, APIs and webhooks.
• Clear communication with non-technical teammates. You can teach as well as build.
• High agency: you spot inefficient processes and fix them without waiting to be asked.

Responsibilities

• Find and prioritize the work. Sit with teams, map their workflows, and size the time saved. Turn what you find into a ranked backlog with the AI Lead.
• Build autonomous agents. Ship event-driven agents that do multi-step work across our stack. You’ll own the engineering off-the-shelf tools can’t do.
• Loop and orchestration: design agent loops, sub-agent handoffs, and when to act alone or elevate to a human.
• Memory and context: model shared memory as a knowledge graph, and decide what each agent sees, remembers and forgets.
• Custom tooling: build the tools our agents need.
• Traces and evals: trace every run, score outputs against test sets built from real outcomes, and prove each version beats the last.
• Measure impact: Define success metrics for each build, track adoption and time saved, and report results to leadership.
• Run what you ship: Own reliability, latency and cost in production, and catch regressions before users do. Partner with Security and IT on access, audit trails and the handling of sensitive data.
• Enable the company: architect the shared foundation the rest of Coast builds on: knowledge bases, application databases, templates, tools, and connectors. Then help people use it through training, office hours and hackathons, and grow a network of AI champions.
• Stay on the cutting edge: Try new models and tools as they land, measure them against what we run today, and keep raising the bar on everything you’ve built.

Skills

Claude Code

Cursor

LLM tooling

Prompt design

MCP

Agent memory

Evals

SQL

Python

TypeScript

APIs

Webhooks

Clear communication

High agency

Tools

Salesforce

Notion

Slack

Gmail

MCP servers

Job description

Coast is seeking an AI Operations Engineer to help build an AI-native company. You’ll own end-to-end initiatives across Sales, Customer Success, Marketing, Support, Finance, Risk, Product, and Operations, shipping autonomous agents and tools that save time and improve efficiency.

In six months you’ll deliver three or more agents, each backed by evals showing month-over-month improvements in Coast’s operating efficiency.