Remote Agentic AI Analyst: Design & Validate AI Agents

Invoca; Seattle (WA); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Day-One Health Benefits

Mental Wellbeing

Wellness Subsidy

Flexible Time Off

Paid Holidays

Paid Family Leave

Paid Medical Leave

401(k) with company match

Sabbatical after seven years

Job summary

Invoca is seeking an Agentic AI Analyst to shape and refine agentic AI applications across product, data science, and customer success. You will design MCP tool integrations, author agent skills, and build evaluation harnesses to measure real-world performance.

You will run simulations, monitor production metrics, and work with cross-functional partners to translate insights into prioritized product work. Strong problem-solving, curiosity about AI capabilities, and clear communication are

Qualifications

• Experience with agentic AI systems in production environments.
• ,

Responsibilities

• Design MCP tool integrations and author tool specifications.
• Build and run agent evaluation frameworks.
• Simulate agent behavior pre-production and monitor performance.

Skills

Agentic AI systems

Multi-step reasoning

Tool integration

Prompts & skills authoring

Eval design

Simulation/testing

LangChain/LangGraph

Independent work

Data-driven decisions

Cross-functional collaboration

Tools

MCP servers

APIs & Webhooks

JSON/JSON Schema

Job description

Invoca is seeking an Agentic AI Analyst to shape and refine agentic AI applications across product, data science, and customer success. You will design MCP tool integrations, author agent skills, and build evaluation harnesses to measure real-world performance.

You will run simulations, monitor production metrics, and work with cross-functional partners to translate insights into prioritized product work. Strong problem-solving, curiosity about AI capabilities, and clear communication are