AI Agent Systems Engineer

plane assessoria empresarial e contábil; United States; On-site; USD 150,000 - 210,000; Full time

Job summary

Plane is seeking a software engineer to build the layer that lets agents participate in work directly, reading context from a workspace, taking action, and handing control back to humans.

You will design MCP servers, orchestration, vector store, and evaluation harness, shipping features that run with real customers and trusted data, across planes of deployment including customer clouds and on-premise environments.

Qualifications

• Two or more years building production software, including at least one year shipping features backed by large language models.
• Strong Python and experience operating services in production, including debugging them under real traffic.
• Experience building agent systems that call tools, covering the orchestration, the failure handling, and the loop control that keeps them from running away.
• Working knowledge of retrieval systems, including embedding models, chunking tradeoffs, vector databases, and the retrieval quality problems that follow.
• Experience building an evaluation harness for a non-deterministic system and using it to make a ship or no-ship call.
• Examples of AI features you shipped to real users rather than to demos or notebooks.

Responsibilities

• Build agent workflows that operate on Plane data, including planning loops, tool calling, multi-step execution, and recovery when a step fails.
• Design and ship MCP servers that expose Plane capabilities as tools, defining the schemas, permissions, and error semantics that make them safe for a model to call.
• Own the retrieval layer end to end, covering chunking strategy, embedding models, vector storage, hybrid search, and reranking.
• Build the agent interfaces that customers actually touch, including streaming output, intermediate step visibility, approval gates, and clean interruption.
• Establish the evaluation harness for everything you ship, defining datasets, regression suites, and the offline and online metrics that decide whether a change goes out.
• Instrument tracing, token cost, and latency across agent runs, and drive down the failure modes that show up in production.
• Design the permission and audit model for agent actions so an agent can only reach what the acting user can reach.
• Evaluate models, frameworks, and techniques as they land, and make a clear recommendation on what Plane should adopt and what it should skip.
• Partner with backend, frontend, and product engineers to take a working prototype to a shipped surface.

Skills

Python

Production software

Agent systems

Retrieval systems

Evaluation harness

Open source contributions

Tools

MCP server

Vector databases

Tool integration

Job description

Plane is seeking a software engineer to build the layer that lets agents participate in work directly, reading context from a workspace, taking action, and handing control back to humans.

You will design MCP servers, orchestration, vector store, and evaluation harness, shipping features that run with real customers and trusted data, across planes of deployment including customer clouds and on-premise environments.