Founding Agent Systems Engineer — Build AI Agent Harnesses

Peano AI; Palo Alto (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

Peano AI in Palo Alto is hiring a Founding Agent Systems Engineer to build the agent harnesses, evaluation systems, workflows, and feedback loops behind our product.

This deeply technical role emphasizes Python and systems engineering, with focus on LLM agents, evaluation, and developer tools. You will enable agent collaboration, code inspection, testing, and production-ready systems at an early-stage startup with equity.

Qualifications

• Strong Python engineering experience.
• Experience building LLM agents and evaluation harnesses.
• Ability to build reliable, debuggable tooling.
• Experience with testing, benchmarking, CI.
• Ability to reason about agent behavior and product usefulness.
• Comfort across agent logic, infrastructure, and user-facing needs.
• Strong product intuition; capable of demos evolving to products.
• High ownership in an early-stage startup.

Responsibilities

• Build agent harnesses for multi-agent workflows and loops.
• Design evaluation environments to measure performance, reliability, cost, latency, quality.
• Build testing systems linking agent behavior, code changes, and results.
• Create workflows for agents to inspect code, change, test, and gauge improvements.
• Develop shared-memory, coordination, and task-management for teams of agents.
• Build infrastructure to track task success, regressions, latency, quality, and progress.
• Work on coding-agent workflows: refactoring, testing, debugging, code review, debt reduction.
• Support customer demos and applied workflows turning research into product experiences.
• Collaborate with ML systems engineers to run agent workloads on Agent Cloud.
• Turn research prototypes into reliable, production-quality systems.

Skills

Python

LLM agents

Eval harnesses

Developer tools

Automation workflows

Systems engineering

Testing/CI

Ownership

Job description

Peano AI in Palo Alto is hiring a Founding Agent Systems Engineer to build the agent harnesses, evaluation systems, workflows, and feedback loops behind our product.

This deeply technical role emphasizes Python and systems engineering, with focus on LLM agents, evaluation, and developer tools. You will enable agent collaboration, code inspection, testing, and production-ready systems at an early-stage startup with equity.