Founding Agent Systems Engineer — Build AI Agent Harnesses

Peano AI

Palo Alto (CA)

On-site

USD 180,000 - 250,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Peano AI in Palo Alto is hiring a Founding Agent Systems Engineer to build the agent harnesses, evaluation systems, workflows, and feedback loops behind our product.

This deeply technical role emphasizes Python and systems engineering, with focus on LLM agents, evaluation, and developer tools. You will enable agent collaboration, code inspection, testing, and production-ready systems at an early-stage startup with equity.

Qualifications

  • Strong Python engineering experience.
  • Experience building LLM agents and evaluation harnesses.
  • Ability to build reliable, debuggable tooling.
  • Experience with testing, benchmarking, CI.
  • Ability to reason about agent behavior and product usefulness.
  • Comfort across agent logic, infrastructure, and user-facing needs.
  • Strong product intuition; capable of demos evolving to products.
  • High ownership in an early-stage startup.

Responsibilities

  • Build agent harnesses for multi-agent workflows and loops.
  • Design evaluation environments to measure performance, reliability, cost, latency, quality.
  • Build testing systems linking agent behavior, code changes, and results.
  • Create workflows for agents to inspect code, change, test, and gauge improvements.
  • Develop shared-memory, coordination, and task-management for teams of agents.
  • Build infrastructure to track task success, regressions, latency, quality, and progress.
  • Work on coding-agent workflows: refactoring, testing, debugging, code review, debt reduction.
  • Support customer demos and applied workflows turning research into product experiences.
  • Collaborate with ML systems engineers to run agent workloads on Agent Cloud.
  • Turn research prototypes into reliable, production-quality systems.

Skills

Python
LLM agents
Eval harnesses
Developer tools
Automation workflows
Systems engineering
Testing/CI
Ownership

Job description

Peano AI in Palo Alto is hiring a Founding Agent Systems Engineer to build the agent harnesses, evaluation systems, workflows, and feedback loops behind our product.

This deeply technical role emphasizes Python and systems engineering, with focus on LLM agents, evaluation, and developer tools. You will enable agent collaboration, code inspection, testing, and production-ready systems at an early-stage startup with equity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Agent Harness Engineer
Founding Agent Harness Engineer

Peano AI • Palo Alto (CA)

On-site
USD 180,000 - 250,000
Founding AI Platform Engineer
Founding AI Platform Engineer

Gallop Intelligence Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Equity
Competitive salary
Senior Founding Engineer - AI Agents & Scalable Systems
Senior Founding Engineer - AI Agents & Scalable Systems

present of AI • Arkansas

On-site
USD 90,000 - 130,000
Founding AI Systems Engineer, Enterprise Agents
Founding AI Systems Engineer, Enterprise Agents

People in AI • United States

On-site
USD 140,000 - 200,000
Senior Agent Engineer
Senior Agent Engineer

Job Envoy • Palo Alto (CA)

On-site
USD 180,000 - 240,000
AI Agent Engineer — Production AI & LLM Workflows
AI Agent Engineer — Production AI & LLM Workflows

Robotics Technologies • Cupertino (CA)

On-site
USD 82,000 - 117,000
P2P AI Engineer — Local AI & Agent Harness
P2P AI Engineer — Local AI & Agent Harness

Tether • United States

Remote
USD 150,000 - 230,000
Founding Agentic AI Engineer - Build Production Agents
Founding Agentic AI Engineer - Build Production Agents

Tecla • United States

On-site
USD 84,000 - 100,000
Senior Agent Harness Engineer - Platform & AI Ops
Senior Agent Harness Engineer - Platform & AI Ops

Savvy Wealth • New York (NY)

On-site
USD 180,000 - 235,000
Competitive salary and equity package
Unlimited PTO + paid company holidays
Comprehensive medical, dental, vision
Founding AI Agent Harness Engineer (Remote)
Founding AI Agent Harness Engineer (Remote)

Bolder Apps • United States

Remote
USD 140,000 - 210,000