Senior Software Engineer, AI Agents & Platform Reliability

Fieldguide

San Francisco (CA)

On-site

USD 225,000 - 250,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive equity
Health benefits
401(k) plan
In-person offsites in the U.S.

Job summary

Fieldguide is seeking a Senior Software Engineer, Agents, to own how we measure and improve the quality of long-horizon agents on our AI platform. You’ll lead evaluations, build infrastructure, and drive reliability across production systems.

You will mentor peers, collaborate with the AI team, and help shape the platform roadmap while delivering scalable backend solutions that power agent execution and monitoring.

Qualifications

  • 1+ years working specifically on agents.
  • Strong experience working on an AI platform.
  • Demonstrated experience building evals and performing error analysis.
  • Backend engineering experience.

Responsibilities

  • Evals strategy and error-analysis to improve agent quality.
  • Design and build agent knowledge and evaluation infra.
  • Lead error analysis on agent behavior to drive reliability.
  • Build and harden backend systems for agent execution at scale.
  • Advance the AI platform's reliability roadmap with the team.
  • Mentor engineers on eval rigor and error-analysis practices.

Skills

Agents
Evals & error analysis
Backend engineering
AI platform

Job description

Fieldguide is seeking a Senior Software Engineer, Agents, to own how we measure and improve the quality of long-horizon agents on our AI platform. You’ll lead evaluations, build infrastructure, and drive reliability across production systems.

You will mentor peers, collaborate with the AI team, and help shape the platform roadmap while delivering scalable backend solutions that power agent execution and monitoring.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer — Long-Horizon Agents & Evals
AI Platform Engineer — Long-Horizon Agents & Evals

Fieldguide • San Francisco (CA)

On-site
USD 190,000 - 220,000
Equity compensation
Health benefits
Flexible time off
+4
Senior AI Engineer, Evaluation & Reliability (Remote)
Senior AI Engineer, Evaluation & Reliability (Remote)

Fieldguide • San Francisco (CA)

Remote
USD 200,000 - 250,000
Competitive compensation packages
Flexible PTO
401k
+3
Senior AI Agent Systems Engineer — Infra & Platform
Senior AI Agent Systems Engineer — Infra & Platform

Together • San Francisco (CA)

Remote
USD 250,000 - 300,000
Remote work flexibility
Equity
Health insurance
Senior AI Systems Engineer - Evaluation & Reliability
Senior AI Systems Engineer - Evaluation & Reliability

ExpertsHub.ai • San Francisco (CA)

On-site
USD 250,000 - 360,000
Equity
Medical Insurance
Dental Insurance
+4
Senior AI Agent Product Manager - Risk & Advisory
Senior AI Agent Product Manager - Risk & Advisory

Fieldguide • United States

Remote
USD 170,000 - 250,000
Competitive compensation
Meaningful ownership
Flexible PTO
+3
Platform Engineering Leader — Scale Core Services & AI
Platform Engineering Leader — Scale Core Services & AI

Fieldguide • San Francisco (CA)

Hybrid
USD 210,000 - 320,000
Equity
Health benefits
Flexible time off
+4
Senior Full-Stack Engineer for AI Agent Platform
Senior Full-Stack Engineer for AI Agent Platform

Skynett Studio • New York (NY)

On-site
USD 140,000 - 230,000
Senior Software Engineer, Agent Oversight & Observability
Senior Software Engineer, Agent Oversight & Observability

Scale AI, Inc. • San Francisco (CA)

On-site
USD 216,000 - 270,000
Equity
Health, dental & vision coverage
Generous PTO
+2
Senior Backend Engineer - AI Agents Platform
Senior Backend Engineer - AI Agents Platform

Actively • San Francisco (CA)

On-site
USD 180,000 - 220,000
Staff Software Engineer - Product (AI Agent Platform)
Staff Software Engineer - Product (AI Agent Platform)

Speedrun Talent Network • San Francisco (CA)

On-site
USD 200,000 - 400,000
Medical, Dental, and Vision benefits
Life Insurance and Disability Benefits
Retirement Plan (e.g., 401K)