Senior Software Engineer, Foundation Agents & Evals

Fieldguide

United States

On-site

USD 170,000 - 210,000

Full time

9 days ago
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health
Dental
PTO

Job summary

Fieldguide is seeking a Senior Software Engineer, Agents, to own how we measure and improve agent quality. You will drive evals, error-analysis, and platform reliability for long-horizon agents, designing infrastructure to support evaluation, learning from failures, and hardening backend systems at scale.

You will mentor teammates, work on frontier AI problems, and contribute to platform-level improvements that affect every agent built on Fieldguide.

Qualifications

  • Backend engineering experience.
  • Strong experience with AI platforms.
  • 1+ years working specifically on agents.
  • Demonstrated experience building evals and performing error analysis.
  • Frontend experience is a plus; distributed systems experience is valuable.

Responsibilities

  • Own evals strategy and error-analysis practice to improve agent quality.
  • Design and build agent knowledge and evaluation infrastructure for Fieldguide’s long-horizon agents.
  • Lead error analysis on agent behavior and drive platform-level reliability improvements.
  • Build and harden backend systems that support agent execution, evaluation, and monitoring at scale.
  • Mentor engineers on the team and raise the bar for eval rigor.

Skills

Backend engineering
Agents
Eval & error analysis
Distributed systems
Platform engineering
Mentoring
Leadership

Job description

Fieldguide is seeking a Senior Software Engineer, Agents, to own how we measure and improve agent quality. You will drive evals, error-analysis, and platform reliability for long-horizon agents, designing infrastructure to support evaluation, learning from failures, and hardening backend systems at scale.

You will mentor teammates, work on frontier AI problems, and contribute to platform-level improvements that affect every agent built on Fieldguide.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Agents & Platform Reliability
Senior Software Engineer, AI Agents & Platform Reliability

Fieldguide • San Francisco (CA)

On-site
USD 225,000 - 250,000
Competitive equity
Health benefits
401(k) plan
+1
Senior Software Engineer (Foundation Agents)
Senior Software Engineer (Foundation Agents)

Fieldguide • United States

On-site
USD 170,000 - 210,000
Health
Dental
PTO
Software Engineer – Foundation Agents & Reliability
Software Engineer – Foundation Agents & Reliability

Fieldguide • United States

On-site
USD 140,000 - 200,000
Health
Dental
PTO
Senior Software Engineer, Agents (Foundation Agents)
Senior Software Engineer, Agents (Foundation Agents)

Fieldguide • San Francisco (CA)

On-site
USD 225,000 - 250,000
Competitive equity
Health benefits
401(k) plan
+1
Software Engineer (Foundation Agents)
Software Engineer (Foundation Agents)

Fieldguide • United States

On-site
USD 140,000 - 200,000
Health
Dental
PTO
AI Platform Engineer — Long-Horizon Agents & Evals
AI Platform Engineer — Long-Horizon Agents & Evals

Fieldguide • San Francisco (CA)

On-site
USD 190,000 - 220,000
Equity compensation
Health benefits
Flexible time off
+4
Software Engineer, Agents (Foundation Agents)
Software Engineer, Agents (Foundation Agents)

Fieldguide • San Francisco (CA)

On-site
USD 190,000 - 220,000
Equity compensation
Health benefits
Flexible time off
+4
Senior AI Engineer, Evaluation & Reliability (Remote)
Senior AI Engineer, Evaluation & Reliability (Remote)

Fieldguide • San Francisco (CA)

On-site
USD 200,000 - 250,000
Competitive compensation packages
Flexible PTO
401k
+3
Senior Software Engineer: AI Agent Training & Evaluations
Senior Software Engineer: AI Agent Training & Evaluations

Prolific • United States

Remote
USD 150,000 - 190,000
Remote working
Competitive salary
Senior Agent Infrastructure Engineer
Senior Agent Infrastructure Engineer

AgentField.ai • United States

On-site
USD 84,000 - 126,000