Full-Stack Engineer, Agent Evaluation & Reliability

Engg

San Francisco (CA)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Visa sponsorship
On-site in San Francisco
Competitive salary

Job summary

true-talent-solutions-partners in San Francisco is hiring a Full-Stack Engineer focused on AI agent evaluation and reliability infrastructure. You will build backend systems, data models, and data pipelines, enabling measurable agent performance and robust production features.

The role emphasizes hands-on backend work with TypeScript/Node.js, PostgreSQL, Redis, and API design, with visa sponsorship available and a competitive on-site salary in SF.

Qualifications

  • 3+ years of experience building and shipping production systems as a full‑stack engineer.
  • Hands-on machine learning model development experience and evaluating AI agents.
  • Strong backend skills with TypeScript and Node.js or Bun.
  • Strong PostgreSQL skills with query optimization and Redis experience.

Responsibilities

  • Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, and quality criteria.
  • Develop and operate enterprise integrations including authentication, data syncing, retries, monitoring, and production support.
  • Ship features across the stack from design to deployment and monitoring.
  • Work with customers to diagnose system failures and turn needs into reusable capabilities.
  • Build data pipelines and interfaces for collecting, analyzing, and visualizing evaluation results.

Skills

TypeScript
Node.js
Bun
PostgreSQL
Redis
APIs
Data pipelines
Observability
Production troubleshooting
Full-stack engineering

Education

Bachelor's degree or equivalent

Tools

PostgreSQL
Redis
APIs

Job description

# Full-Stack Engineer, Agent Evaluation & Reliabilitytrue-talent-solutions-partners · San Francisco## About the roleJoin a small, technical team building AI agent evaluation and reliability infrastructure for enterprise customers. This backend-leaning full-stack role focuses on making agent performance measurable and improving the systems that support reliable AI products.## What you'll do* Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, and quality criteria.* Develop and operate enterprise integrations, including authentication, data syncing, retries, monitoring, and production support.* Ship features across the stack, from technical design and implementation through deployment, monitoring, and iteration.* Work with customers to diagnose system failures and turn their needs into reusable product capabilities.* Build data pipelines and interfaces for collecting, analyzing, and visualizing evaluation results.## What we're looking for* At least 3 years of experience building and shipping production systems as a full-stack engineer, ideally including work at a fast-paced startup.* Hands-on machine learning model development experience, along with knowledge of evaluating and testing AI agents or other nondeterministic systems.* Strong backend skills with TypeScript and Node.js or Bun, and experience building production frontend features.* Strong PostgreSQL skills, including query optimization, and practical experience with Redis, job queues, background workers, or workflow systems.* Experience designing APIs and backend services, building evaluation data pipelines, and developing dashboards or visualization interfaces.* Familiarity with observability, monitoring, logging, and production troubleshooting. COMPENSATION & BENEFITS Base salary: $120,000 to $180,000 annually. Visa sponsorship is available. LOCATION On-site in San Francisco, California, United States.Apply at true-talent-solutions-partnersOpens true-talent-solutions-partners's own careers pageSalary: $120-180KLocation: San FranciscoLevel: Mid-levelExperience: 3+ yearsPosted: Oct 17, 2026Open for: 27 days
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Full-Stack Engineer, Agent Evaluation & Reliability
Full-Stack Engineer, Agent Evaluation & Reliability

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 120,000 - 180,000
Full-Stack Engineer: AI Evaluation & Reliability
Full-Stack Engineer: AI Evaluation & Reliability

Engg • San Francisco (CA)

On-site
USD 120,000 - 180,000
Visa sponsorship
On-site in San Francisco
Competitive salary
Member of Technical Staff, Full Stack
Member of Technical Staff, Full Stack

true-talent-solutions-partners • San Francisco (CA)

On-site
USD 180,000 - 200,000
Full-Stack Engineer for AI Evaluation & Reliability
Full-Stack Engineer for AI Evaluation & Reliability

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 120,000 - 180,000
Mid/Senior Full Stack AI Engineer
Mid/Senior Full Stack AI Engineer

Engg • San Francisco (CA)

On-site
USD 180,000 - 250,000
Full Stack Engineer
Full Stack Engineer

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 150,000 - 275,000
Visa sponsorship
Member of Technical Staff, Product Seed-stage, deployment-first AI company San Francisco, California $200k to $400k USD base a year Posted yesterday
Member of Technical Staff, Product Seed-stage, deployment-first AI company San Francisco, California $200k to $400k USD base a year Posted yesterday

Raydar • San Francisco (CA)

On-site
USD 200,000 - 400,000
Backend-Focused Full-Stack Engineer, AI Agent Systems (SF)
Backend-Focused Full-Stack Engineer, AI Agent Systems (SF)

true-talent-solutions-partners • San Francisco (CA)

On-site
USD 180,000 - 200,000
Full-Stack Engineer — AI Agent Reliability (SF On-Site)
Full-Stack Engineer — AI Agent Reliability (SF On-Site)

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 150,000 - 275,000
Visa sponsorship
Forward Deployed AI Engineer
Forward Deployed AI Engineer

Engg • San Francisco (CA)

On-site
USD 180,000 - 300,000
Visa sponsorship