Full-Stack Engineer for AI Evaluation & Reliability

True Talent Solutions Partners; San Francisco (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

True Talent Solutions Partners in San Francisco, CA, is seeking a backend‑focused full‑stack engineer to build AI agent evaluation and reliability infrastructure for enterprise customers. This role emphasizes making agent performance measurable and sustaining reliable AI products.

You will ship features end‑to‑end, design scalable data models, and collaborate with customers to translate needs into reusable capabilities, with a strong emphasis on backend TypeScript/Node.js, PostgreSQL, and

Qualifications

• 3+ years building and shipping production systems as a full-stack engineer.
• Hands-on ML model development experience and evaluating AI agents.
• Strong backend skills with TypeScript and Node.js or Bun.
• Strong PostgreSQL skills, including query optimization, Redis, and queues.
• Experience designing APIs and backend services; observability and troubleshooting.

Responsibilities

• Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, and quality criteria.
• Develop and operate enterprise integrations, including authentication, data syncing, retries, monitoring, and production support.
• Ship features across the stack, from technical design and implementation through deployment, monitoring, and iteration.
• Work with customers to diagnose system failures and turn their needs into reusable product capabilities.
• Build data pipelines and interfaces for collecting, analyzing, and visualizing evaluation results.

Skills

TypeScript

Node.js

Bun

PostgreSQL

Redis

APIs

Data pipelines

Dashboards

Job description

True Talent Solutions Partners in San Francisco, CA, is seeking a backend‑focused full‑stack engineer to build AI agent evaluation and reliability infrastructure for enterprise customers. This role emphasizes making agent performance measurable and sustaining reliable AI products.

You will ship features end‑to‑end, design scalable data models, and collaborate with customers to translate needs into reusable capabilities, with a strong emphasis on backend TypeScript/Node.js, PostgreSQL, and