Member of Technical Staff, Agents

Clera

United States

On-site

USD 200,000 - 300,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Clera is hiring for a role building autonomous AI agents for executive workflows. You will develop capabilities and evaluation frameworks to ensure tasks are completed reliably with measurable improvements reaching users quickly.

Join a senior team focusing on scalable, production-ready AI systems. The role emphasizes Python, SQL, Django, React, and TypeScript, with on-site work in Palo Alto, CA.

Qualifications

  • 3+ years data science or ML with evaluation systems.
  • Production-quality Python & SQL for analysis and large datasets.
  • Experience designing evaluation frameworks, representative datasets, metrics and simulations.
  • Track record delivering production AI/ML to real users and measuring impact.
  • Experience improving agent reliability and owning end-to-end systems.

Responsibilities

  • Build agents that complete delegated work end to end, without requiring users to check each step.
  • Define measurable success criteria and trusted ways to assess agent performance across tasks.
  • Develop and evaluate new agent capabilities before releasing them to users.
  • Investigate production failures and deliver durable fixes based on underlying causes.
  • Build systems to detect known failure patterns and less predictable issues at scale using Braintrust and Raindrop.
  • Improve agent recovery when tools or websites fail.
  • Create repeatable evaluation workflows to measure improvements in agent performance.

Skills

Evaluation frameworks
Experiment design
Production AI/ML
Agent reliability
Analytics
Statistics
Adaptive mindset

Tools

Python
SQL
Braintrust
Raindrop
Django
React
TypeScript

Job description

About the Role

Join a small, senior team building autonomous AI agents for executive workflows. You will develop agent capabilities and evaluation systems that help ensure real-world tasks are completed reliably, with measurable improvements reaching users quickly.

What You'll Do
  • Build agents that complete delegated work end to end, without requiring users to check each step.
  • Define measurable success criteria and trusted ways to assess agent performance across tasks.
  • Develop and evaluate new agent capabilities before releasing them to users.
  • Investigate production failures and deliver durable fixes based on their underlying causes.
  • Build systems to detect known failure patterns and less predictable issues at scale, using tools such as Braintrust and Raindrop.
  • Improve agent recovery when tools or websites fail.
  • Create repeatable evaluation workflows that let engineers measure whether changes improve agent performance.
What We're Looking For
  • At least 3 years of data science or machine learning experience building evaluation systems, metrics, or product quality measurement.
  • Production-quality Python & SQL skills for analysis, large datasets, and automated pipelines.
  • Experience designing evaluation frameworks, representative datasets, meaningful metrics, and realistic end-to-end simulations.
  • A track record delivering production AI, ML, agent, or agent-evaluation systems for real users and measuring their impact.
  • Experience improving agent reliability, owning systems end to end, and using statistics and experiment design to evaluate changes.
  • Familiarity with post-training, fine-tuning, or reinforcement learning is useful.
  • Experience with Django, React, and TypeScript; the role also uses Python, SQL, Braintrust, and Raindrop.
  • Demonstrated progression and sustained experience in a role, with comfort working in a fast-moving, ambiguous environment.
Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is not available.

Location

On-site in Palo Alto, California.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Agents
Member of Technical Staff, Agents

Royper Royco LLC • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Clera • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Full-Stack Engineer, Agent Evaluation & Reliability
Full-Stack Engineer, Agent Evaluation & Reliability

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 120,000 - 180,000
Member of Technical Staff, Full Stack
Member of Technical Staff, Full Stack

true-talent-solutions-partners • San Francisco (CA)

On-site
USD 180,000 - 200,000
Senior Agent Engineer
Senior Agent Engineer

Job Envoy • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Agent Engineer
Agent Engineer

Clera • United States

On-site
USD 180,000 - 260,000
Member of Technical Staff, Product
Member of Technical Staff, Product

Raydar • San Francisco (CA)

On-site
USD 200,000 - 400,000
Equity
Visa sponsorships
Senior Software Engineer – Agent Systems
Senior Software Engineer – Agent Systems

kraken.com • United States

Remote
USD 180,000 - 260,000
Senior/Staff Product Engineer, Applied AI and Agents
Senior/Staff Product Engineer, Applied AI and Agents

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 200,000 - 300,000
Staff AI Engineer, Agents and Evals
Staff AI Engineer, Agents and Evals

MimoLabs • United States

Remote
USD 170,000 - 220,000
Equity with four-year vesting and one‑