Senior Member of Technical Staff, Agents

Clera

Palo Alto (CA)

On-site

USD 200,000 - 300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Clera is hiring for a role building autonomous AI capabilities to support executive productivity in Palo Alto. You will craft agents that finish delegated tasks end-to-end with minimal oversight, and establish robust evaluation systems to prove improvements before user release.

Seeking a candidate with 3+ years in data science or ML, strong Python/SQL production skills, and a track record of designing measurable evaluation frameworks.

Qualifications

  • 3+ years in data science or ML evaluating systems.
  • Production-quality Python/SQL for large datasets and pipelines.
  • Experience designing evaluation frameworks with metrics and benchmarks.
  • Degree from a strong engineering program and proven impact.

Responsibilities

  • Build end-to-end agents to complete delegated work with minimal oversight.
  • Define and measure agent quality with reliable success metrics.
  • Develop agent capabilities for existing executive tools and evaluate readiness.
  • Investigate production failures and ship fixes to prevent repeats.
  • Build detection systems to surface failure patterns at scale.
  • Improve agent recovery when tools or websites fail.
  • Create repeatable evaluation workflows to measure impact of changes.

Skills

Python
SQL
Django
React
TypeScript
Evaluation frameworks
ML systems

Education

Engineering degree

Tools

Braintrust
Raindrop
Harness

Job description

About the Role

Join a small, fast-moving team building autonomous AI capabilities for executive productivity. You will develop agent capabilities and evaluation systems that help ensure important tasks are completed reliably, and that improvements are proven before reaching users.

What You'll Do
  • Build agents that complete delegated work end to end, with minimal need for executive oversight.

  • Define and measure agent quality so the team can confidently assess how often tasks are completed correctly.

  • Develop new agent capabilities for the tools executives already use, and evaluate readiness before launch.

  • Investigate production failures, identify underlying causes, and ship fixes that prevent repeat issues.

  • Build detection systems to surface known failure patterns and unexpected issues at scale.

  • Improve agent recovery when tools or websites fail.

  • Create repeatable evaluation workflows that let engineers measure the impact of changes.

What We're Looking For
  • At least 3 years in data science or machine learning roles building or delivering evaluation systems, metrics, or quality measurement for products or systems.

  • Production-quality Python and SQL skills for analysis, large datasets, and automated pipelines.

  • Experience designing evaluation frameworks, including measurable success criteria, representative datasets, appropriate metrics, and reliable benchmarks.

  • A track record of relevant impact, sustained experience in a role with demonstrated progression, and a degree from a strong engineering program.

  • Experience with applied AI or machine learning systems and a collaborative, iterative approach to solving ambiguous problems.

  • Relevant tools and technologies include Python, SQL, Django, React, TypeScript, harness engineering, Braintrust, and Raindrop.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is not available.

Location

On-site in Palo Alto, California. The team works in the office four days per week.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Member of Technical Staff, Agents
Senior Member of Technical Staff, Agents

OpenKrill • United States

Remote
USD 200,000 - 300,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Clera • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Openkrill • United States

Hybrid
USD 200,000 - 300,000
Senior Agent Engineer
Senior Agent Engineer

Openkrill • United States

Remote
USD 150,000 - 210,000
Senior Agent Engineer
Senior Agent Engineer

Clera • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Full-Stack Engineer, Agent Evaluation & Reliability
Full-Stack Engineer, Agent Evaluation & Reliability

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 120,000 - 180,000
Senior Applied AI Engineer
Senior Applied AI Engineer

Clera • San Francisco (CA)

On-site
USD 150,000 - 250,000
Visa sponsorship
Agent Engineer
Agent Engineer

OpenKrill • United States

Remote
USD 150,000 - 230,000
Software Engineer, Mid-Level to Staff+
Software Engineer, Mid-Level to Staff+

True Talent Solutions Partners • San Francisco (CA)

On-site
USD 225,000 - 425,000
Visa sponsorship
Competitive compensation
On-site workspace in SF
Staff Engineer — Agentic AI for Desktop Engineering
Staff Engineer — Agentic AI for Desktop Engineering

Clera • San Francisco (CA)

On-site
Confidential