Senior Staff Engineer - Autonomous AI Agents (Production)

Clera

Palo Alto (CA)

On-site

USD 200,000 - 300,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Engg is seeking an engineering leader to build and improve autonomous AI agents that handle executive tasks end to end, from scheduling to relationship management. You will own the full loop: shipping agents, measuring quality, and making improvement a repeatable science for real users in production.

The role requires 5+ years in data science or ML with a focus on evaluation systems, strong Python/SQL, and familiarity with Django/React/TypeScript for cross-domain work.

Qualifications

  • 5+ years in data science, machine learning, or analytics with focus on evaluation systems for production AI.
  • Experience designing evaluation methodologies: criteria, dataset construction, metrics, signal vs noise.
  • Production-quality Python and SQL; familiarity with Django, React and TypeScript for cross-domain work.
  • Strong statistical and experimental design skills: sampling, variance, bias, significance testing for non-deterministic systems.
  • Experience with LLM-as-a-judge systems, model-based graders, and grader calibration.

Responsibilities

  • Build agents that complete delegated executive tasks end to end, without human follow-up.
  • Design evaluation frameworks and metrics to measure agent quality.
  • Expand tasks agents can handle in tools executives use, with readiness evidence.
  • Turn production failures into proven, permanent fixes quickly.
  • Own detection at scale using observability and eval tooling to surface failure patterns.
  • Build self-recovery so agents stay on task when a tool or external service fails.
  • Make agent improvement measurable through end-to-end simulations.

Skills

Data science
Evaluation systems
Experiment design
Statistical analysis
LLM evaluation
Debug prompts
Agentic systems
End-to-end shipping

Education

CS or engineering degree

Tools

Python
SQL
Django
React
TypeScript

Job description

Engg is seeking an engineering leader to build and improve autonomous AI agents that handle executive tasks end to end, from scheduling to relationship management. You will own the full loop: shipping agents, measuring quality, and making improvement a repeatable science for real users in production.

The role requires 5+ years in data science or ML with a focus on evaluation systems, strong Python/SQL, and familiarity with Django/React/TypeScript for cross-domain work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Agents
Member of Technical Staff, Agents

Clera • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Royper Royco LLC • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Staff AI Systems Engineer - Autonomous Agents (Remote)
Staff AI Systems Engineer - Autonomous Agents (Remote)

People in AI • United States

Remote
USD 400,000 - 500,000
Fully remote across the United States
Equity + bonus
AI Engineer: Autonomous Agents & Production ML (Stock Options)
AI Engineer: Autonomous Agents & Production ML (Stock Options)

RecruiterForge • United States

On-site
USD 120,000 - 180,000
Stock options
Wellness stipend
Home office stipend
+2
Senior AI Agent Engineer - Production-Ready Systems
Senior AI Agent Engineer - Production-Ready Systems

Fdetimes • New York (NY)

On-site
USD 290,000 - 363,000
Health benefits
Dental and vision
Retirement benefits
+4
Senior Director of Engineering, AI Agents
Senior Director of Engineering, AI Agents

podium81 • United States

Remote
USD 200,000 - 350,000
Senior Agent AI Engineer Lead
Senior Agent AI Engineer Lead

EY • Irvine (CA)

Hybrid
USD 144,000 - 374,000
Medical & dental
401(k) plans
Flexible vacation
+1
Lead AI Engineer - Autonomous Agents Platform
Lead AI Engineer - Autonomous Agents Platform

Silver.dev • United States

Remote
USD 180,000 - 260,000
Senior AI Automation Architect - Production Systems
Senior AI Automation Architect - Production Systems

DrFirst • Poland (ME)

Remote
USD 150,000 - 200,000
Medical/Dental/Vision insurance
401K with company match
HSA contributions and annual limits
+2
Senior Software Engineer – Agents
Senior Software Engineer – Agents

Digivance Solutions • San Francisco (CA)

On-site
USD 120,000 - 180,000