Member of Technical Staff, Agents

Digitailor; Palo Alto (CA); On-site; USD 200,000 - 300,000; Full time

Job summary

Digitailor is building autonomous AI agents to handle executive workflows. You will develop agent capabilities and the evaluation systems needed to verify reliability before changes reach users.

Join a senior team focused on production-level Python/SQL, evaluation metrics, and end-to-end agent delivery. On-site in Palo Alto with visa sponsorship not available.

Qualifications

• 3+ years in data science or ML building evaluation systems.
• Production-level Python and SQL for analysis on large datasets and automated pipelines.
• Experience designing evaluation frameworks with metrics and benchmarks.
• Experience with statistics, experiment design, and realistic end-to-end simulations.
• Background building or operating agents for real users and improving reliability; RL experience is valuable.
• Experience owning and shipping systems to users; familiarity with Django, React, and TypeScript.

Responsibilities

• Build agents that complete delegated work end to end without requiring users to check every step.
• Design reliable measures of agent success and maintain representative evaluations for real-world tasks.
• Develop new agent capabilities for tools executives already use, and verify readiness before launch.
• Investigate production failures, identify root causes, and deliver fixes that prevent recurrence.
• Build scalable failure detection for known issues and unexpected patterns using evaluation and monitoring tools.
• Improve agent recovery when a tool or website fails.
• Create repeatable workflows so engineers can measure whether agent changes improve performance.

Skills

Data science

Machine learning

Python

SQL

Evaluation frameworks

Experiment design

Statistics

Reinforcement learning

Tools

Django

React

TypeScript

Job description

About The Role

Join a small, senior team building autonomous AI agents that handle real executive workflows. You will develop agent capabilities and the evaluation systems needed to verify reliability before changes reach users.

What You'Ll Do

Build agents that complete delegated work end to end without requiring users to check every step. Design reliable measures of agent success and maintain representative evaluations for real-world tasks. Develop new agent capabilities for tools executives already use, and verify their readiness before launch. Investigate production failures, identify root causes, and deliver fixes that prevent recurrence. Build scalable failure detection for known issues and unexpected patterns using evaluation and monitoring tools. Improve agent recovery when a tool or website fails. Create repeatable workflows so engineers can measure whether agent changes improve performance.

What We'Re Looking For

At least 3 years in data science or machine learning roles building or delivering evaluation systems, metrics, or product quality measurement. Production-level Python and SQL skills for analysis, large datasets, and automated pipelines. Experience designing evaluation frameworks, including success criteria, representative datasets, appropriate metrics, and trustworthy benchmarks. Experience using statistics, experiment design, and realistic end-to-end simulations to evaluate agent changes. Background building or operating agents for real users and improving their reliability; experience with post-training, fine-tuning, or reinforcement learning is valuable. Experience owning and shipping systems to users, with demonstrated impact; familiarity with Django, React, and TypeScript. A track record of sustained contribution and growth in a role, founding a startup, or earning a promotion. Compensation & Benefits Base

Salary

$200,000 to $300,000 annually. Visa sponsorship is not available.

Location

On-site in Palo Alto, California, with four days per week in the office.