Senior AI Agent Engineer for Autonomous Workflows

Royper Royco LLC

Palo Alto (CA)

On-site

USD 200,000 - 300,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Royper Royco LLC in Palo Alto seeks a data scientist or ML engineer to join a small, senior team building autonomous AI agents for executive workflows.

You will develop evaluation systems, metrics, and end-to-end agent capabilities, ensuring reliable task completion with measurable improvements for users.

Base salary: $200,000 to $300,000 annually. Visa sponsorship is not available.

Qualifications

  • 3+ years of data science or ML experience building evaluation systems, metrics, or product quality measurement.
  • Production-quality Python and SQL skills for analysis, large datasets, and automated pipelines.
  • Experience designing evaluation frameworks, representative datasets, meaningful metrics, and realistic end-to-end simulations.
  • Track record delivering production AI, ML, agent, or agent-evaluation systems for real users and measuring their impact.
  • Experience improving agent reliability, owning systems end to end, and using statistics and experiment design to evaluate changes.
  • Familiarity with post-training, fine-tuning, or reinforcement learning is useful.
  • Experience with Django, React, and TypeScript; the role also uses Python, SQL, Braintrust, and Raindrop.
  • Demonstrated progression and sustained experience in a role, with comfort working in a fast-moving, ambiguous environment.

Responsibilities

  • Build agents that complete delegated work end to end, without requiring users to check each step.
  • Define measurable success criteria and trusted ways to assess agent performance across tasks.
  • Develop and evaluate new agent capabilities before releasing them to users.
  • Investigate production failures and deliver durable fixes based on their underlying causes.
  • Build systems to detect known failure patterns and less predictable issues at scale, using tools such as Braintrust and Raindrop.
  • Improve agent recovery when tools or websites fail.
  • Create repeatable evaluation workflows that let engineers measure whether changes improve agent performance.

Skills

Data science / ML eval systems
Python
SQL
Experiment design
Agent reliability
Production AI/ML
Statistics
RL familiarity

Tools

Django
React
TypeScript
Braintrust
Raindrop

Job description

Royper Royco LLC in Palo Alto seeks a data scientist or ML engineer to join a small, senior team building autonomous AI agents for executive workflows.

You will develop evaluation systems, metrics, and end-to-end agent capabilities, ensuring reliable task completion with measurable improvements for users.

Base salary: $200,000 to $300,000 annually. Visa sponsorship is not available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Engineer for Data & Marketing Insights
Remote AI Engineer for Data & Marketing Insights

Royper Royco LLC • United States

Remote
USD 200,000 - 320,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Clera • United States

On-site
USD 200,000 - 300,000
Senior AI Agents Engineer — Build Autonomous Systems
Senior AI Agents Engineer — Build Autonomous Systems

The General Intelligence Company of New York • United States

On-site
USD 250,000 - 300,000
Equity
Comprehensive benefits
Flexible work setup
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Royper Royco LLC • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Staff Full-Stack Engineer for AI-Powered Science Platform
Staff Full-Stack Engineer for AI-Powered Science Platform

Royper Royco LLC • California

Hybrid
USD 240,000 - 275,000
Senior AI-Native Software Engineer: Lead Cross-Functional AI
Senior AI-Native Software Engineer: Lead Cross-Functional AI

Royper Royco LLC • Addison (TX)

On-site
USD 170,000 - 230,000
Senior AI Platform Architect for Autonomous Workflows
Senior AI Platform Architect for Autonomous Workflows

AGI Dialect, LLC • United States

On-site
USD 120,000 - 180,000
Member of Technical Staff, Agents
Member of Technical Staff, Agents

Clera • Palo Alto (CA)

On-site
USD 200,000 - 300,000
Senior & Principal Applied AI Engineer (Agentic Workflows / Autonomous Systems)
Senior & Principal Applied AI Engineer (Agentic Workflows / Autonomous Systems)

High Country Search Group • Denver (CO)

Hybrid
USD 225,000 - 350,000
Senior AI Agent Engineer & Platform Lead
Senior AI Agent Engineer & Platform Lead

EY • Orlando (FL)

Hybrid
USD 126,000 - 230,000